-- Logs begin at Tue 2022-08-02 09:27:44 UTC, end at Tue 2022-08-02 10:28:29 UTC. -- Aug 02 09:56:27.966506 dv-cinder-850318-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 02 09:56:27.979654 dv-cinder-850318-6-smb devstack@keystone.service[80324]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 02 09:56:27.982231 dv-cinder-850318-6-smb devstack@keystone.service[80324]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 09:56:27 2022] *** Aug 02 09:56:27.982231 dv-cinder-850318-6-smb devstack@keystone.service[80324]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 09:56:27.982231 dv-cinder-850318-6-smb devstack@keystone.service[80324]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 09:56:27.982231 dv-cinder-850318-6-smb devstack@keystone.service[80324]: nodename: dv-cinder-850318-6-smb Aug 02 09:56:27.982231 dv-cinder-850318-6-smb devstack@keystone.service[80324]: machine: x86_64 Aug 02 09:56:27.982231 dv-cinder-850318-6-smb devstack@keystone.service[80324]: clock source: unix Aug 02 09:56:27.982231 dv-cinder-850318-6-smb devstack@keystone.service[80324]: pcre jit disabled Aug 02 09:56:27.982231 dv-cinder-850318-6-smb devstack@keystone.service[80324]: detected number of CPU cores: 4 Aug 02 09:56:27.982231 dv-cinder-850318-6-smb devstack@keystone.service[80324]: current working directory: / Aug 02 09:56:27.982231 dv-cinder-850318-6-smb devstack@keystone.service[80324]: detected binary path: /usr/bin/uwsgi-core Aug 02 09:56:27.982231 dv-cinder-850318-6-smb devstack@keystone.service[80324]: your processes number limit is 47680 Aug 02 09:56:27.982231 dv-cinder-850318-6-smb devstack@keystone.service[80324]: your memory page size is 4096 bytes Aug 02 09:56:27.983018 dv-cinder-850318-6-smb devstack@keystone.service[80324]: detected max file descriptor number: 2048 Aug 02 09:56:27.983018 dv-cinder-850318-6-smb devstack@keystone.service[80324]: lock engine: pthread robust mutexes Aug 02 09:56:27.983018 dv-cinder-850318-6-smb devstack@keystone.service[80324]: thunder lock: enabled Aug 02 09:56:27.983018 dv-cinder-850318-6-smb devstack@keystone.service[80324]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 02 09:56:27.983018 dv-cinder-850318-6-smb devstack@keystone.service[80324]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 09:56:28.021374 dv-cinder-850318-6-smb devstack@keystone.service[80324]: Python main interpreter initialized at 0x55ea100929c0 Aug 02 09:56:28.021374 dv-cinder-850318-6-smb devstack@keystone.service[80324]: python threads support enabled Aug 02 09:56:28.021374 dv-cinder-850318-6-smb devstack@keystone.service[80324]: your server socket listen backlog is limited to 100 connections Aug 02 09:56:28.021374 dv-cinder-850318-6-smb devstack@keystone.service[80324]: your mercy for graceful operations on workers is 90 seconds Aug 02 09:56:28.021713 dv-cinder-850318-6-smb devstack@keystone.service[80324]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 09:56:28.021787 dv-cinder-850318-6-smb devstack@keystone.service[80324]: *** Operational MODE: preforking *** Aug 02 09:56:28.022045 dv-cinder-850318-6-smb devstack@keystone.service[80324]: *** uWSGI is running in multiple interpreter mode *** Aug 02 09:56:28.022045 dv-cinder-850318-6-smb devstack@keystone.service[80324]: spawned uWSGI master process (pid: 80324) Aug 02 09:56:28.022251 dv-cinder-850318-6-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 02 09:56:28.023042 dv-cinder-850318-6-smb devstack@keystone.service[80324]: spawned uWSGI worker 1 (pid: 80329, cores: 1) Aug 02 09:56:28.023128 dv-cinder-850318-6-smb devstack@keystone.service[80324]: spawned uWSGI worker 2 (pid: 80330, cores: 1) Aug 02 09:56:28.025086 dv-cinder-850318-6-smb devstack@keystone.service[80324]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 09:56:33.613914 dv-cinder-850318-6-smb devstack@keystone.service[80329]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:56:33.613914 dv-cinder-850318-6-smb devstack@keystone.service[80329]: from cryptography.utils import int_from_bytes Aug 02 09:56:33.614667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:56:33.614667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: from cryptography.utils import int_from_bytes Aug 02 09:56:33.615081 dv-cinder-850318-6-smb devstack@keystone.service[80329]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:56:33.615081 dv-cinder-850318-6-smb devstack@keystone.service[80329]: from cryptography.utils import int_from_bytes Aug 02 09:56:33.615188 dv-cinder-850318-6-smb devstack@keystone.service[80330]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:56:33.615188 dv-cinder-850318-6-smb devstack@keystone.service[80330]: from cryptography.utils import int_from_bytes Aug 02 09:56:33.664029 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 09:56:33.664211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 09:56:33.664299 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 09:56:33.664384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 09:56:33.664481 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] command line args: [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 09:56:33.664566 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] command line args: [] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 09:56:33.664709 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 09:56:33.664789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 09:56:33.664894 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ================================================================================ {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 09:56:33.664973 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ================================================================================ {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 09:56:33.665161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] admin_token = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.665246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] admin_token = **** {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.665408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] config_dir = [] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.665486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] config_dir = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.665596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.665674 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.665778 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] config_source = [] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.665855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] config_source = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.665961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] debug = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.666045 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] debug = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.666159 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.666449 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.666589 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.666960 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.667061 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.667170 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.667265 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.667364 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.667464 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.667557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.667657 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.667749 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] list_limit = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.667846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] log_config_append = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.667948 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] log_config_append = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.668053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.668147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.668239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] log_dir = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.668336 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] log_dir = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.668436 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] log_file = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.668582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] log_file = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.668681 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.668758 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.668873 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.668953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.669073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.669155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.669297 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.669377 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.669494 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.669575 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.669654 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.669773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.669883 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.669968 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.670137 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.670219 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.670379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.670500 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.670620 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.670702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.670859 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.670975 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.671093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.671183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.671344 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.671431 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.671592 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.671732 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.671875 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.671975 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.672373 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.85/identity {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.672474 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.85/identity {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.672587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] publish_errors = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.672671 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] publish_errors = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.672824 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.672949 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.673058 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.673140 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.673236 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.673352 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.673486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.673583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.673723 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.673800 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.673961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] standard_threads = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.674038 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] standard_threads = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.674193 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.674334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.674439 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.674515 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.674621 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.675376 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.675376 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] use_journal = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.675522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] use_journal = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.675592 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] use_json = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.675661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] use_json = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.675729 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] use_stderr = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.675797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] use_stderr = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.675874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] use_syslog = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.675945 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] use_syslog = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.676074 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.676187 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:56:33.676328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.676502 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.676711 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.676799 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.676976 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.677060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.677228 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.677312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.677483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.677561 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.677724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.677800 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.677976 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.678051 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.678215 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.678298 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.678467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.678549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.678717 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.678793 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.678970 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.679048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.679208 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.679290 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.679477 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.679577 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.679696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.679781 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.679946 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.680021 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.680194 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.680277 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.680424 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.680535 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.680705 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.680783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.680963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.681037 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.681210 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.681288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.681447 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.681523 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.681702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.681777 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.681965 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.682048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.682220 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.682295 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.682474 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.682555 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.682709 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.682787 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.682942 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.683016 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.683175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.683258 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.683414 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.683500 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.683664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.683741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.683912 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.684031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.684146 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.684221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.684379 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.684456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.684658 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.684747 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.684911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.684993 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.685152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.685234 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.685402 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.685486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.685638 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.685714 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.685876 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.685955 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.686112 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.686263 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.686337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.686405 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.686567 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.686645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.686798 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.686881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.687030 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.687110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.687270 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.687354 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.687518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.687609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.687752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.687829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.687991 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.688065 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.688221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.688304 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.688486 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.688566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.688715 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.688792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.688966 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.689051 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.689197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.689272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.689437 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.689518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.689823 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.689965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.689965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.690145 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.690239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.690337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.690434 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.690610 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.690785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.690921 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.691050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.691168 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.691258 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.691330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.691482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.691566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.691720 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.691810 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.691985 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.692065 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.692227 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.692313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.692489 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.692570 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.692723 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.692803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.692962 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.693056 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.693236 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.693321 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.693478 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.693558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.693729 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.693852 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.693976 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.694052 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.694213 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.694290 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.694452 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.694532 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.694688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.694767 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.694940 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.695055 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.695179 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.695254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.695419 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.695543 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.695664 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.695740 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.695904 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.695983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.696142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.696218 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.696381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.696510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.696646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.696728 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.696870 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.696949 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.697136 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.697213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.697378 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.697464 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.697623 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.697700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.697864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.697949 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.698096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.698170 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.698337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.698421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.698576 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.698652 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.698814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.698900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.699047 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.699125 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.699279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.699355 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.699511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.699587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.699747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.699825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.699979 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.700055 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.700224 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.700301 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.700479 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.700560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.700733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.700822 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.700977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.701054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.701235 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.701313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.701499 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.701575 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.701741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.701825 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.701976 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.external = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.702058 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] auth.external = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.702207 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.702283 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.702506 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.702612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.702742 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.702829 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.702977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.password = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.703055 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] auth.password = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.703210 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] auth.token = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.703288 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] auth.token = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.703451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.703536 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.703688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.703767 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.703937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.704014 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.704169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.704253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.704420 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.704515 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.704697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.704775 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.704936 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.705030 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.705173 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] credential.caching = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.705250 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.705425 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.705502 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.705675 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.705761 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.706564 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.706695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.706830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.706964 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.707102 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.707195 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.707271 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.707342 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.707478 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.707601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.707736 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.707865 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.707979 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.708111 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.708237 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.708370 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.708550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.708686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.708801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.708941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.709070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.709216 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.709327 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.709466 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.709590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.709738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.709818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] federation.caching = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.709983 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.710061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.710229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.710310 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.710484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.710564 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.710739 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.710818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.710977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.711057 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.711220 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.711298 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.711463 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.711548 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.711710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.711789 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.711956 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.712033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.712202 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.712287 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.712449 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.712552 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.712722 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] identity.caching = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.712800 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.712965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.713045 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.713198 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.713279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.713442 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.713522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.713699 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.713832 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.713915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.713985 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.714158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.714236 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.714394 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.714480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.714643 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.714722 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.714902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.715023 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.715142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.715287 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.715425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.715556 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.715684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.715811 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.715938 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.716072 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.716200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.716326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.716495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.716621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.716764 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.716899 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.717031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.717158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.717295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.717423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.717423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.717669 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.717797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.717923 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.718051 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.718179 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.718305 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.718440 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.718567 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.718694 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.718820 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.718962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.719091 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.719225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.719351 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.719478 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.719604 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.719730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.719856 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.719993 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.720127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.720254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.720379 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.720520 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.720643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.720789 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.720917 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.721043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.721177 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.721304 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.721430 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.721698 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.722373 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.722567 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.722768 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.722930 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.723010 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.723082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.723143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.723208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.723268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.723434 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.723554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.723692 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.723814 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.723946 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.724071 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.724197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.724325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.724523 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.724650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.724777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.724913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.725047 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.725173 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.725307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.725435 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.725435 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.725672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.725797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.725922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.726055 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.726180 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.726311 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.user = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.726439 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.726565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.726700 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.726700 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.726943 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.726943 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.727186 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.727312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.727447 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.727572 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.727696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.727821 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.727946 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.728070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.728200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.728334 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.728479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.728604 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.728731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.728856 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.728990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.729115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.729240 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.729365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.729491 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.729618 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.729751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.729876 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.730001 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.730135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.730259 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.730259 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.730502 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.730630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.730755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.730755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.730992 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.731116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.731247 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.731371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.731498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.731574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.731691 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.731802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.731895 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.731971 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.732042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.732113 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.732184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.732254 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.732331 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.732404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.732538 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.732613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.732685 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.732756 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.732843 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.732918 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.732988 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.733058 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.733129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.733199 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.733276 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.733349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.733419 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.733489 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.733560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.733633 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.733712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.733785 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.733855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.733925 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.733995 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.734066 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] resource.caching = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.734143 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.734216 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.734292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.734388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.734469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.734631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.734719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.734894 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.734973 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.735139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.735218 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.735384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.735470 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.735634 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.735713 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.735876 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.735954 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.736121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.736272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.736348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] role.caching = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.736418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.736623 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] role.driver = sql {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.736704 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.736860 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.736952 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] role.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.737113 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] role.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.737357 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.737488 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.737626 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.737764 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.737900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.737984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.738057 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.738128 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.738239 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.738350 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.738490 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.738605 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.738742 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.738857 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.738993 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.739111 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.739230 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.739365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.739482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.739605 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.739734 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.739857 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.739986 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.740111 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.740237 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.740363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.740640 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.740737 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.740902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.741054 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.741158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.741298 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.741412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.741554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.741665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.741809 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.741916 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.742065 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.742144 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.742318 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.742398 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.742560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.742639 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.742822 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.742900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.743081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.743163 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.743319 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.743397 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.743554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.743631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.743792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.743872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.744029 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.744108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.744288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.744373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.744549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.744631 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.744792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.744870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.745026 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.745116 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.745270 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.745348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] token.caching = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.745507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.745586 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.745750 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] token.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.745837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.745986 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.746064 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.746238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.746315 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.746481 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.746567 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.746719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.746797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.746968 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.747047 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.747212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.747300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.747461 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.747539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.747704 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.747783 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.747948 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.748033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.748189 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.748266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.748436 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.748546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.748702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.748793 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.748936 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.749014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.749182 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.749261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.749423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.749510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.749675 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.749754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] database.connection = **** {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.749961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.750049 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.750212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.750292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.connection = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.750456 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.750545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.750699 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.750780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.750939 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.751019 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.751180 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.751258 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.751417 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.751497 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.751654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.751738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.751894 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.751971 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.752132 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.752211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.752380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.752477 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.752640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.752717 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.752934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.753051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.753264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.753407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.753548 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.753651 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.753736 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.753872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.754019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.754152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.754276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.754401 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.754531 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 09:56:33.754657 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.754782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:56:33.754918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80330) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 09:56:33.783700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.783932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.784813 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.785029 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.785257 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.785460 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.793620 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.794025 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.823454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.823683 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.823814 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.823958 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.876395 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.876977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.927877 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.928103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.928887 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.929129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.993225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.993460 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.993594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.993723 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.993866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.994001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.994085 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.994261 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.994390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.994519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.994655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:33.994655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.017688 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.017929 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.018071 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.018229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.018368 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.019007 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.019237 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.019443 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.019443 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.019823 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.019952 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.020081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.020208 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.020208 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.031228 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.031639 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.044988 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.045221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.045353 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.045495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.045623 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.045748 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.045873 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.045998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.046126 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.046254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.046392 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.046526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80330) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.046653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.046653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 09:56:34.063250 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.063464 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 09:56:34.063806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.063996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.064126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 09:56:34.064269 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 09:56:34.064401 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.064552 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.064689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.064819 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.064961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 09:56:34.065093 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.065222 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.065903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.066228 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.066580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.077108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.077255 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.077410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.077552 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.077679 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.077817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.077943 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.078070 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.086901 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.087259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.091696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.091981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.096135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.096135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.096439 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.096588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.096735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.096884 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.097092 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.097296 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.097497 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.097670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.097804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.097935 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.098071 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.098201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.098330 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.098468 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.098598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.098598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.098598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.098598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.118122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.119635 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.119922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.120673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.122210 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.122515 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.124594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.124878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.125161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.127645 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.128419 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.128772 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.132310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.132639 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.136022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.136308 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.136831 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.137133 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.137430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.137717 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.137995 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.138286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.138560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.138845 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.140729 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.141071 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.141397 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.141735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.142052 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.142382 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.142697 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.143025 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.155393 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.155672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.159963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.161051 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.161385 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.163177 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.163475 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.165481 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.168163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.169258 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.169576 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.171389 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.174387 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.174600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.175144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.175443 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.175724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.176008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.176302 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.177639 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.180998 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.181300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.181587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.181884 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.182173 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.182467 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.193087 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.193368 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.193635 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.193900 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.199659 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.199944 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.200211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.200491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.200898 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.202469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.202749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.205589 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.205874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.206792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.207079 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.207384 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.208260 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.209927 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.210224 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.213193 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.213479 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.213790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.214102 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.214429 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.218872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.219164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.219449 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.219733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.220014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.220291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.220612 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.227152 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.227469 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.227759 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.228076 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.228393 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.228715 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.229049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.236897 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.239930 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.242931 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.245463 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.246028 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.247085 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.247372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.247653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.249139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.252292 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.254994 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.255550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.256633 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.257635 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.257930 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.258211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.259581 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.259875 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.260164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.260445 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.265103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.266717 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.269154 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.269549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.269850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.270317 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.270609 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.270895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.271172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.276754 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80330) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.277039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.277324 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.277601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.277885 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.278167 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.278451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.278721 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.279094 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.279262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.279383 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.279546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.279676 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.279827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.279942 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.280222 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.280501 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80330) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.286728 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 09:56:34.287008 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.287289 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.287567 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.287849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.288131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.288410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.288704 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.289076 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.289361 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.289653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.289919 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.290194 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.290455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 09:56:34.314698 dv-cinder-850318-6-smb devstack@keystone.service[80330]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ea100929c0 pid: 80330 (default app) Aug 02 09:56:34.318815 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7bbf7-9ac7-4b7a-8ccb-98376d954d4d None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:34.319107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7bbf7-9ac7-4b7a-8ccb-98376d954d4d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:34.319386 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7bbf7-9ac7-4b7a-8ccb-98376d954d4d None None] PATH_INFO: `/v3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:34.323728 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1/1] 10.222.0.85 () {50 vars in 791 bytes} [Tue Aug 2 09:56:34 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:56:34.325493 dv-cinder-850318-6-smb devstack@keystone.service[80329]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ea100929c0 pid: 80329 (default app) Aug 02 09:56:42.030800 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf516376-4e1a-4034-a8a1-001484765b79 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:42.031363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf516376-4e1a-4034-a8a1-001484765b79 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:42.031363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf516376-4e1a-4034-a8a1-001484765b79 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:42.032767 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 2/2] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:56:42.041611 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c0fae-055d-4c9d-83ec-dcde37a41d23 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:42.042032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c0fae-055d-4c9d-83ec-dcde37a41d23 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:42.042168 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c0fae-055d-4c9d-83ec-dcde37a41d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:42.114916 dv-cinder-850318-6-smb devstack@keystone.service[80329]: INFO dbcounter [None req-b45c0fae-055d-4c9d-83ec-dcde37a41d23 None None] Registered counter for database keystone Aug 02 09:56:42.134152 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG oslo_db.sqlalchemy.engines [None req-b45c0fae-055d-4c9d-83ec-dcde37a41d23 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:56:42.140368 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writer thread running {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:56:42.325075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG passlib.handlers.bcrypt [None req-b45c0fae-055d-4c9d-83ec-dcde37a41d23 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80329) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 02 09:56:42.325483 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG passlib.handlers.bcrypt [None req-b45c0fae-055d-4c9d-83ec-dcde37a41d23 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80329) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 02 09:56:42.381580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-b45c0fae-055d-4c9d-83ec-dcde37a41d23 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:56:42.383191 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b45c0fae-055d-4c9d-83ec-dcde37a41d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:56:42.515561 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1/3] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:56:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 02 09:56:42.675742 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf516376-4e1a-4034-a8a1-001484765b79 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:42.747891 dv-cinder-850318-6-smb devstack@keystone.service[80330]: INFO dbcounter [None req-bf516376-4e1a-4034-a8a1-001484765b79 None None] Registered counter for database keystone Aug 02 09:56:42.769835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG oslo_db.sqlalchemy.engines [None req-bf516376-4e1a-4034-a8a1-001484765b79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80330) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:56:42.776448 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writer thread running {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:56:42.900214 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf516376-4e1a-4034-a8a1-001484765b79 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:42.904550 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b3887-913b-424d-8393-e81861b3f199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:42.905186 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b3887-913b-424d-8393-e81861b3f199 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:42.905469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b3887-913b-424d-8393-e81861b3f199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:42.905743 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b3887-913b-424d-8393-e81861b3f199 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:42.914201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b3887-913b-424d-8393-e81861b3f199 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:42.967830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: WARNING keystone.common.rbac_enforcer.enforcer [None req-af4b3887-913b-424d-8393-e81861b3f199 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 02 09:56:42.968383 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b3887-913b-424d-8393-e81861b3f199 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:42.978918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 3/4] 10.222.0.85 () {58 vars in 1324 bytes} [Tue Aug 2 09:56:42 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:56:42.984951 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c0fae-055d-4c9d-83ec-dcde37a41d23 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:42.999830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c0fae-055d-4c9d-83ec-dcde37a41d23 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:43.004193 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325c686-5559-41a9-af19-d919e0308a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:43.005962 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325c686-5559-41a9-af19-d919e0308a21 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:43.006241 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325c686-5559-41a9-af19-d919e0308a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:43.006512 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325c686-5559-41a9-af19-d919e0308a21 admin admin] PATH_INFO: `/v3/projects/c3d1fabb05ac40668bd828447419da5a` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:43.008146 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325c686-5559-41a9-af19-d919e0308a21 admin admin] RBAC: Authorizing `identity:get_project(project_id=c3d1fabb05ac40668bd828447419da5a)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:43.059504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e325c686-5559-41a9-af19-d919e0308a21 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 02 09:56:43.060082 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325c686-5559-41a9-af19-d919e0308a21 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:43.064439 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 2/5] 10.222.0.85 () {56 vars in 1207 bytes} [Tue Aug 2 09:56:42 2022] GET /identity/v3/projects/c3d1fabb05ac40668bd828447419da5a => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:56:45.103097 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cf982-3d50-4ae4-bca9-b15f4fb27aba None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:45.103637 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cf982-3d50-4ae4-bca9-b15f4fb27aba None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:45.103637 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cf982-3d50-4ae4-bca9-b15f4fb27aba None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:45.107732 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 4/6] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:56:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:56:45.113142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035d82f-fe80-4ac5-8175-34a562f2712c None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:45.113579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035d82f-fe80-4ac5-8175-34a562f2712c None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:45.113708 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035d82f-fe80-4ac5-8175-34a562f2712c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:45.135057 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-f035d82f-fe80-4ac5-8175-34a562f2712c None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:56:45.136608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f035d82f-fe80-4ac5-8175-34a562f2712c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:56:45.144476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 3/7] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:56:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 02 09:56:45.166000 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cf982-3d50-4ae4-bca9-b15f4fb27aba None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:45.179292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824cf982-3d50-4ae4-bca9-b15f4fb27aba None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:45.183535 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c90aac-2744-4795-838a-54859cb2ae34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:45.184135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c90aac-2744-4795-838a-54859cb2ae34 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:45.184420 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c90aac-2744-4795-838a-54859cb2ae34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:45.184725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c90aac-2744-4795-838a-54859cb2ae34 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:45.193791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c90aac-2744-4795-838a-54859cb2ae34 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:45.195567 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c90aac-2744-4795-838a-54859cb2ae34 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:45.204279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 5/8] 10.222.0.85 () {58 vars in 1324 bytes} [Tue Aug 2 09:56:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 09:56:45.209620 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035d82f-fe80-4ac5-8175-34a562f2712c None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:45.218599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035d82f-fe80-4ac5-8175-34a562f2712c None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:45.222998 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1804b-7921-40d6-897b-1d2479b0859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:45.223616 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1804b-7921-40d6-897b-1d2479b0859a admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:45.223963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1804b-7921-40d6-897b-1d2479b0859a admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:45.224253 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1804b-7921-40d6-897b-1d2479b0859a admin admin] PATH_INFO: `/v3/users/06f2ad1758af4022bd84ef137b10c0c7` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:45.225659 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1804b-7921-40d6-897b-1d2479b0859a admin admin] RBAC: Authorizing `identity:get_user(user_id=06f2ad1758af4022bd84ef137b10c0c7)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:45.227461 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1804b-7921-40d6-897b-1d2479b0859a admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:45.229022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 4/9] 10.222.0.85 () {56 vars in 1198 bytes} [Tue Aug 2 09:56:45 2022] GET /identity/v3/users/06f2ad1758af4022bd84ef137b10c0c7 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:56:47.316021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba582aa-b408-4be3-8fd7-4f145944b45e None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:47.316506 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba582aa-b408-4be3-8fd7-4f145944b45e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:47.317216 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba582aa-b408-4be3-8fd7-4f145944b45e None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:47.318574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 6/10] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:56:47.323782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba20643-3f35-4549-8daa-2b0333e8251a None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:47.323965 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e35969-b5a3-4207-898a-1ab8a3967439 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:47.324361 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba20643-3f35-4549-8daa-2b0333e8251a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:47.324448 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e35969-b5a3-4207-898a-1ab8a3967439 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:47.324553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba20643-3f35-4549-8daa-2b0333e8251a None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:47.324646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e35969-b5a3-4207-898a-1ab8a3967439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:47.325580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 7/11] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:56:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:56:47.330478 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5546ce-f3ad-468c-bd94-49a18e0b3ec8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:47.330766 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5546ce-f3ad-468c-bd94-49a18e0b3ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:47.331043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5546ce-f3ad-468c-bd94-49a18e0b3ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:47.352203 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-94e35969-b5a3-4207-898a-1ab8a3967439 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:56:47.353458 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-94e35969-b5a3-4207-898a-1ab8a3967439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:56:47.381193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG passlib.handlers.bcrypt [None req-2b5546ce-f3ad-468c-bd94-49a18e0b3ec8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80330) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 02 09:56:47.381654 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG passlib.handlers.bcrypt [None req-2b5546ce-f3ad-468c-bd94-49a18e0b3ec8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80330) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 02 09:56:47.428203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2b5546ce-f3ad-468c-bd94-49a18e0b3ec8 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:56:47.429850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2b5546ce-f3ad-468c-bd94-49a18e0b3ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:56:47.433453 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 5/12] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:56:47.456818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e35969-b5a3-4207-898a-1ab8a3967439 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:47.481910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:47.532989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 8/13] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:56:47.555655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5546ce-f3ad-468c-bd94-49a18e0b3ec8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:47.561849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e35969-b5a3-4207-898a-1ab8a3967439 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:47.596009 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f5d74-f539-47d3-a66c-bd1156a195ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:47.596688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f5d74-f539-47d3-a66c-bd1156a195ea None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:47.596978 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f5d74-f539-47d3-a66c-bd1156a195ea None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:47.597258 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f5d74-f539-47d3-a66c-bd1156a195ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:47.608448 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f5d74-f539-47d3-a66c-bd1156a195ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:56:47.617452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-604f5d74-f539-47d3-a66c-bd1156a195ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:56:47.617452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:56:47.617452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:56:47.617452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:56:47.617452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:56:47.617452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:56:47.617452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:56:47.617452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:56:47.617452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:56:47.617452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:56:47.617452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:56:47.617452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:56:47.617452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:56:47.617452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:56:47.617452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:56:47.617452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:56:47.618524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:56:47.618524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:56:47.618524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:56:47.618524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:56:47.618524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:56:47.618524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:56:47.618524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:56:47.618524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:56:47.618524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:56:47.618524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:56:47.618524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:56:47.618524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:56:47.618524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:56:47.618524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:56:47.618524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:56:47.618524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:56:47.619391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:56:47.619391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:56:47.619391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:56:47.619391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:56:47.619391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:56:47.619391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:56:47.619391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:56:47.619391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:56:47.619391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:56:47.619391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:56:47.619391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:56:47.619391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:56:47.619391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 6/14] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:56:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:56:47.624856 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f5d74-f539-47d3-a66c-bd1156a195ea None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:47.655979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5546ce-f3ad-468c-bd94-49a18e0b3ec8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:47.658266 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:47.694994 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73ae7b-5c6a-4398-9600-2585254a4485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:47.695957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73ae7b-5c6a-4398-9600-2585254a4485 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:47.696314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73ae7b-5c6a-4398-9600-2585254a4485 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:47.696687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73ae7b-5c6a-4398-9600-2585254a4485 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:47.705899 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:47.724989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f5d74-f539-47d3-a66c-bd1156a195ea None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:47.757949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4600bba-4f1e-4f90-84bc-a3f7721c0c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:47.758565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4600bba-4f1e-4f90-84bc-a3f7721c0c8d None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:47.758852 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4600bba-4f1e-4f90-84bc-a3f7721c0c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:47.759127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4600bba-4f1e-4f90-84bc-a3f7721c0c8d None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:47.759856 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4600bba-4f1e-4f90-84bc-a3f7721c0c8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:56:47.760164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4600bba-4f1e-4f90-84bc-a3f7721c0c8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:47.761630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4600bba-4f1e-4f90-84bc-a3f7721c0c8d None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:47.765072 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73ae7b-5c6a-4398-9600-2585254a4485 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:47.766577 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73ae7b-5c6a-4398-9600-2585254a4485 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:47.773599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 7/15] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:56:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:56:47.779081 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4600bba-4f1e-4f90-84bc-a3f7721c0c8d None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:47.867408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 9/16] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:56:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 09:56:47.873197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73ae7b-5c6a-4398-9600-2585254a4485 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:47.876437 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:47.981507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73ae7b-5c6a-4398-9600-2585254a4485 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:47.988121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4600bba-4f1e-4f90-84bc-a3f7721c0c8d None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:48.015161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c86636-9bf8-47d7-8366-0fda5499edd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:48.016012 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c86636-9bf8-47d7-8366-0fda5499edd2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:48.016293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c86636-9bf8-47d7-8366-0fda5499edd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:48.016630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c86636-9bf8-47d7-8366-0fda5499edd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:48.021689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddbc3b-5629-4687-a0b8-00d505af53ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:48.022330 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddbc3b-5629-4687-a0b8-00d505af53ba None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:48.022611 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddbc3b-5629-4687-a0b8-00d505af53ba None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:48.022885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddbc3b-5629-4687-a0b8-00d505af53ba None admin] PATH_INFO: `/v3/users/06f2ad1758af4022bd84ef137b10c0c7` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:48.024055 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ddbc3b-5629-4687-a0b8-00d505af53ba None admin] RBAC: Authorizing `identity:get_user(user_id=06f2ad1758af4022bd84ef137b10c0c7)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:48.025537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ddbc3b-5629-4687-a0b8-00d505af53ba None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:48.027138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 8/17] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:56:47 2022] GET /identity/v3/users/06f2ad1758af4022bd84ef137b10c0c7 => generated 247 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:56:48.032658 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddbc3b-5629-4687-a0b8-00d505af53ba None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:48.036323 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c86636-9bf8-47d7-8366-0fda5499edd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:48.037806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c86636-9bf8-47d7-8366-0fda5499edd2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:48.048206 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:48.056751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-60c86636-9bf8-47d7-8366-0fda5499edd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:56:48.056751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:56:48.056751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:56:48.056751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:56:48.056751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:56:48.056751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:56:48.056751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:56:48.056751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:56:48.056751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:56:48.056751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:56:48.056751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:56:48.056751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:56:48.056751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:56:48.056751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:56:48.056751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:56:48.057726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:56:48.057726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:56:48.057726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:56:48.057726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:56:48.057726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:56:48.057726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:56:48.057726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:56:48.057726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:56:48.057726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:56:48.057726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:56:48.057726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:56:48.057726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:56:48.057726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:56:48.057726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:56:48.057726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:56:48.057726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:56:48.057726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:56:48.058714 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:56:48.058714 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:56:48.058714 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:56:48.058714 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:56:48.058714 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 10/18] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:56:48.063627 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c86636-9bf8-47d7-8366-0fda5499edd2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:48.120215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:48.136971 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddbc3b-5629-4687-a0b8-00d505af53ba None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:48.164724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c86636-9bf8-47d7-8366-0fda5499edd2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:48.170110 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f755f-b504-451f-bba0-0e36743a90a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:48.170750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f755f-b504-451f-bba0-0e36743a90a0 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:48.171031 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f755f-b504-451f-bba0-0e36743a90a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:48.171303 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f755f-b504-451f-bba0-0e36743a90a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:48.172475 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f755f-b504-451f-bba0-0e36743a90a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:48.173894 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2f755f-b504-451f-bba0-0e36743a90a0 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:48.176004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 9/19] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:56:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:56:48.181940 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f755f-b504-451f-bba0-0e36743a90a0 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:48.200619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056ae0e-12dd-4e99-9056-e465ff390533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:48.201239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056ae0e-12dd-4e99-9056-e465ff390533 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:48.201529 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056ae0e-12dd-4e99-9056-e465ff390533 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:48.201808 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056ae0e-12dd-4e99-9056-e465ff390533 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:48.202513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056ae0e-12dd-4e99-9056-e465ff390533 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:56:48.202825 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056ae0e-12dd-4e99-9056-e465ff390533 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:48.204228 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056ae0e-12dd-4e99-9056-e465ff390533 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:48.221386 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 11/20] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:56:48.265738 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:48.286856 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f755f-b504-451f-bba0-0e36743a90a0 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:48.325632 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a2e13-3c3f-4df2-ba2f-94af9c98eb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:48.326304 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a2e13-3c3f-4df2-ba2f-94af9c98eb2d None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:48.326533 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a2e13-3c3f-4df2-ba2f-94af9c98eb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:48.326861 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a2e13-3c3f-4df2-ba2f-94af9c98eb2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:48.327669 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a2e13-3c3f-4df2-ba2f-94af9c98eb2d None admin] RBAC: Adding query filter params (role.id=c15ca78eb3c9472f94e15e2d28c7f403, scope.domain.id=default, user.id=06f2ad1758af4022bd84ef137b10c0c7) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:56:48.327983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a2e13-3c3f-4df2-ba2f-94af9c98eb2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:48.329486 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a2e13-3c3f-4df2-ba2f-94af9c98eb2d None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:48.337130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 10/21] 10.222.0.85 () {56 vars in 1322 bytes} [Tue Aug 2 09:56:48 2022] GET /identity/v3/role_assignments?user.id=06f2ad1758af4022bd84ef137b10c0c7&scope.domain.id=default&role.id=c15ca78eb3c9472f94e15e2d28c7f403 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:56:50.664220 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c962660-5ed2-48e3-af13-986cf4e4caa4 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:50.664749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c962660-5ed2-48e3-af13-986cf4e4caa4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:50.664749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c962660-5ed2-48e3-af13-986cf4e4caa4 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:50.666525 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 12/22] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:56:50.671600 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7b825-5e39-4982-a53e-2199061befad None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:50.672069 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7b825-5e39-4982-a53e-2199061befad None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:50.672320 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7b825-5e39-4982-a53e-2199061befad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:50.697805 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-77b7b825-5e39-4982-a53e-2199061befad None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:56:50.698986 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-77b7b825-5e39-4982-a53e-2199061befad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:56:50.786747 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 11/23] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:56:50.804306 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e579c8-7201-42d2-a65c-e5bfc4e267b0 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:50.804611 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e579c8-7201-42d2-a65c-e5bfc4e267b0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:50.804887 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e579c8-7201-42d2-a65c-e5bfc4e267b0 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:50.806343 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 13/24] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:56:50.812289 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537fa08-eb35-4e1b-81a8-9ddc5f1979d2 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:50.812289 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537fa08-eb35-4e1b-81a8-9ddc5f1979d2 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:50.812289 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537fa08-eb35-4e1b-81a8-9ddc5f1979d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:50.827920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e579c8-7201-42d2-a65c-e5bfc4e267b0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:50.846408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-3537fa08-eb35-4e1b-81a8-9ddc5f1979d2 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:56:50.848321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-3537fa08-eb35-4e1b-81a8-9ddc5f1979d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:56:50.935077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 12/25] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:56:50.960181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537fa08-eb35-4e1b-81a8-9ddc5f1979d2 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:50.973518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:51.094962 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537fa08-eb35-4e1b-81a8-9ddc5f1979d2 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:51.104884 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e579c8-7201-42d2-a65c-e5bfc4e267b0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:51.148202 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:51.156930 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b07425-32c3-4c85-bd16-84cef392e5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:51.157832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b07425-32c3-4c85-bd16-84cef392e5af None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:51.158300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b07425-32c3-4c85-bd16-84cef392e5af None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:51.158584 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b07425-32c3-4c85-bd16-84cef392e5af None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:51.159321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b07425-32c3-4c85-bd16-84cef392e5af None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:51.160752 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b07425-32c3-4c85-bd16-84cef392e5af None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:51.185216 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91906a-9468-43e6-b81b-9d40af20ae8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:51.185850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91906a-9468-43e6-b81b-9d40af20ae8e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:51.186168 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91906a-9468-43e6-b81b-9d40af20ae8e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:51.186468 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91906a-9468-43e6-b81b-9d40af20ae8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:51.213740 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91906a-9468-43e6-b81b-9d40af20ae8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:51.215225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91906a-9468-43e6-b81b-9d40af20ae8e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:51.232229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-2d91906a-9468-43e6-b81b-9d40af20ae8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:56:51.232229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:56:51.232229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:56:51.232229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:56:51.232229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:56:51.232229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:56:51.232229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:56:51.232229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:56:51.232229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:56:51.232229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:56:51.232229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:56:51.232229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:56:51.232229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:56:51.232229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:56:51.232229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:56:51.233107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:56:51.233107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:56:51.233107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:56:51.233107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:56:51.233107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:56:51.233107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:56:51.233107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:56:51.233107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:56:51.233107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:56:51.233107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:56:51.233107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:56:51.233107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:56:51.233107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:56:51.233107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:56:51.233107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:56:51.233107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:56:51.233107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:56:51.233890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:56:51.233890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:56:51.233890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:56:51.233890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:56:51.233890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 14/26] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:56:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:56:51.234584 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ae057-5963-4a78-8b46-54b8579d281a None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:51.234872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ae057-5963-4a78-8b46-54b8579d281a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:51.235672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ae057-5963-4a78-8b46-54b8579d281a None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:51.237202 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 15/27] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:56:51.238240 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295c007-1357-4ca2-94f8-ee55ff5ed282 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:51.238527 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295c007-1357-4ca2-94f8-ee55ff5ed282 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:51.238806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f295c007-1357-4ca2-94f8-ee55ff5ed282 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:51.239995 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 16/28] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:56:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:56:51.246696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97511de-a49a-41eb-9c7c-7e017ea34a18 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:51.247197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97511de-a49a-41eb-9c7c-7e017ea34a18 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:51.247671 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97511de-a49a-41eb-9c7c-7e017ea34a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:51.311408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 13/29] 10.222.0.85 () {60 vars in 1131 bytes} [Tue Aug 2 09:56:50 2022] POST /identity/v3/roles => generated 219 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:56:51.312819 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b07425-32c3-4c85-bd16-84cef392e5af None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:51.432734 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a97511de-a49a-41eb-9c7c-7e017ea34a18 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:56:51.441322 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a97511de-a49a-41eb-9c7c-7e017ea34a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:56:51.448328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:51.501229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b07425-32c3-4c85-bd16-84cef392e5af None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:51.546485 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b328e7e-8bb7-443c-88f8-043c96b99a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:51.547706 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b328e7e-8bb7-443c-88f8-043c96b99a07 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:51.548240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b328e7e-8bb7-443c-88f8-043c96b99a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:51.548549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b328e7e-8bb7-443c-88f8-043c96b99a07 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:51.549300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b328e7e-8bb7-443c-88f8-043c96b99a07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:56:51.549874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b328e7e-8bb7-443c-88f8-043c96b99a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:51.551714 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b328e7e-8bb7-443c-88f8-043c96b99a07 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:51.565016 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 17/30] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:56:51.566659 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aed54-3dc4-4738-91a8-a92f8fbc54d9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:51.567177 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aed54-3dc4-4738-91a8-a92f8fbc54d9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:51.567659 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678aed54-3dc4-4738-91a8-a92f8fbc54d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:51.574119 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 14/31] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:56:51.580645 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b328e7e-8bb7-443c-88f8-043c96b99a07 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:51.587258 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-678aed54-3dc4-4738-91a8-a92f8fbc54d9 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:56:51.588735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-678aed54-3dc4-4738-91a8-a92f8fbc54d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:56:51.682998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 18/32] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:56:51.683825 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678aed54-3dc4-4738-91a8-a92f8fbc54d9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:51.693591 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b328e7e-8bb7-443c-88f8-043c96b99a07 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:51.717359 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:51.723152 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:51.735624 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75ec1c-b24b-48f6-b9e6-c8b69c8dad00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:51.736694 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75ec1c-b24b-48f6-b9e6-c8b69c8dad00 None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:51.737192 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75ec1c-b24b-48f6-b9e6-c8b69c8dad00 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:51.737673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75ec1c-b24b-48f6-b9e6-c8b69c8dad00 None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:51.738579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75ec1c-b24b-48f6-b9e6-c8b69c8dad00 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:51.740374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75ec1c-b24b-48f6-b9e6-c8b69c8dad00 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:51.774974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 15/33] 10.222.0.85 () {60 vars in 1141 bytes} [Tue Aug 2 09:56:51 2022] POST /identity/v3/projects => generated 301 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:56:51.776280 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75ec1c-b24b-48f6-b9e6-c8b69c8dad00 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:51.806190 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678aed54-3dc4-4738-91a8-a92f8fbc54d9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:51.852526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe56b1-7d4b-4154-9059-775570656df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:51.852526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe56b1-7d4b-4154-9059-775570656df7 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:51.852526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe56b1-7d4b-4154-9059-775570656df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:51.852526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe56b1-7d4b-4154-9059-775570656df7 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:51.852958 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe56b1-7d4b-4154-9059-775570656df7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:51.852958 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe56b1-7d4b-4154-9059-775570656df7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:51.959974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75ec1c-b24b-48f6-b9e6-c8b69c8dad00 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:52.004408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72f5a0-bcce-45de-afb2-740827f2f145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:52.005439 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72f5a0-bcce-45de-afb2-740827f2f145 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:52.005921 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72f5a0-bcce-45de-afb2-740827f2f145 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:52.006446 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72f5a0-bcce-45de-afb2-740827f2f145 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:52.018820 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72f5a0-bcce-45de-afb2-740827f2f145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:56:52.024731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-8f72f5a0-bcce-45de-afb2-740827f2f145 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:56:52.024731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:56:52.024731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:56:52.024731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:56:52.024731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:56:52.024731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:56:52.024731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:56:52.024731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:56:52.024731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:56:52.024731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:56:52.024731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:56:52.024731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:56:52.024731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:56:52.024731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:56:52.024731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:56:52.024731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:56:52.025574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:56:52.025574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:56:52.025574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:56:52.025574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:56:52.025574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:56:52.025574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:56:52.025574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:56:52.025574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:56:52.025574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:56:52.025574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:56:52.025574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:56:52.025574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:56:52.025574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:56:52.025574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:56:52.025574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:56:52.025574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:56:52.026321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:56:52.026321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:56:52.026321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:56:52.026321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:56:52.026321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:56:52.026321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:56:52.026321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:56:52.026321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:56:52.026321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:56:52.026321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:56:52.026321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:56:52.026321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:56:52.028672 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 16/34] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:56:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:56:52.030893 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 19/35] 10.222.0.85 () {60 vars in 1131 bytes} [Tue Aug 2 09:56:51 2022] POST /identity/v3/roles => generated 225 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:56:52.036146 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72f5a0-bcce-45de-afb2-740827f2f145 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:52.089181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:52.135881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585569f4-6d33-4a51-8834-460b22a2babc None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:52.136482 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585569f4-6d33-4a51-8834-460b22a2babc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:52.136871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585569f4-6d33-4a51-8834-460b22a2babc None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:52.138519 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 20/36] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:56:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:56:52.146056 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacfc87-6e9a-4a9c-96ed-4b5bb464cad9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:52.146359 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacfc87-6e9a-4a9c-96ed-4b5bb464cad9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:52.146715 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacfc87-6e9a-4a9c-96ed-4b5bb464cad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:52.171072 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-dbacfc87-6e9a-4a9c-96ed-4b5bb464cad9 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:56:52.173849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dbacfc87-6e9a-4a9c-96ed-4b5bb464cad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:56:52.185010 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72f5a0-bcce-45de-afb2-740827f2f145 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:52.229378 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3e512-3156-4486-bfa5-7a3f72ccd82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:52.229929 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3e512-3156-4486-bfa5-7a3f72ccd82e None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:52.230218 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3e512-3156-4486-bfa5-7a3f72ccd82e None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:52.230499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3e512-3156-4486-bfa5-7a3f72ccd82e None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:52.231242 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3e512-3156-4486-bfa5-7a3f72ccd82e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:56:52.231557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3e512-3156-4486-bfa5-7a3f72ccd82e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:52.233313 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3e512-3156-4486-bfa5-7a3f72ccd82e None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:52.242428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 17/37] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:56:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:56:52.243755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c060d-02ac-4a57-9217-4016133973ca None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:52.244051 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c060d-02ac-4a57-9217-4016133973ca None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:52.244407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41c060d-02ac-4a57-9217-4016133973ca None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:52.245804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 18/38] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:56:52.251172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c060d-02ac-4a57-9217-4016133973ca None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:52.255891 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 21/39] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:56:52.256728 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92a28c-2cf0-44b9-a672-32c9761d4b60 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:52.257014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92a28c-2cf0-44b9-a672-32c9761d4b60 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:52.257286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92a28c-2cf0-44b9-a672-32c9761d4b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:52.277292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1f92a28c-2cf0-44b9-a672-32c9761d4b60 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:56:52.278806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1f92a28c-2cf0-44b9-a672-32c9761d4b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:56:52.299091 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:52.353953 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 22/40] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:56:52.361425 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92a28c-2cf0-44b9-a672-32c9761d4b60 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:52.370436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:52.376898 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41c060d-02ac-4a57-9217-4016133973ca None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:52.412676 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40dcee-b7a4-47b5-bf0c-45901f0a89c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:52.413313 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40dcee-b7a4-47b5-bf0c-45901f0a89c7 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:52.413602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40dcee-b7a4-47b5-bf0c-45901f0a89c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:52.413876 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40dcee-b7a4-47b5-bf0c-45901f0a89c7 None admin] PATH_INFO: `/v3/users/06f2ad1758af4022bd84ef137b10c0c7` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:52.415327 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40dcee-b7a4-47b5-bf0c-45901f0a89c7 None admin] RBAC: Authorizing `identity:get_user(user_id=06f2ad1758af4022bd84ef137b10c0c7)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:52.416817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40dcee-b7a4-47b5-bf0c-45901f0a89c7 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:52.418400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 19/41] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:56:52 2022] GET /identity/v3/users/06f2ad1758af4022bd84ef137b10c0c7 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:56:52.419133 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40dcee-b7a4-47b5-bf0c-45901f0a89c7 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:52.461360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92a28c-2cf0-44b9-a672-32c9761d4b60 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:52.496265 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddee3c1-97bc-4efe-95e9-dec2db98ff7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:52.496863 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddee3c1-97bc-4efe-95e9-dec2db98ff7f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:52.497153 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddee3c1-97bc-4efe-95e9-dec2db98ff7f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:52.497433 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddee3c1-97bc-4efe-95e9-dec2db98ff7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:52.498885 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddee3c1-97bc-4efe-95e9-dec2db98ff7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:52.500488 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddee3c1-97bc-4efe-95e9-dec2db98ff7f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:52.502095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 23/42] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:56:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:56:52.506722 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddee3c1-97bc-4efe-95e9-dec2db98ff7f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:52.521088 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:52.525800 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40dcee-b7a4-47b5-bf0c-45901f0a89c7 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:52.559439 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d118bfa-0fd1-4726-9513-3c972a7bc583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:52.560048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d118bfa-0fd1-4726-9513-3c972a7bc583 None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:52.560329 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d118bfa-0fd1-4726-9513-3c972a7bc583 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:52.560642 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d118bfa-0fd1-4726-9513-3c972a7bc583 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:52.561351 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d118bfa-0fd1-4726-9513-3c972a7bc583 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:52.562953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d118bfa-0fd1-4726-9513-3c972a7bc583 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:52.576755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 20/43] 10.222.0.85 () {60 vars in 1131 bytes} [Tue Aug 2 09:56:52 2022] POST /identity/v3/roles => generated 223 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:56:52.576755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d118bfa-0fd1-4726-9513-3c972a7bc583 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:52.607621 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddee3c1-97bc-4efe-95e9-dec2db98ff7f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:52.629735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:52.651473 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d74839-f37e-446e-a124-17a47ffe9e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:52.652144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d74839-f37e-446e-a124-17a47ffe9e7e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:52.652429 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d74839-f37e-446e-a124-17a47ffe9e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:52.652738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d74839-f37e-446e-a124-17a47ffe9e7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:52.653970 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d74839-f37e-446e-a124-17a47ffe9e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:52.655463 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d74839-f37e-446e-a124-17a47ffe9e7e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:52.657960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 24/44] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:56:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:56:52.663690 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d74839-f37e-446e-a124-17a47ffe9e7e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:52.720132 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d118bfa-0fd1-4726-9513-3c972a7bc583 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:52.764891 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec0e93-c63b-4b24-864d-4776ecc747b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:52.765645 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec0e93-c63b-4b24-864d-4776ecc747b5 None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:52.766232 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec0e93-c63b-4b24-864d-4776ecc747b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:52.766752 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec0e93-c63b-4b24-864d-4776ecc747b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:52.767095 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec0e93-c63b-4b24-864d-4776ecc747b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:52.768725 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec0e93-c63b-4b24-864d-4776ecc747b5 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:52.776578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:52.798640 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d74839-f37e-446e-a124-17a47ffe9e7e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:52.800905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 21/45] 10.222.0.85 () {60 vars in 1141 bytes} [Tue Aug 2 09:56:52 2022] POST /identity/v3/projects => generated 312 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:56:52.841839 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee287621-e8ad-4b32-8ecd-fe0684048df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:52.842528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee287621-e8ad-4b32-8ecd-fe0684048df7 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:52.842810 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee287621-e8ad-4b32-8ecd-fe0684048df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:52.843087 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee287621-e8ad-4b32-8ecd-fe0684048df7 None admin] PATH_INFO: `/v3/domains/default/users/06f2ad1758af4022bd84ef137b10c0c7/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:52.846772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee287621-e8ad-4b32-8ecd-fe0684048df7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=06f2ad1758af4022bd84ef137b10c0c7, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:52.848287 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee287621-e8ad-4b32-8ecd-fe0684048df7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:52.866158 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 25/46] 10.222.0.85 () {58 vars in 1361 bytes} [Tue Aug 2 09:56:52 2022] PUT /identity/v3/domains/default/users/06f2ad1758af4022bd84ef137b10c0c7/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:56:54.814973 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a2384-e668-40e8-9c78-de4ad7f963a1 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:54.815517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a2384-e668-40e8-9c78-de4ad7f963a1 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:54.815517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a2384-e668-40e8-9c78-de4ad7f963a1 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:54.817058 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 22/47] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:56:54.822050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31fbde-f8b4-4c22-b5b8-920a1f9e7d0a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:54.822455 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31fbde-f8b4-4c22-b5b8-920a1f9e7d0a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:54.822609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31fbde-f8b4-4c22-b5b8-920a1f9e7d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:54.841212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3a31fbde-f8b4-4c22-b5b8-920a1f9e7d0a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:56:54.843104 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3a31fbde-f8b4-4c22-b5b8-920a1f9e7d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:56:54.868846 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd7f65-f834-4e87-b11e-9e6eae6b5314 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:54.869144 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd7f65-f834-4e87-b11e-9e6eae6b5314 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:54.869430 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd7f65-f834-4e87-b11e-9e6eae6b5314 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:54.870780 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 23/48] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:56:54.875887 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a024fcf-2d4b-4cf0-98d1-317c0edf6d08 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:54.876178 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a024fcf-2d4b-4cf0-98d1-317c0edf6d08 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:54.876478 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a024fcf-2d4b-4cf0-98d1-317c0edf6d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:54.894915 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-9a024fcf-2d4b-4cf0-98d1-317c0edf6d08 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:56:54.896443 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-9a024fcf-2d4b-4cf0-98d1-317c0edf6d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:56:54.910910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 26/49] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:56:54.934243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31fbde-f8b4-4c22-b5b8-920a1f9e7d0a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:54.963341 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 24/50] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:56:54.985785 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a024fcf-2d4b-4cf0-98d1-317c0edf6d08 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:54.995876 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:55.010167 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:55.037729 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31fbde-f8b4-4c22-b5b8-920a1f9e7d0a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:55.071922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448fca6-fa5b-446c-aba4-7809c083d1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:55.072527 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448fca6-fa5b-446c-aba4-7809c083d1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:55.072814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448fca6-fa5b-446c-aba4-7809c083d1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:55.073090 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448fca6-fa5b-446c-aba4-7809c083d1b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:55.074245 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448fca6-fa5b-446c-aba4-7809c083d1b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:55.075696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448fca6-fa5b-446c-aba4-7809c083d1b7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:55.077519 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 27/51] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:56:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:56:55.083099 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448fca6-fa5b-446c-aba4-7809c083d1b7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:55.091451 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a024fcf-2d4b-4cf0-98d1-317c0edf6d08 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:55.125655 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e45d1-a94c-408e-bd88-8b71062cdb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:55.126291 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e45d1-a94c-408e-bd88-8b71062cdb91 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:55.126579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e45d1-a94c-408e-bd88-8b71062cdb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:55.126855 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e45d1-a94c-408e-bd88-8b71062cdb91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:55.136730 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e45d1-a94c-408e-bd88-8b71062cdb91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:56:55.141963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-b83e45d1-a94c-408e-bd88-8b71062cdb91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:56:55.141963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:56:55.141963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:56:55.141963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:56:55.141963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:56:55.141963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:56:55.141963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:56:55.141963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:56:55.141963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:56:55.141963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:56:55.141963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:56:55.141963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:56:55.141963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:56:55.141963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:56:55.141963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:56:55.141963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:56:55.142803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:56:55.142803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:56:55.142803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:56:55.142803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:56:55.142803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:56:55.142803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:56:55.142803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:56:55.142803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:56:55.142803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:56:55.142803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:56:55.142803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:56:55.142803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:56:55.142803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:56:55.142803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:56:55.142803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:56:55.142803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:56:55.143573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:56:55.143573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:56:55.143573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:56:55.143573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:56:55.143573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:56:55.143573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:56:55.143573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:56:55.143573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:56:55.143573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:56:55.143573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:56:55.143573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:56:55.143573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:56:55.143573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 25/52] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:56:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:56:55.148806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e45d1-a94c-408e-bd88-8b71062cdb91 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:55.184391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448fca6-fa5b-446c-aba4-7809c083d1b7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:55.215262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:55.218577 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5eb90-e8a8-42a3-ac5b-e50b3f66170f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:55.219137 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5eb90-e8a8-42a3-ac5b-e50b3f66170f None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:55.219979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5eb90-e8a8-42a3-ac5b-e50b3f66170f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:55.219979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5eb90-e8a8-42a3-ac5b-e50b3f66170f None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:55.220377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5eb90-e8a8-42a3-ac5b-e50b3f66170f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:55.221882 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5eb90-e8a8-42a3-ac5b-e50b3f66170f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:55.237905 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:55.249142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e45d1-a94c-408e-bd88-8b71062cdb91 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:55.251494 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 28/53] 10.222.0.85 () {60 vars in 1140 bytes} [Tue Aug 2 09:56:55 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:56:55.285785 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9863427-5ab0-42b8-9edf-f3b60ef150b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:55.286426 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9863427-5ab0-42b8-9edf-f3b60ef150b1 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:55.286708 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9863427-5ab0-42b8-9edf-f3b60ef150b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:55.286982 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9863427-5ab0-42b8-9edf-f3b60ef150b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:55.287985 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9863427-5ab0-42b8-9edf-f3b60ef150b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:56:55.288281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9863427-5ab0-42b8-9edf-f3b60ef150b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:55.289745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9863427-5ab0-42b8-9edf-f3b60ef150b1 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:55.302123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 26/54] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:56:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:56:55.307859 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5eb90-e8a8-42a3-ac5b-e50b3f66170f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:55.414885 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5eb90-e8a8-42a3-ac5b-e50b3f66170f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:55.451554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda88e2-c99b-45eb-a887-20289656eebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:55.452121 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda88e2-c99b-45eb-a887-20289656eebe None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:55.452403 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda88e2-c99b-45eb-a887-20289656eebe None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:55.452729 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bda88e2-c99b-45eb-a887-20289656eebe None admin] PATH_INFO: `/v3/users/06f2ad1758af4022bd84ef137b10c0c7` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:55.453919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda88e2-c99b-45eb-a887-20289656eebe None admin] RBAC: Authorizing `identity:get_user(user_id=06f2ad1758af4022bd84ef137b10c0c7)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:55.455376 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bda88e2-c99b-45eb-a887-20289656eebe None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:55.457016 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 29/55] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:56:55 2022] GET /identity/v3/users/06f2ad1758af4022bd84ef137b10c0c7 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:56:55.462436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9863427-5ab0-42b8-9edf-f3b60ef150b1 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:55.561245 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9863427-5ab0-42b8-9edf-f3b60ef150b1 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:55.588198 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:55.594630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01c7f3-0eab-49de-ae44-11f3e0285157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:55.595273 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01c7f3-0eab-49de-ae44-11f3e0285157 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:55.595558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01c7f3-0eab-49de-ae44-11f3e0285157 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:55.595835 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01c7f3-0eab-49de-ae44-11f3e0285157 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:55.597012 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01c7f3-0eab-49de-ae44-11f3e0285157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:55.598463 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01c7f3-0eab-49de-ae44-11f3e0285157 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:55.600051 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 27/56] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:56:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:56:55.605670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda88e2-c99b-45eb-a887-20289656eebe None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:55.667494 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:55.707566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bda88e2-c99b-45eb-a887-20289656eebe None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:55.740510 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb09a6c-9fe8-41b1-ba03-cb03b4a51436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:55.741131 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb09a6c-9fe8-41b1-ba03-cb03b4a51436 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:55.741413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb09a6c-9fe8-41b1-ba03-cb03b4a51436 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:55.741685 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb09a6c-9fe8-41b1-ba03-cb03b4a51436 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:55.742477 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb09a6c-9fe8-41b1-ba03-cb03b4a51436 None admin] RBAC: Adding query filter params (role.id=c15ca78eb3c9472f94e15e2d28c7f403, scope.domain.id=default, user.id=06f2ad1758af4022bd84ef137b10c0c7) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:56:55.742785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb09a6c-9fe8-41b1-ba03-cb03b4a51436 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:55.744214 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb09a6c-9fe8-41b1-ba03-cb03b4a51436 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:55.752968 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 30/57] 10.222.0.85 () {56 vars in 1322 bytes} [Tue Aug 2 09:56:55 2022] GET /identity/v3/role_assignments?user.id=06f2ad1758af4022bd84ef137b10c0c7&scope.domain.id=default&role.id=c15ca78eb3c9472f94e15e2d28c7f403 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:56:57.267739 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa428e-8d55-4f6e-8bf8-34b4372f0b13 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:57.268247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa428e-8d55-4f6e-8bf8-34b4372f0b13 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:57.268328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa428e-8d55-4f6e-8bf8-34b4372f0b13 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:57.269706 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 28/58] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:56:57.274717 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc1cff-092f-48d4-b29e-9288fc0a235e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:57.275076 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc1cff-092f-48d4-b29e-9288fc0a235e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:57.275286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc1cff-092f-48d4-b29e-9288fc0a235e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:57.294695 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b0cc1cff-092f-48d4-b29e-9288fc0a235e None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:56:57.295901 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b0cc1cff-092f-48d4-b29e-9288fc0a235e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:56:57.361583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 31/59] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:56:57.385118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa428e-8d55-4f6e-8bf8-34b4372f0b13 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:57.486661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa428e-8d55-4f6e-8bf8-34b4372f0b13 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:57.519810 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8972e9-5467-49d4-8b58-153a1f196fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:57.520382 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8972e9-5467-49d4-8b58-153a1f196fec None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:57.520700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8972e9-5467-49d4-8b58-153a1f196fec None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:57.520982 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8972e9-5467-49d4-8b58-153a1f196fec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:57.522142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8972e9-5467-49d4-8b58-153a1f196fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:57.523593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8972e9-5467-49d4-8b58-153a1f196fec None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:57.525216 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 29/60] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:56:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:56:57.530856 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc1cff-092f-48d4-b29e-9288fc0a235e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:56:57.586034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:56:57.628606 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc1cff-092f-48d4-b29e-9288fc0a235e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:56:57.661689 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dda4a-c8b0-4f0e-9af1-4b772444e6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:56:57.662304 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dda4a-c8b0-4f0e-9af1-4b772444e6df None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:56:57.662593 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dda4a-c8b0-4f0e-9af1-4b772444e6df None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:56:57.662875 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dda4a-c8b0-4f0e-9af1-4b772444e6df None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:56:57.663566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0dda4a-c8b0-4f0e-9af1-4b772444e6df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:56:57.665055 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0dda4a-c8b0-4f0e-9af1-4b772444e6df None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:56:57.697564 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 32/61] 10.222.0.85 () {60 vars in 1132 bytes} [Tue Aug 2 09:56:57 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:57:00.817878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac9616-25e0-4820-a950-b3ae81718e22 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:00.818389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac9616-25e0-4820-a950-b3ae81718e22 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:00.818491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac9616-25e0-4820-a950-b3ae81718e22 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:00.819808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 30/62] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:00.825304 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a3197-98c1-401f-bf41-c61b63b64bfb None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:00.825741 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a3197-98c1-401f-bf41-c61b63b64bfb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:00.825916 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a3197-98c1-401f-bf41-c61b63b64bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:00.854283 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5e7a3197-98c1-401f-bf41-c61b63b64bfb None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:00.855502 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5e7a3197-98c1-401f-bf41-c61b63b64bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:00.954008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 33/63] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:00.995449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac9616-25e0-4820-a950-b3ae81718e22 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:01.066148 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782370fb-9bee-4abc-b0be-0f943c5e5d3d None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:01.066807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782370fb-9bee-4abc-b0be-0f943c5e5d3d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:01.067715 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782370fb-9bee-4abc-b0be-0f943c5e5d3d None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:01.069766 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 34/64] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:57:01.075821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76696883-b4bc-47a8-af1b-5ffa87b6aaf7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:01.076798 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76696883-b4bc-47a8-af1b-5ffa87b6aaf7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:01.077343 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76696883-b4bc-47a8-af1b-5ffa87b6aaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:01.104952 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:01.114000 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-76696883-b4bc-47a8-af1b-5ffa87b6aaf7 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:01.115231 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-76696883-b4bc-47a8-af1b-5ffa87b6aaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:01.167804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac9616-25e0-4820-a950-b3ae81718e22 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:01.193290 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:01.223947 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8826d-6dbf-43f0-9b91-165a5a648f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:01.224646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8826d-6dbf-43f0-9b91-165a5a648f3c None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:01.224989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8826d-6dbf-43f0-9b91-165a5a648f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:01.225272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8826d-6dbf-43f0-9b91-165a5a648f3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:01.236312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8826d-6dbf-43f0-9b91-165a5a648f3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:01.238086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 35/65] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:01.239212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ef239-0833-45f2-afd7-a403c54a41b4 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:01.239504 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ef239-0833-45f2-afd7-a403c54a41b4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:01.239785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ef239-0833-45f2-afd7-a403c54a41b4 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:01.241976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-30a8826d-6dbf-43f0-9b91-165a5a648f3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:01.241976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:01.241976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:01.241976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:01.241976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:01.241976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:01.241976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:01.241976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:01.241976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:01.241976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:01.241976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:01.241976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:01.241976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:01.241976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:01.241976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:01.241976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:01.242809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:01.242809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:01.242809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:01.242809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:01.242809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:01.242809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:01.242809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:01.242809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:01.242809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:01.242809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:01.242809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:01.242809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:01.242809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:01.242809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:01.242809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:01.242809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:01.244246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:01.244246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:01.244246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:01.244246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:01.244246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:01.244246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:01.244246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:01.244246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:01.244246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:01.244246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:01.244246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:01.244246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:01.244246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 31/66] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:01.249049 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 36/67] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:01.250033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b06df7-cf08-42b2-bdac-65b96844e314 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:01.250326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b06df7-cf08-42b2-bdac-65b96844e314 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:01.250604 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b06df7-cf08-42b2-bdac-65b96844e314 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:01.250869 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ef239-0833-45f2-afd7-a403c54a41b4 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:01.252512 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 32/68] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:01.257616 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552f31b-5c36-491e-bada-50d1be33e327 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:01.258039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552f31b-5c36-491e-bada-50d1be33e327 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:01.258434 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9552f31b-5c36-491e-bada-50d1be33e327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:01.277394 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-9552f31b-5c36-491e-bada-50d1be33e327 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:01.278819 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-9552f31b-5c36-491e-bada-50d1be33e327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:01.368886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 33/69] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:01.368886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43ea9-02cd-4acb-9296-71da6c36e784 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:01.368886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43ea9-02cd-4acb-9296-71da6c36e784 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:01.368886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb43ea9-02cd-4acb-9296-71da6c36e784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:01.371374 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ef239-0833-45f2-afd7-a403c54a41b4 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:01.386678 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-7bb43ea9-02cd-4acb-9296-71da6c36e784 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:01.387866 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7bb43ea9-02cd-4acb-9296-71da6c36e784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:01.407536 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d487757-34ed-4fdd-bf1b-736acd783bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:01.408427 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d487757-34ed-4fdd-bf1b-736acd783bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:01.408738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d487757-34ed-4fdd-bf1b-736acd783bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:01.409016 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d487757-34ed-4fdd-bf1b-736acd783bd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:01.409744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d487757-34ed-4fdd-bf1b-736acd783bd9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:01.410049 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d487757-34ed-4fdd-bf1b-736acd783bd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:01.411432 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d487757-34ed-4fdd-bf1b-736acd783bd9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:01.423278 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 37/70] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:01.424080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d487757-34ed-4fdd-bf1b-736acd783bd9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:01.440161 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:01.457558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 34/71] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:01.468635 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:01.468724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20786454-abf9-406e-b106-38c2d405af28 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:01.468724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20786454-abf9-406e-b106-38c2d405af28 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:01.468724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20786454-abf9-406e-b106-38c2d405af28 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:01.468724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 35/72] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:01.468724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20786454-abf9-406e-b106-38c2d405af28 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:01.538910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d487757-34ed-4fdd-bf1b-736acd783bd9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:01.567576 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20786454-abf9-406e-b106-38c2d405af28 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:01.574721 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe77e2d-d555-43bb-9790-6fbbdf9d18e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:01.575362 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe77e2d-d555-43bb-9790-6fbbdf9d18e9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:01.575639 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe77e2d-d555-43bb-9790-6fbbdf9d18e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:01.575911 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe77e2d-d555-43bb-9790-6fbbdf9d18e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:01.587579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe77e2d-d555-43bb-9790-6fbbdf9d18e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:01.594254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-6fe77e2d-d555-43bb-9790-6fbbdf9d18e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:57:01.594254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:01.594254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:01.594254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:01.594254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:01.594254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:01.594254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:01.594254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:01.594254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:01.594254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:01.594254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:01.594254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:01.594254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:01.594254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:01.594254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:01.594254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:01.595127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:01.595127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:01.595127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:01.595127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:01.595127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:01.595127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:01.595127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:01.595127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:01.595127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:01.595127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:01.595127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:01.595127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:01.595127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:01.595127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:01.595127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:01.595127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:01.595872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:01.595872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:01.595872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:01.595872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:01.595872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:01.595872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:01.595872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:01.595872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:01.595872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:01.595872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:01.595872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:57:01.595872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:01.595872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 38/73] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:57:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:01.596682 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe77e2d-d555-43bb-9790-6fbbdf9d18e9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:01.605937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8dc19-f8e5-4bb0-a51b-af93d0937303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:01.606584 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8dc19-f8e5-4bb0-a51b-af93d0937303 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:01.606869 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8dc19-f8e5-4bb0-a51b-af93d0937303 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:01.607145 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8dc19-f8e5-4bb0-a51b-af93d0937303 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:01.608310 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8dc19-f8e5-4bb0-a51b-af93d0937303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:01.609787 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8dc19-f8e5-4bb0-a51b-af93d0937303 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:01.611363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 36/74] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:01.612475 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f423c-5c96-4b16-adfb-1c023f264d12 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:01.612779 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f423c-5c96-4b16-adfb-1c023f264d12 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:01.613061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f423c-5c96-4b16-adfb-1c023f264d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:01.630877 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-b66f423c-5c96-4b16-adfb-1c023f264d12 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:01.631984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b66f423c-5c96-4b16-adfb-1c023f264d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:01.680104 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:01.691981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:01.698534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 37/75] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:01.698737 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe77e2d-d555-43bb-9790-6fbbdf9d18e9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:01.699367 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f423c-5c96-4b16-adfb-1c023f264d12 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:01.733767 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdcb5e-f80a-448d-9233-0d1778f5053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:01.734409 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdcb5e-f80a-448d-9233-0d1778f5053c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:01.734689 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdcb5e-f80a-448d-9233-0d1778f5053c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:01.734969 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdcb5e-f80a-448d-9233-0d1778f5053c None admin] PATH_INFO: `/v3/users/931bf62912bf4be1b0054eaf8b68847c` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:01.749787 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdcb5e-f80a-448d-9233-0d1778f5053c None admin] RBAC: Authorizing `identity:get_user(user_id=931bf62912bf4be1b0054eaf8b68847c)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:01.751300 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdcb5e-f80a-448d-9233-0d1778f5053c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:01.752990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 39/76] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:01 2022] GET /identity/v3/users/931bf62912bf4be1b0054eaf8b68847c => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:01.753755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdcb5e-f80a-448d-9233-0d1778f5053c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:01.812715 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f423c-5c96-4b16-adfb-1c023f264d12 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:01.848110 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeff013-fc9e-4eac-81a7-3936fbaa2ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:01.848774 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeff013-fc9e-4eac-81a7-3936fbaa2ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:01.849053 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeff013-fc9e-4eac-81a7-3936fbaa2ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:01.849333 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeff013-fc9e-4eac-81a7-3936fbaa2ae0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:01.852729 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdcb5e-f80a-448d-9233-0d1778f5053c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:01.859641 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeff013-fc9e-4eac-81a7-3936fbaa2ae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:01.864631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-5eeff013-fc9e-4eac-81a7-3936fbaa2ae0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:01.864631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:01.864631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:01.864631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:01.864631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:01.864631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:01.864631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:01.864631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:01.864631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:01.864631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:01.864631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:01.864631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:01.864631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:01.864631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:01.864631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:01.864631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:01.865648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:01.865648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:01.865648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:01.865648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:01.865648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:01.865648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:01.865648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:01.865648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:01.865648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:01.865648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:01.865648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:01.865648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:01.865648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:01.865648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:01.865648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:01.865648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:01.866643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:01.866643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:01.866643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:01.866643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:01.866643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:01.866643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:01.866643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:01.866643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:01.866643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:01.866643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:01.866643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:01.866643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:01.866643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 38/77] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:57:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:01.866643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeff013-fc9e-4eac-81a7-3936fbaa2ae0 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:01.890459 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdac5ff-3ac1-4d7b-90e4-bdf181053fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:01.890999 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdac5ff-3ac1-4d7b-90e4-bdf181053fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:01.891286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdac5ff-3ac1-4d7b-90e4-bdf181053fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:01.891565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdac5ff-3ac1-4d7b-90e4-bdf181053fa9 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:01.892272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdac5ff-3ac1-4d7b-90e4-bdf181053fa9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:01.892608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdac5ff-3ac1-4d7b-90e4-bdf181053fa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:01.893981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdac5ff-3ac1-4d7b-90e4-bdf181053fa9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:01.902203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 40/78] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:01.905308 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdac5ff-3ac1-4d7b-90e4-bdf181053fa9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:01.913721 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:01.922573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:01.970007 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeff013-fc9e-4eac-81a7-3936fbaa2ae0 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:02.003618 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695847a5-8746-43a8-b994-23fc4ec3e7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:02.004230 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695847a5-8746-43a8-b994-23fc4ec3e7f1 None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:02.004546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695847a5-8746-43a8-b994-23fc4ec3e7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:02.004830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695847a5-8746-43a8-b994-23fc4ec3e7f1 None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:02.005518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695847a5-8746-43a8-b994-23fc4ec3e7f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:02.006969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695847a5-8746-43a8-b994-23fc4ec3e7f1 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:02.009567 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdac5ff-3ac1-4d7b-90e4-bdf181053fa9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:02.034397 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 39/79] 10.222.0.85 () {60 vars in 1132 bytes} [Tue Aug 2 09:57:01 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:57:02.035412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695847a5-8746-43a8-b994-23fc4ec3e7f1 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:02.043761 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834d3cd-8c53-4e93-be3c-959468573507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:02.044419 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834d3cd-8c53-4e93-be3c-959468573507 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:02.044740 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834d3cd-8c53-4e93-be3c-959468573507 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:02.045010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834d3cd-8c53-4e93-be3c-959468573507 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:02.058975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834d3cd-8c53-4e93-be3c-959468573507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:02.064803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-b834d3cd-8c53-4e93-be3c-959468573507 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:02.064803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:02.064803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:02.064803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:02.064803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:02.064803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:02.064803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:02.064803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:02.064803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:02.064803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:02.064803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:02.064803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:02.064803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:02.064803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:02.064803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:02.064803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:02.065836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:02.065836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:02.065836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:02.065836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:02.065836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:02.065836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:02.065836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:02.065836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:02.065836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:02.065836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:02.065836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:02.065836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:02.065836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:02.065836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:02.065836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:02.065836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:02.066596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:02.066596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:02.066596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:02.066596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:02.066596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:02.066596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:02.066596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:02.066596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:02.066596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:02.066596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:02.066596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:02.066596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:02.066596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 41/80] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:02.067238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834d3cd-8c53-4e93-be3c-959468573507 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:02.160399 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:02.173619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:02.177698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695847a5-8746-43a8-b994-23fc4ec3e7f1 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:02.191394 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834d3cd-8c53-4e93-be3c-959468573507 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:02.221451 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ebe90-6b56-4eb0-8dcd-868d2bb00e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:02.222085 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ebe90-6b56-4eb0-8dcd-868d2bb00e7b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:02.222375 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ebe90-6b56-4eb0-8dcd-868d2bb00e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:02.222654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975ebe90-6b56-4eb0-8dcd-868d2bb00e7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:02.230311 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e38b3b-5f5d-42cb-89c7-8a0f523a6a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:02.230934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e38b3b-5f5d-42cb-89c7-8a0f523a6a24 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:02.231219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e38b3b-5f5d-42cb-89c7-8a0f523a6a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:02.231492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e38b3b-5f5d-42cb-89c7-8a0f523a6a24 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:02.232223 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e38b3b-5f5d-42cb-89c7-8a0f523a6a24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:02.232573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e38b3b-5f5d-42cb-89c7-8a0f523a6a24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:02.233980 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e38b3b-5f5d-42cb-89c7-8a0f523a6a24 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:02.244505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 42/81] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:57:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:02.245408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e38b3b-5f5d-42cb-89c7-8a0f523a6a24 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:02.306282 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ebe90-6b56-4eb0-8dcd-868d2bb00e7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:02.307360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975ebe90-6b56-4eb0-8dcd-868d2bb00e7b None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:02.382111 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e38b3b-5f5d-42cb-89c7-8a0f523a6a24 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:02.420225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492d0fa-06c5-4532-9f01-833d423c31b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:02.420827 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492d0fa-06c5-4532-9f01-833d423c31b4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:02.421126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492d0fa-06c5-4532-9f01-833d423c31b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:02.421384 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492d0fa-06c5-4532-9f01-833d423c31b4 None admin] PATH_INFO: `/v3/users/06f2ad1758af4022bd84ef137b10c0c7` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:02.422573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492d0fa-06c5-4532-9f01-833d423c31b4 None admin] RBAC: Authorizing `identity:get_user(user_id=06f2ad1758af4022bd84ef137b10c0c7)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:02.424030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492d0fa-06c5-4532-9f01-833d423c31b4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:02.425673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 43/82] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:02 2022] GET /identity/v3/users/06f2ad1758af4022bd84ef137b10c0c7 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:02.426453 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492d0fa-06c5-4532-9f01-833d423c31b4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:02.434962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:02.441064 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:02.448957 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 40/83] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:02.450056 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ebe90-6b56-4eb0-8dcd-868d2bb00e7b None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:02.548646 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492d0fa-06c5-4532-9f01-833d423c31b4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:02.587590 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0306e7f-930c-4935-925b-ad26814e2090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:02.588214 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0306e7f-930c-4935-925b-ad26814e2090 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:02.588524 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0306e7f-930c-4935-925b-ad26814e2090 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:02.588742 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975ebe90-6b56-4eb0-8dcd-868d2bb00e7b None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:02.588841 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0306e7f-930c-4935-925b-ad26814e2090 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:02.589509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0306e7f-930c-4935-925b-ad26814e2090 None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:02.589814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0306e7f-930c-4935-925b-ad26814e2090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:02.591367 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0306e7f-930c-4935-925b-ad26814e2090 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:02.600380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 44/84] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:02.605441 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0306e7f-930c-4935-925b-ad26814e2090 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:02.639103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d1211-f0d9-47a5-9ab0-1e11e83927ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:02.640418 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d1211-f0d9-47a5-9ab0-1e11e83927ef None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:02.641357 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d1211-f0d9-47a5-9ab0-1e11e83927ef None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:02.641974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d1211-f0d9-47a5-9ab0-1e11e83927ef None admin] PATH_INFO: `/v3/users/931bf62912bf4be1b0054eaf8b68847c` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:02.643702 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d1211-f0d9-47a5-9ab0-1e11e83927ef None admin] RBAC: Authorizing `identity:get_user(user_id=931bf62912bf4be1b0054eaf8b68847c)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:02.646090 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d1211-f0d9-47a5-9ab0-1e11e83927ef None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:02.649712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 41/85] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:02 2022] GET /identity/v3/users/931bf62912bf4be1b0054eaf8b68847c => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:02.650984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d1211-f0d9-47a5-9ab0-1e11e83927ef None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:02.694370 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:02.738034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:02.738990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0306e7f-930c-4935-925b-ad26814e2090 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:02.783087 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d1211-f0d9-47a5-9ab0-1e11e83927ef None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:02.792019 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a355106-ede8-4559-8510-e64f7653077e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:02.793441 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a355106-ede8-4559-8510-e64f7653077e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:02.793928 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a355106-ede8-4559-8510-e64f7653077e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:02.794438 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a355106-ede8-4559-8510-e64f7653077e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:02.821512 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eb46f-64b0-4996-a7bd-be31a18ae3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:02.822252 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eb46f-64b0-4996-a7bd-be31a18ae3bd None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:02.822620 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eb46f-64b0-4996-a7bd-be31a18ae3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:02.822963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eb46f-64b0-4996-a7bd-be31a18ae3bd None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:02.824228 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5eb46f-64b0-4996-a7bd-be31a18ae3bd None admin] RBAC: Authorizing `identity:get_project(project_id=20f771efd436479ebbfe994b525b28dc)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:02.825778 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5eb46f-64b0-4996-a7bd-be31a18ae3bd None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:02.827602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 42/86] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:02 2022] GET /identity/v3/projects/20f771efd436479ebbfe994b525b28dc => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:02.828442 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eb46f-64b0-4996-a7bd-be31a18ae3bd None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:02.882176 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a355106-ede8-4559-8510-e64f7653077e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:02.884407 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a355106-ede8-4559-8510-e64f7653077e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:02.951192 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eb46f-64b0-4996-a7bd-be31a18ae3bd None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:02.956842 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:02.989196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a624d7-d468-4435-aadf-4ef380a88af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:02.990129 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a624d7-d468-4435-aadf-4ef380a88af1 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:02.990615 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a624d7-d468-4435-aadf-4ef380a88af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:02.991097 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a624d7-d468-4435-aadf-4ef380a88af1 None admin] PATH_INFO: `/v3/users/931bf62912bf4be1b0054eaf8b68847c` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:02.992063 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 45/87] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:02.993332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a624d7-d468-4435-aadf-4ef380a88af1 None admin] RBAC: Authorizing `identity:get_user(user_id=931bf62912bf4be1b0054eaf8b68847c)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:02.995047 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a624d7-d468-4435-aadf-4ef380a88af1 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:02.996881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 43/88] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:02 2022] GET /identity/v3/users/931bf62912bf4be1b0054eaf8b68847c => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:02.997732 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a355106-ede8-4559-8510-e64f7653077e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:02.998201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a624d7-d468-4435-aadf-4ef380a88af1 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:03.001930 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:03.105020 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a355106-ede8-4559-8510-e64f7653077e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:03.106531 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a624d7-d468-4435-aadf-4ef380a88af1 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:03.140245 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff933d-3b2a-4b84-8e10-a680ff69d152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:03.141151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff933d-3b2a-4b84-8e10-a680ff69d152 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:03.141504 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff933d-3b2a-4b84-8e10-a680ff69d152 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:03.141860 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff933d-3b2a-4b84-8e10-a680ff69d152 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:03.143902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c4989-90d2-48a1-879c-b5ca95f7b433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:03.144730 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c4989-90d2-48a1-879c-b5ca95f7b433 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:03.145187 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c4989-90d2-48a1-879c-b5ca95f7b433 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:03.145630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c4989-90d2-48a1-879c-b5ca95f7b433 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:03.146574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c4989-90d2-48a1-879c-b5ca95f7b433 None admin] RBAC: Adding query filter params (role.id=a2d6e3ab7e054be982bc78ce3c0a9748, scope.project.id=20f771efd436479ebbfe994b525b28dc, user.id=931bf62912bf4be1b0054eaf8b68847c) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:03.147079 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c4989-90d2-48a1-879c-b5ca95f7b433 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:03.149424 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c4989-90d2-48a1-879c-b5ca95f7b433 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:03.155535 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 44/89] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:57:02 2022] GET /identity/v3/role_assignments?user.id=931bf62912bf4be1b0054eaf8b68847c&scope.project.id=20f771efd436479ebbfe994b525b28dc&role.id=a2d6e3ab7e054be982bc78ce3c0a9748 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:03.156546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c4989-90d2-48a1-879c-b5ca95f7b433 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:03.213109 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:03.234471 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:03.264976 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff933d-3b2a-4b84-8e10-a680ff69d152 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:03.266273 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff933d-3b2a-4b84-8e10-a680ff69d152 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:03.275536 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c4989-90d2-48a1-879c-b5ca95f7b433 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:03.332874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749fe52-d438-4360-a79e-cf764ff751ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:03.333983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749fe52-d438-4360-a79e-cf764ff751ab None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:03.334476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749fe52-d438-4360-a79e-cf764ff751ab None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:03.334958 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749fe52-d438-4360-a79e-cf764ff751ab None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:03.337822 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749fe52-d438-4360-a79e-cf764ff751ab None admin] RBAC: Authorizing `identity:get_project(project_id=20f771efd436479ebbfe994b525b28dc)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:03.339701 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749fe52-d438-4360-a79e-cf764ff751ab None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:03.342424 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 45/90] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:03 2022] GET /identity/v3/projects/20f771efd436479ebbfe994b525b28dc => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:03.343508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749fe52-d438-4360-a79e-cf764ff751ab None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:03.482337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749fe52-d438-4360-a79e-cf764ff751ab None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:03.486676 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 46/91] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:03.487675 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff933d-3b2a-4b84-8e10-a680ff69d152 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:03.568860 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:03.573179 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb7a07-f060-4c5d-8e86-407333e74229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:03.573826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb7a07-f060-4c5d-8e86-407333e74229 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:03.574121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb7a07-f060-4c5d-8e86-407333e74229 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:03.574409 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb7a07-f060-4c5d-8e86-407333e74229 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:03.587247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:03.605939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff933d-3b2a-4b84-8e10-a680ff69d152 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:03.641339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a229c4-69f2-4881-bb3a-40ef0dcd512a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:03.641966 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a229c4-69f2-4881-bb3a-40ef0dcd512a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:03.642255 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a229c4-69f2-4881-bb3a-40ef0dcd512a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:03.642541 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a229c4-69f2-4881-bb3a-40ef0dcd512a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:03.643338 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a229c4-69f2-4881-bb3a-40ef0dcd512a None admin] RBAC: Adding query filter params (role.id=c15ca78eb3c9472f94e15e2d28c7f403, scope.project.id=20f771efd436479ebbfe994b525b28dc, user.id=06f2ad1758af4022bd84ef137b10c0c7) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:03.643656 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a229c4-69f2-4881-bb3a-40ef0dcd512a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:03.645173 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a229c4-69f2-4881-bb3a-40ef0dcd512a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:03.651088 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 47/92] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:57:03 2022] GET /identity/v3/role_assignments?user.id=06f2ad1758af4022bd84ef137b10c0c7&scope.project.id=20f771efd436479ebbfe994b525b28dc&role.id=c15ca78eb3c9472f94e15e2d28c7f403 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:03.651860 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a229c4-69f2-4881-bb3a-40ef0dcd512a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:03.739223 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb7a07-f060-4c5d-8e86-407333e74229 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:03.741214 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb7a07-f060-4c5d-8e86-407333e74229 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:03.762765 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a229c4-69f2-4881-bb3a-40ef0dcd512a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:03.794322 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:03.805259 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11919c-d853-4931-bbef-085bf62a7503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:03.805924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11919c-d853-4931-bbef-085bf62a7503 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:03.806210 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11919c-d853-4931-bbef-085bf62a7503 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:03.806491 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11919c-d853-4931-bbef-085bf62a7503 None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:03.807939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11919c-d853-4931-bbef-085bf62a7503 None admin] RBAC: Authorizing `identity:get_project(project_id=20f771efd436479ebbfe994b525b28dc)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:03.809462 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11919c-d853-4931-bbef-085bf62a7503 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:03.811165 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 48/93] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:03 2022] GET /identity/v3/projects/20f771efd436479ebbfe994b525b28dc => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:03.817475 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11919c-d853-4931-bbef-085bf62a7503 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:03.937431 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11919c-d853-4931-bbef-085bf62a7503 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:03.944729 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 46/94] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:03.954355 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb7a07-f060-4c5d-8e86-407333e74229 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:04.007148 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829b763-9602-4df0-b556-6448cb62d7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:04.008739 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829b763-9602-4df0-b556-6448cb62d7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:04.010010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829b763-9602-4df0-b556-6448cb62d7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:04.010183 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:04.010646 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829b763-9602-4df0-b556-6448cb62d7c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:04.011677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829b763-9602-4df0-b556-6448cb62d7c2 None admin] RBAC: Adding query filter params (role.id=cbb81f88446a46f38469b450c5f24624, scope.project.id=20f771efd436479ebbfe994b525b28dc, user.id=931bf62912bf4be1b0054eaf8b68847c) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:04.014215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829b763-9602-4df0-b556-6448cb62d7c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:04.015902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829b763-9602-4df0-b556-6448cb62d7c2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:04.028499 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 49/95] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:57:03 2022] GET /identity/v3/role_assignments?user.id=931bf62912bf4be1b0054eaf8b68847c&scope.project.id=20f771efd436479ebbfe994b525b28dc&role.id=cbb81f88446a46f38469b450c5f24624 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:04.115340 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb7a07-f060-4c5d-8e86-407333e74229 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:04.165927 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c283d16b-e7a8-40f6-ab85-e3d6694dcf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:04.166609 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283d16b-e7a8-40f6-ab85-e3d6694dcf9e None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:04.166901 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283d16b-e7a8-40f6-ab85-e3d6694dcf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:04.167185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c283d16b-e7a8-40f6-ab85-e3d6694dcf9e None admin] PATH_INFO: `/v3/projects/e5cff9501c6147edaf6a4409802856b7` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:04.168386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283d16b-e7a8-40f6-ab85-e3d6694dcf9e None admin] RBAC: Authorizing `identity:get_project(project_id=e5cff9501c6147edaf6a4409802856b7)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:04.169891 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c283d16b-e7a8-40f6-ab85-e3d6694dcf9e None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:04.171585 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 47/96] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:03 2022] GET /identity/v3/projects/e5cff9501c6147edaf6a4409802856b7 => generated 312 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:04.177882 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829b763-9602-4df0-b556-6448cb62d7c2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:04.277029 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:04.320337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829b763-9602-4df0-b556-6448cb62d7c2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:04.358636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cef75-b475-4c66-bdfa-e7a42bf55993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:04.359266 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cef75-b475-4c66-bdfa-e7a42bf55993 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:04.359555 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cef75-b475-4c66-bdfa-e7a42bf55993 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:04.359834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cef75-b475-4c66-bdfa-e7a42bf55993 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:04.360667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cef75-b475-4c66-bdfa-e7a42bf55993 None admin] RBAC: Adding query filter params (role.id=a2d6e3ab7e054be982bc78ce3c0a9748, scope.project.id=e5cff9501c6147edaf6a4409802856b7, user.id=931bf62912bf4be1b0054eaf8b68847c) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:04.360982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cef75-b475-4c66-bdfa-e7a42bf55993 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:04.362435 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cef75-b475-4c66-bdfa-e7a42bf55993 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:04.371222 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 50/97] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:57:04 2022] GET /identity/v3/role_assignments?user.id=931bf62912bf4be1b0054eaf8b68847c&scope.project.id=e5cff9501c6147edaf6a4409802856b7&role.id=a2d6e3ab7e054be982bc78ce3c0a9748 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:04.595458 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3dbbb-8799-4fae-9803-382c7ac0146d None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:04.595784 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3dbbb-8799-4fae-9803-382c7ac0146d None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:04.595956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3dbbb-8799-4fae-9803-382c7ac0146d None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:04.597609 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 48/98] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:04.603068 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad616de8-33f7-4131-b551-3ca857dca91c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:04.603369 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad616de8-33f7-4131-b551-3ca857dca91c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:04.603656 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad616de8-33f7-4131-b551-3ca857dca91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:04.625715 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ad616de8-33f7-4131-b551-3ca857dca91c None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:04.627248 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ad616de8-33f7-4131-b551-3ca857dca91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:04.714242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 51/99] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:04.729613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25ee9f-9fe5-4a69-b595-f20c3cb37666 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:04.730180 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25ee9f-9fe5-4a69-b595-f20c3cb37666 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:04.730662 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25ee9f-9fe5-4a69-b595-f20c3cb37666 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:04.732517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 49/100] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:04.746257 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cec886-5bbc-41ef-8ed8-7c54506fe647 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:04.746843 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cec886-5bbc-41ef-8ed8-7c54506fe647 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:04.747344 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cec886-5bbc-41ef-8ed8-7c54506fe647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:04.769100 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25ee9f-9fe5-4a69-b595-f20c3cb37666 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:04.775447 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-22cec886-5bbc-41ef-8ed8-7c54506fe647 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:04.776940 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-22cec886-5bbc-41ef-8ed8-7c54506fe647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:04.853269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:04.886118 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 52/101] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:04.921774 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cec886-5bbc-41ef-8ed8-7c54506fe647 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:04.975199 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25ee9f-9fe5-4a69-b595-f20c3cb37666 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:04.979617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:05.018161 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922212c2-002a-4f67-a096-0bce932506d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:05.019201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922212c2-002a-4f67-a096-0bce932506d9 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:05.019850 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922212c2-002a-4f67-a096-0bce932506d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:05.020504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922212c2-002a-4f67-a096-0bce932506d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:05.032605 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922212c2-002a-4f67-a096-0bce932506d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:05.038695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-922212c2-002a-4f67-a096-0bce932506d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:57:05.038695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:05.038695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:05.038695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:05.038695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:05.038695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:05.038695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:05.038695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:05.038695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:05.038695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:05.038695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:05.038695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:05.038695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:05.038695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:05.038695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:05.038695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:05.039539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:05.039539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:05.039539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:05.039539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:05.039539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:05.039539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:05.039539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:05.039539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:05.039539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:05.039539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:05.039539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:05.039539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:05.039539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:05.039539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:05.039539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:05.039539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:05.040278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:05.040278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:05.040278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:05.040278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:05.040278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:05.040278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:05.040278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:05.040278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:05.040278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:05.040278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:05.040278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:57:05.040278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:05.042802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 50/102] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:57:05.049684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922212c2-002a-4f67-a096-0bce932506d9 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:05.107717 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cec886-5bbc-41ef-8ed8-7c54506fe647 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:05.143702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64c585-3dc5-41a1-b1c3-35d06d6c6152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:05.144344 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64c585-3dc5-41a1-b1c3-35d06d6c6152 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:05.144669 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64c585-3dc5-41a1-b1c3-35d06d6c6152 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:05.144946 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64c585-3dc5-41a1-b1c3-35d06d6c6152 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:05.146106 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64c585-3dc5-41a1-b1c3-35d06d6c6152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:05.148102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64c585-3dc5-41a1-b1c3-35d06d6c6152 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:05.149996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 53/103] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:05.155366 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64c585-3dc5-41a1-b1c3-35d06d6c6152 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:05.215423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:05.258477 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922212c2-002a-4f67-a096-0bce932506d9 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:05.288988 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64c585-3dc5-41a1-b1c3-35d06d6c6152 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:05.329635 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb0f11-d3c1-458d-a8c1-40d340a67c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:05.330249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb0f11-d3c1-458d-a8c1-40d340a67c36 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:05.330534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb0f11-d3c1-458d-a8c1-40d340a67c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:05.330810 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb0f11-d3c1-458d-a8c1-40d340a67c36 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:05.331543 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb0f11-d3c1-458d-a8c1-40d340a67c36 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:05.331847 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb0f11-d3c1-458d-a8c1-40d340a67c36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:05.333252 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb0f11-d3c1-458d-a8c1-40d340a67c36 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:05.351934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 51/104] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:05.357817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb0f11-d3c1-458d-a8c1-40d340a67c36 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:05.363038 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ad06d-c0be-458b-b28f-bba4039fe24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:05.363676 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ad06d-c0be-458b-b28f-bba4039fe24d None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:05.363958 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ad06d-c0be-458b-b28f-bba4039fe24d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:05.364233 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ad06d-c0be-458b-b28f-bba4039fe24d None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:05.364948 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ad06d-c0be-458b-b28f-bba4039fe24d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:05.366922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ad06d-c0be-458b-b28f-bba4039fe24d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:05.433476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:05.434032 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 54/105] 10.222.0.85 () {60 vars in 1141 bytes} [Tue Aug 2 09:57:05 2022] POST /identity/v3/projects => generated 302 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:57:05.543034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb0f11-d3c1-458d-a8c1-40d340a67c36 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:05.593555 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853db35-db57-42e6-b950-d6dc6eb38004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:05.594236 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853db35-db57-42e6-b950-d6dc6eb38004 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:05.594527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853db35-db57-42e6-b950-d6dc6eb38004 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:05.594812 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853db35-db57-42e6-b950-d6dc6eb38004 None admin] PATH_INFO: `/v3/users/d51fee4347f34eea80067f0d8e75f681` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:05.619142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853db35-db57-42e6-b950-d6dc6eb38004 None admin] RBAC: Authorizing `identity:get_user(user_id=d51fee4347f34eea80067f0d8e75f681)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:05.620586 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853db35-db57-42e6-b950-d6dc6eb38004 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:05.626589 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 52/106] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:05 2022] GET /identity/v3/users/d51fee4347f34eea80067f0d8e75f681 => generated 289 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:05.629589 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ad06d-c0be-458b-b28f-bba4039fe24d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:05.809747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ad06d-c0be-458b-b28f-bba4039fe24d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:05.824429 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:05.859144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1d8df-5bfc-4bbe-a978-67402fffbe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:05.860183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1d8df-5bfc-4bbe-a978-67402fffbe10 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:05.860757 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1d8df-5bfc-4bbe-a978-67402fffbe10 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:05.861237 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1d8df-5bfc-4bbe-a978-67402fffbe10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:05.946603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1d8df-5bfc-4bbe-a978-67402fffbe10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:05.948510 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1d8df-5bfc-4bbe-a978-67402fffbe10 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:06.073751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 55/107] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:06.081570 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853db35-db57-42e6-b950-d6dc6eb38004 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:06.182527 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8981f-b82d-4261-8872-6e89d3e32bed None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:06.183479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8981f-b82d-4261-8872-6e89d3e32bed None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:06.183982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8981f-b82d-4261-8872-6e89d3e32bed None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:06.185601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:06.185708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 56/108] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:06.191405 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118356f-9e94-43c9-a6a2-7019f8dab9b6 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:06.192045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118356f-9e94-43c9-a6a2-7019f8dab9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:06.192559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118356f-9e94-43c9-a6a2-7019f8dab9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:06.203120 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853db35-db57-42e6-b950-d6dc6eb38004 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:06.214587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:06.225289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0118356f-9e94-43c9-a6a2-7019f8dab9b6 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:06.226954 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0118356f-9e94-43c9-a6a2-7019f8dab9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:06.241012 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab5ae8-87d2-4667-864b-7652f87d2c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:06.241678 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab5ae8-87d2-4667-864b-7652f87d2c05 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:06.241966 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab5ae8-87d2-4667-864b-7652f87d2c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:06.242251 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ab5ae8-87d2-4667-864b-7652f87d2c05 None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:06.243453 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab5ae8-87d2-4667-864b-7652f87d2c05 None admin] RBAC: Authorizing `identity:get_project(project_id=20f771efd436479ebbfe994b525b28dc)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:06.244984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ab5ae8-87d2-4667-864b-7652f87d2c05 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:06.246679 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 53/109] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:06 2022] GET /identity/v3/projects/20f771efd436479ebbfe994b525b28dc => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:06.252589 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab5ae8-87d2-4667-864b-7652f87d2c05 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:06.376293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ab5ae8-87d2-4667-864b-7652f87d2c05 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:06.400690 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 57/110] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:06.428828 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6fe12-bb42-491c-8aae-530f7f6d103a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:06.429461 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6fe12-bb42-491c-8aae-530f7f6d103a None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:06.429748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6fe12-bb42-491c-8aae-530f7f6d103a None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:06.430029 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6fe12-bb42-491c-8aae-530f7f6d103a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:06.430840 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6fe12-bb42-491c-8aae-530f7f6d103a None admin] RBAC: Adding query filter params (role.id=3c4094b115cb4252aec1c29de8391a07, scope.project.id=20f771efd436479ebbfe994b525b28dc, user.id=d51fee4347f34eea80067f0d8e75f681) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:06.431153 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6fe12-bb42-491c-8aae-530f7f6d103a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:06.433666 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e6fe12-bb42-491c-8aae-530f7f6d103a None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:06.436834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118356f-9e94-43c9-a6a2-7019f8dab9b6 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:06.461164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 54/111] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:57:06 2022] GET /identity/v3/role_assignments?user.id=d51fee4347f34eea80067f0d8e75f681&scope.project.id=20f771efd436479ebbfe994b525b28dc&role.id=3c4094b115cb4252aec1c29de8391a07 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:06.571770 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118356f-9e94-43c9-a6a2-7019f8dab9b6 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:06.608882 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d4cc4-fbdc-46c3-b00a-7d3f98242898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:06.609540 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d4cc4-fbdc-46c3-b00a-7d3f98242898 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:06.609829 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d4cc4-fbdc-46c3-b00a-7d3f98242898 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:06.610110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d4cc4-fbdc-46c3-b00a-7d3f98242898 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:06.616849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:06.623380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d4cc4-fbdc-46c3-b00a-7d3f98242898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:06.629151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-c90d4cc4-fbdc-46c3-b00a-7d3f98242898 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:06.629151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:06.629151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:06.629151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:06.629151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:06.629151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:06.629151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:06.629151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:06.629151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:06.629151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:06.629151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:06.629151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:06.629151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:06.629151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:06.629151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:06.629151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:06.630249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:06.630249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:06.630249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:06.630249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:06.630249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:06.630249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:06.630249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:06.630249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:06.630249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:06.630249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:06.630249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:06.630249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:06.630249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:06.630249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:06.630249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:06.630249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:06.632243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:06.632243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:06.632243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:06.632243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:06.632243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:06.632243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:06.632243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:06.632243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:06.632243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:06.632243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:06.632243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:06.632243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:06.638357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 58/112] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:06.644185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6fe12-bb42-491c-8aae-530f7f6d103a None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:06.665648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:06.756668 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6fe12-bb42-491c-8aae-530f7f6d103a None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:06.798316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed8134-b9bb-4cb3-928d-e9382030942b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:06.799227 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed8134-b9bb-4cb3-928d-e9382030942b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:06.799663 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed8134-b9bb-4cb3-928d-e9382030942b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:06.800086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed8134-b9bb-4cb3-928d-e9382030942b None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:06.801232 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed8134-b9bb-4cb3-928d-e9382030942b None admin] RBAC: Adding query filter params (name=member) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:06.801761 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed8134-b9bb-4cb3-928d-e9382030942b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:06.804945 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed8134-b9bb-4cb3-928d-e9382030942b None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:06.821652 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 55/113] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:06.824956 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cad567-fa2a-46d9-a356-ad3ef9bdf271 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:06.825251 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cad567-fa2a-46d9-a356-ad3ef9bdf271 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:06.825535 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cad567-fa2a-46d9-a356-ad3ef9bdf271 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:06.826888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 59/114] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:06.829210 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed8134-b9bb-4cb3-928d-e9382030942b None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:06.847062 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc098b-351c-4b72-8d21-138b4cf36d0f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:06.847506 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc098b-351c-4b72-8d21-138b4cf36d0f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:06.847936 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc098b-351c-4b72-8d21-138b4cf36d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:06.877379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a3bc098b-351c-4b72-8d21-138b4cf36d0f None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:06.878707 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a3bc098b-351c-4b72-8d21-138b4cf36d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:06.961356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 60/115] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:06.985705 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc098b-351c-4b72-8d21-138b4cf36d0f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:07.012981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:07.070435 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed8134-b9bb-4cb3-928d-e9382030942b None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:07.102208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc098b-351c-4b72-8d21-138b4cf36d0f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:07.132259 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:07.141761 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba21e0-c7c6-4c47-84ee-0cebf8dfe76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:07.142574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba21e0-c7c6-4c47-84ee-0cebf8dfe76e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:07.142972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba21e0-c7c6-4c47-84ee-0cebf8dfe76e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:07.143359 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba21e0-c7c6-4c47-84ee-0cebf8dfe76e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:07.155874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba21e0-c7c6-4c47-84ee-0cebf8dfe76e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:07.161291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-00ba21e0-c7c6-4c47-84ee-0cebf8dfe76e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:57:07.161291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:07.161291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:07.161291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:07.161291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:07.161291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:07.161291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:07.161291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:07.161291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:07.161291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:07.161291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:07.161291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:07.161291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:07.161291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:07.161291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:07.161291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:07.162806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:07.162806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:07.162806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:07.162806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:07.162806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:07.162806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:07.162806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:07.162806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:07.162806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:07.162806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:07.162806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:07.162806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:07.162806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:07.162806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:07.162806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:07.162806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:07.163636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:07.163636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:07.163636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:07.163636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:07.163636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:07.163636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:07.163636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:07.163636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:07.163636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:07.163636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:07.163636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:57:07.163636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:07.167600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 61/116] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:57:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:07.169059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba21e0-c7c6-4c47-84ee-0cebf8dfe76e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:07.177744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5c268-0d6f-4553-96a6-ae5cdc1fe209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:07.178621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5c268-0d6f-4553-96a6-ae5cdc1fe209 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:07.178761 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5c268-0d6f-4553-96a6-ae5cdc1fe209 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:07.179037 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5c268-0d6f-4553-96a6-ae5cdc1fe209 None admin] PATH_INFO: `/v3/users/931bf62912bf4be1b0054eaf8b68847c` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:07.183950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5c268-0d6f-4553-96a6-ae5cdc1fe209 None admin] RBAC: Authorizing `identity:get_user(user_id=931bf62912bf4be1b0054eaf8b68847c)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:07.185452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff5c268-0d6f-4553-96a6-ae5cdc1fe209 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:07.187426 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 56/117] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:06 2022] GET /identity/v3/users/931bf62912bf4be1b0054eaf8b68847c => generated 275 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:07.194042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5c268-0d6f-4553-96a6-ae5cdc1fe209 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:07.296169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba21e0-c7c6-4c47-84ee-0cebf8dfe76e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:07.343594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5f1e8-01ae-43b9-9092-b89d1072c070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:07.344647 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5f1e8-01ae-43b9-9092-b89d1072c070 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:07.345134 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5f1e8-01ae-43b9-9092-b89d1072c070 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:07.345625 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5f1e8-01ae-43b9-9092-b89d1072c070 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:07.346560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5f1e8-01ae-43b9-9092-b89d1072c070 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:07.347076 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5f1e8-01ae-43b9-9092-b89d1072c070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:07.352756 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5f1e8-01ae-43b9-9092-b89d1072c070 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:07.362845 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 62/118] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:07.368867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5f1e8-01ae-43b9-9092-b89d1072c070 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:07.452484 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5c268-0d6f-4553-96a6-ae5cdc1fe209 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:07.472079 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:07.511030 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0241c-9a5a-4a30-9d2d-9b2509af2224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:07.511705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0241c-9a5a-4a30-9d2d-9b2509af2224 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:07.511970 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0241c-9a5a-4a30-9d2d-9b2509af2224 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:07.512251 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0241c-9a5a-4a30-9d2d-9b2509af2224 None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:07.517163 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0241c-9a5a-4a30-9d2d-9b2509af2224 None admin] RBAC: Authorizing `identity:get_project(project_id=20f771efd436479ebbfe994b525b28dc)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:07.518636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0241c-9a5a-4a30-9d2d-9b2509af2224 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:07.520684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 57/119] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:07 2022] GET /identity/v3/projects/20f771efd436479ebbfe994b525b28dc => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:07.526555 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97ac35-ee79-4c73-89eb-710801e2f564 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:07.526852 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97ac35-ee79-4c73-89eb-710801e2f564 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:07.527194 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97ac35-ee79-4c73-89eb-710801e2f564 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:07.528801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 58/120] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:57:07.536692 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fe5c5-1de0-4391-bc8f-32518ac764aa None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:07.536692 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fe5c5-1de0-4391-bc8f-32518ac764aa None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:07.536692 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fe5c5-1de0-4391-bc8f-32518ac764aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:07.556198 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-628fe5c5-1de0-4391-bc8f-32518ac764aa None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:07.557562 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-628fe5c5-1de0-4391-bc8f-32518ac764aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:07.584959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:07.618933 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5f1e8-01ae-43b9-9092-b89d1072c070 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:07.652781 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 59/121] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:07.653619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fe5c5-1de0-4391-bc8f-32518ac764aa None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:07.693182 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0065f8-6f08-4390-8333-14a8a12bd8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:07.693846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0065f8-6f08-4390-8333-14a8a12bd8a4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:07.694134 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0065f8-6f08-4390-8333-14a8a12bd8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:07.694416 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0065f8-6f08-4390-8333-14a8a12bd8a4 None admin] PATH_INFO: `/v3/users/06f2ad1758af4022bd84ef137b10c0c7` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:07.695629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0065f8-6f08-4390-8333-14a8a12bd8a4 None admin] RBAC: Authorizing `identity:get_user(user_id=06f2ad1758af4022bd84ef137b10c0c7)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:07.697132 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0065f8-6f08-4390-8333-14a8a12bd8a4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:07.703237 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 63/122] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:07 2022] GET /identity/v3/users/06f2ad1758af4022bd84ef137b10c0c7 => generated 247 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:07.704566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec51de8-d662-4cfc-a9c3-7a9f398c4afa None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:07.704862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec51de8-d662-4cfc-a9c3-7a9f398c4afa None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:07.705146 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec51de8-d662-4cfc-a9c3-7a9f398c4afa None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:07.706436 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 64/123] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:07.707718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec51de8-d662-4cfc-a9c3-7a9f398c4afa None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:07.758025 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fe5c5-1de0-4391-bc8f-32518ac764aa None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:07.796889 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2feaf-05c1-43db-a9f9-c4cd64268147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:07.797558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2feaf-05c1-43db-a9f9-c4cd64268147 None admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:07.797841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2feaf-05c1-43db-a9f9-c4cd64268147 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:07.798116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2feaf-05c1-43db-a9f9-c4cd64268147 None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc/users/931bf62912bf4be1b0054eaf8b68847c/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:07.800226 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2feaf-05c1-43db-a9f9-c4cd64268147 None admin] RBAC: Authorizing `identity:create_grant(project_id=20f771efd436479ebbfe994b525b28dc, user_id=931bf62912bf4be1b0054eaf8b68847c, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:07.802227 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f2feaf-05c1-43db-a9f9-c4cd64268147 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:07.820197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 60/124] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:57:07 2022] PUT /identity/v3/projects/20f771efd436479ebbfe994b525b28dc/users/931bf62912bf4be1b0054eaf8b68847c/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:57:07.821133 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2feaf-05c1-43db-a9f9-c4cd64268147 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:07.824935 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:07.844487 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec51de8-d662-4cfc-a9c3-7a9f398c4afa None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:07.875680 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:07.916219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8d1b4-be7b-4a09-9e33-890f002c1eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:07.917261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8d1b4-be7b-4a09-9e33-890f002c1eef None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:07.917696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8d1b4-be7b-4a09-9e33-890f002c1eef None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:07.918118 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8d1b4-be7b-4a09-9e33-890f002c1eef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:07.938803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2feaf-05c1-43db-a9f9-c4cd64268147 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:07.950067 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a8d1b4-be7b-4a09-9e33-890f002c1eef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:07.967984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-89a8d1b4-be7b-4a09-9e33-890f002c1eef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:07.967984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:07.967984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:07.967984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:07.967984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:07.967984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:07.967984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:07.967984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:07.967984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:07.967984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:07.967984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:07.967984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:07.967984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:07.967984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:07.967984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:07.967984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:07.968924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:07.968924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:07.968924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:07.968924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:07.968924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:07.968924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:07.968924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:07.968924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:07.968924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:07.968924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:07.968924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:07.968924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:07.968924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:07.968924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:07.968924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:07.968924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:07.969677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:07.969677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:07.969677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:07.969677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:07.969677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:07.969677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:07.969677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:07.969677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:07.969677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:07.969677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:07.969677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:07.969677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:07.969677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 65/125] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:07.973216 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588f908-2fae-4edc-8249-69fed280709b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:07.973717 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588f908-2fae-4edc-8249-69fed280709b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:07.974124 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588f908-2fae-4edc-8249-69fed280709b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:07.977041 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5f9e9-a6f0-49cf-a283-c95c12de86b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:07.977802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5f9e9-a6f0-49cf-a283-c95c12de86b2 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:07.978093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5f9e9-a6f0-49cf-a283-c95c12de86b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:07.978374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5f9e9-a6f0-49cf-a283-c95c12de86b2 None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:07.984864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5f9e9-a6f0-49cf-a283-c95c12de86b2 None admin] RBAC: Authorizing `identity:get_project(project_id=20f771efd436479ebbfe994b525b28dc)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:07.990837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5f9e9-a6f0-49cf-a283-c95c12de86b2 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:07.993783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 61/126] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:07 2022] GET /identity/v3/projects/20f771efd436479ebbfe994b525b28dc => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:07.994678 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5f9e9-a6f0-49cf-a283-c95c12de86b2 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:08.016846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5588f908-2fae-4edc-8249-69fed280709b None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:08.018075 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5588f908-2fae-4edc-8249-69fed280709b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:08.087253 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:08.112417 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5f9e9-a6f0-49cf-a283-c95c12de86b2 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:08.151534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471609f-c619-465d-a62e-ac6ac2b95198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:08.152180 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471609f-c619-465d-a62e-ac6ac2b95198 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:08.152486 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471609f-c619-465d-a62e-ac6ac2b95198 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:08.152777 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471609f-c619-465d-a62e-ac6ac2b95198 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:08.153630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471609f-c619-465d-a62e-ac6ac2b95198 None admin] RBAC: Adding query filter params (name=member) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:08.154204 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471609f-c619-465d-a62e-ac6ac2b95198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:08.155603 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471609f-c619-465d-a62e-ac6ac2b95198 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:08.162791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 66/127] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:08.163631 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588f908-2fae-4edc-8249-69fed280709b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:08.165879 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 62/128] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:08.180503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471609f-c619-465d-a62e-ac6ac2b95198 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:08.331212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471609f-c619-465d-a62e-ac6ac2b95198 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:08.350111 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588f908-2fae-4edc-8249-69fed280709b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:08.364910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:08.401460 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259f3d9-33c2-4003-8c27-89b90c7a2f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:08.402119 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259f3d9-33c2-4003-8c27-89b90c7a2f9b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:08.402406 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259f3d9-33c2-4003-8c27-89b90c7a2f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:08.402678 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259f3d9-33c2-4003-8c27-89b90c7a2f9b None admin] PATH_INFO: `/v3/users/931bf62912bf4be1b0054eaf8b68847c` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:08.405405 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259f3d9-33c2-4003-8c27-89b90c7a2f9b None admin] RBAC: Authorizing `identity:get_user(user_id=931bf62912bf4be1b0054eaf8b68847c)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:08.406888 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259f3d9-33c2-4003-8c27-89b90c7a2f9b None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:08.410077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 63/129] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:08 2022] GET /identity/v3/users/931bf62912bf4be1b0054eaf8b68847c => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:08.411582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259f3d9-33c2-4003-8c27-89b90c7a2f9b None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:08.425013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8493f3-0feb-4810-bd55-b6ab85670632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:08.425750 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8493f3-0feb-4810-bd55-b6ab85670632 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:08.426032 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8493f3-0feb-4810-bd55-b6ab85670632 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:08.427268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:08.427660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8493f3-0feb-4810-bd55-b6ab85670632 None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc/users/06f2ad1758af4022bd84ef137b10c0c7/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:08.431907 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8493f3-0feb-4810-bd55-b6ab85670632 None admin] RBAC: Authorizing `identity:create_grant(project_id=20f771efd436479ebbfe994b525b28dc, user_id=06f2ad1758af4022bd84ef137b10c0c7, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:08.433400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8493f3-0feb-4810-bd55-b6ab85670632 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:08.453679 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 67/130] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:57:08 2022] PUT /identity/v3/projects/20f771efd436479ebbfe994b525b28dc/users/06f2ad1758af4022bd84ef137b10c0c7/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:57:08.455525 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8493f3-0feb-4810-bd55-b6ab85670632 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:08.577252 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259f3d9-33c2-4003-8c27-89b90c7a2f9b None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:08.628719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987eec2-ac0a-4746-a558-1967806d1985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:08.630288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987eec2-ac0a-4746-a558-1967806d1985 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:08.630288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987eec2-ac0a-4746-a558-1967806d1985 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:08.630537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987eec2-ac0a-4746-a558-1967806d1985 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:08.649772 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987eec2-ac0a-4746-a558-1967806d1985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:08.655648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-8987eec2-ac0a-4746-a558-1967806d1985 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:08.655648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:08.655648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:08.655648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:08.655648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:08.655648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:08.655648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:08.655648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:08.655648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:08.655648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:08.655648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:08.655648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:08.655648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:08.655648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:08.655648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:08.655648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:08.656657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:08.656657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:08.656657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:08.656657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:08.656657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:08.656657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:08.656657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:08.656657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:08.656657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:08.656657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:08.656657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:08.656657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:08.656657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:08.656657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:08.656657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:08.656657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:08.657445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:08.657445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:08.657445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:08.657445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:08.657445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:08.657445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:08.657445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:08.657445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:08.657445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:08.657445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:08.657445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:08.657445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:08.657445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 64/131] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:57:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:08.663184 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987eec2-ac0a-4746-a558-1967806d1985 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:08.704294 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8493f3-0feb-4810-bd55-b6ab85670632 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:08.770253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785356b-0d9d-41fd-a7e1-38e551e52076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:08.771386 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785356b-0d9d-41fd-a7e1-38e551e52076 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:08.771914 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785356b-0d9d-41fd-a7e1-38e551e52076 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:08.772059 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:08.772434 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785356b-0d9d-41fd-a7e1-38e551e52076 None admin] PATH_INFO: `/v3/projects/e5cff9501c6147edaf6a4409802856b7` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:08.777287 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785356b-0d9d-41fd-a7e1-38e551e52076 None admin] RBAC: Authorizing `identity:get_project(project_id=e5cff9501c6147edaf6a4409802856b7)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:08.779046 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785356b-0d9d-41fd-a7e1-38e551e52076 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:08.781012 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 68/132] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:08 2022] GET /identity/v3/projects/e5cff9501c6147edaf6a4409802856b7 => generated 312 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:08.787413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785356b-0d9d-41fd-a7e1-38e551e52076 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:08.819002 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987eec2-ac0a-4746-a558-1967806d1985 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:08.855814 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f7b0e-0952-421d-88b9-1200129456c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:08.856907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f7b0e-0952-421d-88b9-1200129456c9 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:08.857363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f7b0e-0952-421d-88b9-1200129456c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:08.857780 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f7b0e-0952-421d-88b9-1200129456c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:08.858724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f7b0e-0952-421d-88b9-1200129456c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:08.859230 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f7b0e-0952-421d-88b9-1200129456c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:08.860919 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f7b0e-0952-421d-88b9-1200129456c9 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:08.871228 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 65/133] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:57:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:08.877573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f7b0e-0952-421d-88b9-1200129456c9 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:08.896543 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:08.992501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f7b0e-0952-421d-88b9-1200129456c9 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:09.017566 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:09.030665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7edd35f-7f1d-4c6a-a67a-78c7849144a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:09.031456 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edd35f-7f1d-4c6a-a67a-78c7849144a9 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:09.031850 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edd35f-7f1d-4c6a-a67a-78c7849144a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:09.032336 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7edd35f-7f1d-4c6a-a67a-78c7849144a9 None admin] PATH_INFO: `/v3/users/931bf62912bf4be1b0054eaf8b68847c` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:09.033787 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edd35f-7f1d-4c6a-a67a-78c7849144a9 None admin] RBAC: Authorizing `identity:get_user(user_id=931bf62912bf4be1b0054eaf8b68847c)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:09.035550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7edd35f-7f1d-4c6a-a67a-78c7849144a9 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:09.037239 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 66/134] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:08 2022] GET /identity/v3/users/931bf62912bf4be1b0054eaf8b68847c => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:09.038212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785356b-0d9d-41fd-a7e1-38e551e52076 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:09.038579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a85aa-d194-4ec2-89b0-5aba6e1c2537 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:09.038977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a85aa-d194-4ec2-89b0-5aba6e1c2537 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:09.039363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a85aa-d194-4ec2-89b0-5aba6e1c2537 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:09.044485 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 67/135] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:09.044485 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a85aa-d194-4ec2-89b0-5aba6e1c2537 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:09.109809 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88c2f1-a2d0-4677-944d-71ed261a60a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:09.110757 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88c2f1-a2d0-4677-944d-71ed261a60a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:09.111192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88c2f1-a2d0-4677-944d-71ed261a60a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:09.111651 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88c2f1-a2d0-4677-944d-71ed261a60a1 None admin] PATH_INFO: `/v3/projects/e5cff9501c6147edaf6a4409802856b7/users/931bf62912bf4be1b0054eaf8b68847c/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:09.118084 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88c2f1-a2d0-4677-944d-71ed261a60a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e5cff9501c6147edaf6a4409802856b7, user_id=931bf62912bf4be1b0054eaf8b68847c, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:09.119759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88c2f1-a2d0-4677-944d-71ed261a60a1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:09.150682 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 69/136] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:57:08 2022] PUT /identity/v3/projects/e5cff9501c6147edaf6a4409802856b7/users/931bf62912bf4be1b0054eaf8b68847c/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:57:09.152284 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb72bb-1c5e-42b5-b890-9eda4863d9b9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:09.152752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb72bb-1c5e-42b5-b890-9eda4863d9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:09.153183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fb72bb-1c5e-42b5-b890-9eda4863d9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:09.164488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a85aa-d194-4ec2-89b0-5aba6e1c2537 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:09.196581 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb69f4d-8202-4057-95d7-caf87c8942f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:09.197413 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb69f4d-8202-4057-95d7-caf87c8942f3 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:09.197809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb69f4d-8202-4057-95d7-caf87c8942f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:09.198195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb69f4d-8202-4057-95d7-caf87c8942f3 None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:09.198797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-08fb72bb-1c5e-42b5-b890-9eda4863d9b9 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:09.199793 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb69f4d-8202-4057-95d7-caf87c8942f3 None admin] RBAC: Authorizing `identity:get_project(project_id=20f771efd436479ebbfe994b525b28dc)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:09.200376 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-08fb72bb-1c5e-42b5-b890-9eda4863d9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:09.201590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb69f4d-8202-4057-95d7-caf87c8942f3 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:09.208281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 68/137] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:09 2022] GET /identity/v3/projects/20f771efd436479ebbfe994b525b28dc => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:09.210344 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb69f4d-8202-4057-95d7-caf87c8942f3 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:09.352844 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:09.369371 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 70/138] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:09.413149 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb72bb-1c5e-42b5-b890-9eda4863d9b9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:09.439342 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb69f4d-8202-4057-95d7-caf87c8942f3 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:09.460843 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:09.517188 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ecc47-d21d-4c4d-975a-3f18a09b69bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:09.518315 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ecc47-d21d-4c4d-975a-3f18a09b69bc None admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:09.518796 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ecc47-d21d-4c4d-975a-3f18a09b69bc None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:09.519250 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ecc47-d21d-4c4d-975a-3f18a09b69bc None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc/users/931bf62912bf4be1b0054eaf8b68847c/roles/cbb81f88446a46f38469b450c5f24624` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:09.522601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ecc47-d21d-4c4d-975a-3f18a09b69bc None admin] RBAC: Authorizing `identity:create_grant(project_id=20f771efd436479ebbfe994b525b28dc, user_id=931bf62912bf4be1b0054eaf8b68847c, role_id=cbb81f88446a46f38469b450c5f24624)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:09.524288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ecc47-d21d-4c4d-975a-3f18a09b69bc None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:09.565352 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fb72bb-1c5e-42b5-b890-9eda4863d9b9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:09.567937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 69/139] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:57:09 2022] PUT /identity/v3/projects/20f771efd436479ebbfe994b525b28dc/users/931bf62912bf4be1b0054eaf8b68847c/roles/cbb81f88446a46f38469b450c5f24624 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:57:09.623486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc534b7-8267-47de-8750-c2f130c8a0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:09.624254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc534b7-8267-47de-8750-c2f130c8a0ca None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:09.624623 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc534b7-8267-47de-8750-c2f130c8a0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:09.624908 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc534b7-8267-47de-8750-c2f130c8a0ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:09.626237 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc534b7-8267-47de-8750-c2f130c8a0ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:09.627868 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc534b7-8267-47de-8750-c2f130c8a0ca None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:09.630388 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 71/140] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:09.636175 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ecc47-d21d-4c4d-975a-3f18a09b69bc None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:09.755749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128fa9d-726c-4dc2-a4b2-455225efd6c3 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:09.756094 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128fa9d-726c-4dc2-a4b2-455225efd6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:09.756317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128fa9d-726c-4dc2-a4b2-455225efd6c3 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:09.757700 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 72/141] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:57:09.758165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ecc47-d21d-4c4d-975a-3f18a09b69bc None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:09.764176 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e422f6-d98d-4e76-8c32-288cc28e5273 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:09.764499 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e422f6-d98d-4e76-8c32-288cc28e5273 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:09.764791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e422f6-d98d-4e76-8c32-288cc28e5273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:09.790364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-30e422f6-d98d-4e76-8c32-288cc28e5273 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:09.791665 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-30e422f6-d98d-4e76-8c32-288cc28e5273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:09.799956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:09.836309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba824bf8-ab4c-40a9-8dc7-3e74e7265a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:09.837249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba824bf8-ab4c-40a9-8dc7-3e74e7265a23 None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:09.837682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba824bf8-ab4c-40a9-8dc7-3e74e7265a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:09.838102 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba824bf8-ab4c-40a9-8dc7-3e74e7265a23 None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:09.839235 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba824bf8-ab4c-40a9-8dc7-3e74e7265a23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:09.841798 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba824bf8-ab4c-40a9-8dc7-3e74e7265a23 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:09.885453 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 70/142] 10.222.0.85 () {60 vars in 1132 bytes} [Tue Aug 2 09:57:09 2022] POST /identity/v3/users => generated 283 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:57:09.885940 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 73/143] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:09.947433 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba824bf8-ab4c-40a9-8dc7-3e74e7265a23 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:10.074329 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba824bf8-ab4c-40a9-8dc7-3e74e7265a23 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:10.112056 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c1689-9542-49c0-9531-5fbd33b48f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:10.112788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c1689-9542-49c0-9531-5fbd33b48f75 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:10.113155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c1689-9542-49c0-9531-5fbd33b48f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:10.113434 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c1689-9542-49c0-9531-5fbd33b48f75 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:10.130960 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183c1689-9542-49c0-9531-5fbd33b48f75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:10.140421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-183c1689-9542-49c0-9531-5fbd33b48f75 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:57:10.140421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:10.140421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:10.140421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:10.140421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:10.140421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:10.140421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:10.140421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:10.140421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:10.140421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:10.140421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:10.140421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:10.140421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:10.140421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:10.140421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:10.140421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:10.141544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:10.141544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:10.141544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:10.141544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:10.141544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:10.141544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:10.141544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:10.141544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:10.141544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:10.141544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:10.141544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:10.141544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:10.141544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:10.141544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:10.141544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:10.141544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:10.142498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:10.142498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:10.142498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:10.142498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:10.142498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:10.142498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:10.142498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:10.142498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:10.142498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:10.142498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:10.142498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:57:10.142498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:10.143215 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 71/144] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:10.150146 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e422f6-d98d-4e76-8c32-288cc28e5273 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:10.196583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:10.280780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e422f6-d98d-4e76-8c32-288cc28e5273 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:10.323234 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfa3c8-036c-4292-b9be-708930d3f349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:10.324109 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfa3c8-036c-4292-b9be-708930d3f349 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:10.324621 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfa3c8-036c-4292-b9be-708930d3f349 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:10.325051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cfa3c8-036c-4292-b9be-708930d3f349 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:10.326011 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfa3c8-036c-4292-b9be-708930d3f349 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:10.326475 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfa3c8-036c-4292-b9be-708930d3f349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:10.328082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cfa3c8-036c-4292-b9be-708930d3f349 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:10.340283 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 74/145] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:10.346151 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c1689-9542-49c0-9531-5fbd33b48f75 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:10.401560 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:10.489434 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c1689-9542-49c0-9531-5fbd33b48f75 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:10.537174 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5037f37-cd99-49d6-b2d2-367ae1482bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:10.537835 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5037f37-cd99-49d6-b2d2-367ae1482bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:10.538116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5037f37-cd99-49d6-b2d2-367ae1482bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:10.538391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5037f37-cd99-49d6-b2d2-367ae1482bf3 None admin] PATH_INFO: `/v3/users/d51fee4347f34eea80067f0d8e75f681` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:10.539621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5037f37-cd99-49d6-b2d2-367ae1482bf3 None admin] RBAC: Authorizing `identity:get_user(user_id=d51fee4347f34eea80067f0d8e75f681)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:10.541278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5037f37-cd99-49d6-b2d2-367ae1482bf3 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:10.542954 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 72/146] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:10 2022] GET /identity/v3/users/d51fee4347f34eea80067f0d8e75f681 => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:10.549249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfa3c8-036c-4292-b9be-708930d3f349 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:10.670175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:10.688511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cfa3c8-036c-4292-b9be-708930d3f349 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:10.731374 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16637f3-65b8-42b5-883d-2bfb0694d3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:10.732075 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16637f3-65b8-42b5-883d-2bfb0694d3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:10.732376 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16637f3-65b8-42b5-883d-2bfb0694d3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:10.732684 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16637f3-65b8-42b5-883d-2bfb0694d3c1 None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:10.737202 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16637f3-65b8-42b5-883d-2bfb0694d3c1 None admin] RBAC: Authorizing `identity:get_project(project_id=20f771efd436479ebbfe994b525b28dc)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:10.739332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16637f3-65b8-42b5-883d-2bfb0694d3c1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:10.741148 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 75/147] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:10 2022] GET /identity/v3/projects/20f771efd436479ebbfe994b525b28dc => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:10.747170 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5037f37-cd99-49d6-b2d2-367ae1482bf3 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:10.855446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f539574-7aee-4f4f-986f-aceea1cad38e None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:10.855788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f539574-7aee-4f4f-986f-aceea1cad38e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:10.856000 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f539574-7aee-4f4f-986f-aceea1cad38e None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:10.857508 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 76/148] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:57:10.867317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52991c-73e4-4060-a3d8-0b51fc3220ce None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:10.867700 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52991c-73e4-4060-a3d8-0b51fc3220ce None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:10.867949 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e52991c-73e4-4060-a3d8-0b51fc3220ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:10.893462 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5037f37-cd99-49d6-b2d2-367ae1482bf3 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:10.898210 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:10.899033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0e52991c-73e4-4060-a3d8-0b51fc3220ce None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:10.899963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0e52991c-73e4-4060-a3d8-0b51fc3220ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:10.961849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba0771-3948-4def-8ddc-8396e30d979e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:10.962593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba0771-3948-4def-8ddc-8396e30d979e None admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:10.962882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba0771-3948-4def-8ddc-8396e30d979e None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:10.963160 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba0771-3948-4def-8ddc-8396e30d979e None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc/users/d51fee4347f34eea80067f0d8e75f681/roles/3c4094b115cb4252aec1c29de8391a07` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:10.965959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba0771-3948-4def-8ddc-8396e30d979e None admin] RBAC: Authorizing `identity:create_grant(project_id=20f771efd436479ebbfe994b525b28dc, user_id=d51fee4347f34eea80067f0d8e75f681, role_id=3c4094b115cb4252aec1c29de8391a07)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:10.967434 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba0771-3948-4def-8ddc-8396e30d979e None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:10.998233 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 73/149] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:57:10 2022] PUT /identity/v3/projects/20f771efd436479ebbfe994b525b28dc/users/d51fee4347f34eea80067f0d8e75f681/roles/3c4094b115cb4252aec1c29de8391a07 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:57:11.038209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 77/150] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:11.073096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba0771-3948-4def-8ddc-8396e30d979e None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:11.216203 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba0771-3948-4def-8ddc-8396e30d979e None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:11.264540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37d84d-66df-4dbc-9d50-4038013cf1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:11.265194 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37d84d-66df-4dbc-9d50-4038013cf1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:11.265479 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37d84d-66df-4dbc-9d50-4038013cf1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:11.265759 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37d84d-66df-4dbc-9d50-4038013cf1a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:11.281717 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37d84d-66df-4dbc-9d50-4038013cf1a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:11.287831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-ca37d84d-66df-4dbc-9d50-4038013cf1a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:11.287831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:11.287831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:11.287831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:11.287831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:11.287831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:11.287831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:11.287831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:11.287831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:11.287831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:11.287831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:11.287831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:11.287831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:11.287831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:11.287831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:11.287831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:11.288673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:11.288673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:11.288673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:11.288673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:11.288673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:11.288673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:11.288673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:11.288673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:11.288673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:11.288673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:11.288673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:11.288673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:11.288673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:11.288673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:11.288673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:11.288673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:11.289450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:11.289450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:11.289450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:11.289450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:11.289450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:11.289450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:11.289450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:11.289450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:11.289450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:11.289450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:11.289450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:11.289450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:11.289450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 74/151] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:11.301661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52991c-73e4-4060-a3d8-0b51fc3220ce None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:11.430327 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5a5a3-95f2-41d0-a1d1-2674213d347e None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:11.430834 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5a5a3-95f2-41d0-a1d1-2674213d347e None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:11.430918 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5a5a3-95f2-41d0-a1d1-2674213d347e None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:11.433623 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 75/152] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:11.434710 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:11.438931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05fbde-a060-4e49-bda1-995ef27c2b0d None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:11.439231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05fbde-a060-4e49-bda1-995ef27c2b0d None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:11.439513 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05fbde-a060-4e49-bda1-995ef27c2b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:11.457960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e52991c-73e4-4060-a3d8-0b51fc3220ce None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:11.465767 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-dd05fbde-a060-4e49-bda1-995ef27c2b0d None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:11.467031 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-dd05fbde-a060-4e49-bda1-995ef27c2b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:11.496735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:11.511217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51b51d-be39-4516-a7ad-2f69734f3d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:11.512372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51b51d-be39-4516-a7ad-2f69734f3d2f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:11.512681 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51b51d-be39-4516-a7ad-2f69734f3d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:11.512958 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51b51d-be39-4516-a7ad-2f69734f3d2f None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:11.513696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51b51d-be39-4516-a7ad-2f69734f3d2f None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:11.514002 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51b51d-be39-4516-a7ad-2f69734f3d2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:11.515671 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51b51d-be39-4516-a7ad-2f69734f3d2f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:11.527243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 78/153] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:11.532681 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51b51d-be39-4516-a7ad-2f69734f3d2f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:11.611271 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 76/154] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:11.648944 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05fbde-a060-4e49-bda1-995ef27c2b0d None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:11.649279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51b51d-be39-4516-a7ad-2f69734f3d2f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:11.698699 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd52dfa-0b0d-4350-a6ae-aa4bd09b4e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:11.699498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd52dfa-0b0d-4350-a6ae-aa4bd09b4e95 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:11.699782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd52dfa-0b0d-4350-a6ae-aa4bd09b4e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:11.700058 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd52dfa-0b0d-4350-a6ae-aa4bd09b4e95 None admin] PATH_INFO: `/v3/users/931bf62912bf4be1b0054eaf8b68847c` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:11.702689 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd52dfa-0b0d-4350-a6ae-aa4bd09b4e95 None admin] RBAC: Authorizing `identity:get_user(user_id=931bf62912bf4be1b0054eaf8b68847c)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:11.704225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd52dfa-0b0d-4350-a6ae-aa4bd09b4e95 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:11.707416 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 79/155] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:11 2022] GET /identity/v3/users/931bf62912bf4be1b0054eaf8b68847c => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:11.713768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd52dfa-0b0d-4350-a6ae-aa4bd09b4e95 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:11.741622 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:11.886031 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05fbde-a060-4e49-bda1-995ef27c2b0d None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:11.903786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd52dfa-0b0d-4350-a6ae-aa4bd09b4e95 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:11.958385 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f10ef0-36bc-4b68-b9f0-35f0f4719d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:11.959025 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f10ef0-36bc-4b68-b9f0-35f0f4719d76 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:11.959311 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f10ef0-36bc-4b68-b9f0-35f0f4719d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:11.959588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f10ef0-36bc-4b68-b9f0-35f0f4719d76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:11.982032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472efc13-e8f5-4a9f-a243-5f82ccf04dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:11.982752 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472efc13-e8f5-4a9f-a243-5f82ccf04dce None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:11.983043 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472efc13-e8f5-4a9f-a243-5f82ccf04dce None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:11.984536 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472efc13-e8f5-4a9f-a243-5f82ccf04dce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:12.011623 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472efc13-e8f5-4a9f-a243-5f82ccf04dce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:12.017138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-472efc13-e8f5-4a9f-a243-5f82ccf04dce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:57:12.017138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:12.017138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:12.017138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:12.017138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:12.017138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:12.017138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:12.017138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:12.017138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:12.017138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:12.017138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:12.017138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:12.017138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:12.017138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:12.017138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:12.017138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:12.018748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:12.018748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:12.018748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:12.018748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:12.018748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:12.018748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:12.018748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:12.018748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:12.018748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:12.018748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:12.018748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:12.018748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:12.018748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:12.018748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:12.018748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:12.018748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:12.019601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:12.019601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:12.019601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:12.019601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:12.019601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:12.019601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:12.019601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:12.019601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:12.019601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:12.019601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:12.019601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:57:12.019601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:12.025005 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 77/156] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:57:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:12.031055 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472efc13-e8f5-4a9f-a243-5f82ccf04dce None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:12.061929 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:12.067085 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f10ef0-36bc-4b68-b9f0-35f0f4719d76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:12.074232 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f10ef0-36bc-4b68-b9f0-35f0f4719d76 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:12.108869 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:12.218289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 80/157] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 09:57:12.225061 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f10ef0-36bc-4b68-b9f0-35f0f4719d76 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:12.310145 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472efc13-e8f5-4a9f-a243-5f82ccf04dce None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:12.377017 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a4095-e465-4885-a1d5-af7027d7cd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:12.378994 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a4095-e465-4885-a1d5-af7027d7cd3b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:12.379285 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a4095-e465-4885-a1d5-af7027d7cd3b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:12.379560 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a4095-e465-4885-a1d5-af7027d7cd3b None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:12.380295 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a4095-e465-4885-a1d5-af7027d7cd3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:12.380641 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a4095-e465-4885-a1d5-af7027d7cd3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:12.382050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a4095-e465-4885-a1d5-af7027d7cd3b None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:12.399063 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 78/158] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:12.404816 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a4095-e465-4885-a1d5-af7027d7cd3b None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:12.436270 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f10ef0-36bc-4b68-b9f0-35f0f4719d76 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:12.462430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:12.522106 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acfd5a-7a63-4359-9579-b462f5fd768f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:12.522767 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acfd5a-7a63-4359-9579-b462f5fd768f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:12.523044 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acfd5a-7a63-4359-9579-b462f5fd768f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:12.523317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acfd5a-7a63-4359-9579-b462f5fd768f None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:12.524530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44acfd5a-7a63-4359-9579-b462f5fd768f None admin] RBAC: Authorizing `identity:get_project(project_id=20f771efd436479ebbfe994b525b28dc)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:12.526119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44acfd5a-7a63-4359-9579-b462f5fd768f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:12.528055 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 81/159] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:12 2022] GET /identity/v3/projects/20f771efd436479ebbfe994b525b28dc => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:12.534506 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acfd5a-7a63-4359-9579-b462f5fd768f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:12.570636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:12.609093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a4095-e465-4885-a1d5-af7027d7cd3b None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:12.668037 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf99ef0-eb14-4d71-9bde-ef3c4e35747f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:12.668723 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf99ef0-eb14-4d71-9bde-ef3c4e35747f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:12.669009 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf99ef0-eb14-4d71-9bde-ef3c4e35747f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:12.669284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf99ef0-eb14-4d71-9bde-ef3c4e35747f None admin] PATH_INFO: `/v3/users/06f2ad1758af4022bd84ef137b10c0c7` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:12.670474 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf99ef0-eb14-4d71-9bde-ef3c4e35747f None admin] RBAC: Authorizing `identity:get_user(user_id=06f2ad1758af4022bd84ef137b10c0c7)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:12.672114 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf99ef0-eb14-4d71-9bde-ef3c4e35747f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:12.673753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 79/160] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:12 2022] GET /identity/v3/users/06f2ad1758af4022bd84ef137b10c0c7 => generated 247 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:12.675437 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe66a20-ead4-4430-af9a-1b5172ecdd56 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:12.675722 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe66a20-ead4-4430-af9a-1b5172ecdd56 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:12.675995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe66a20-ead4-4430-af9a-1b5172ecdd56 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:12.677251 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 80/161] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:12.680980 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe66a20-ead4-4430-af9a-1b5172ecdd56 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:12.809041 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe66a20-ead4-4430-af9a-1b5172ecdd56 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:12.811304 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acfd5a-7a63-4359-9579-b462f5fd768f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:12.849430 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784de8bc-40fa-40e9-9e6b-7b36ee9328e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:12.849984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784de8bc-40fa-40e9-9e6b-7b36ee9328e2 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:12.850268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784de8bc-40fa-40e9-9e6b-7b36ee9328e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:12.850791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784de8bc-40fa-40e9-9e6b-7b36ee9328e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:12.886089 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:12.888182 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f25ee-6c94-4595-ab78-fce414f38b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:12.888841 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f25ee-6c94-4595-ab78-fce414f38b91 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:12.890716 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f25ee-6c94-4595-ab78-fce414f38b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:12.890996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f25ee-6c94-4595-ab78-fce414f38b91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:12.891810 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f25ee-6c94-4595-ab78-fce414f38b91 None admin] RBAC: Adding query filter params (role.id=a2d6e3ab7e054be982bc78ce3c0a9748, scope.project.id=20f771efd436479ebbfe994b525b28dc, user.id=931bf62912bf4be1b0054eaf8b68847c) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:12.893752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f25ee-6c94-4595-ab78-fce414f38b91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:12.895220 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f25ee-6c94-4595-ab78-fce414f38b91 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:12.911255 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 82/162] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:57:12 2022] GET /identity/v3/role_assignments?user.id=931bf62912bf4be1b0054eaf8b68847c&scope.project.id=20f771efd436479ebbfe994b525b28dc&role.id=a2d6e3ab7e054be982bc78ce3c0a9748 => generated 608 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:12.914600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319874a-2a36-4e65-8960-7938f8e5f8ee None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:12.914964 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319874a-2a36-4e65-8960-7938f8e5f8ee None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:12.915254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319874a-2a36-4e65-8960-7938f8e5f8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:12.952711 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784de8bc-40fa-40e9-9e6b-7b36ee9328e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:12.953513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4319874a-2a36-4e65-8960-7938f8e5f8ee None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:12.954240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784de8bc-40fa-40e9-9e6b-7b36ee9328e2 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:12.954745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4319874a-2a36-4e65-8960-7938f8e5f8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:13.066874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 81/163] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:13.073211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784de8bc-40fa-40e9-9e6b-7b36ee9328e2 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:13.087099 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:13.145082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 83/164] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:13.176862 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:13.200762 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319874a-2a36-4e65-8960-7938f8e5f8ee None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:13.250078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784de8bc-40fa-40e9-9e6b-7b36ee9328e2 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:13.305387 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37335c0-53f7-4473-92aa-04301f33c411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:13.305387 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37335c0-53f7-4473-92aa-04301f33c411 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:13.305387 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37335c0-53f7-4473-92aa-04301f33c411 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:13.305387 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37335c0-53f7-4473-92aa-04301f33c411 None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:13.305808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37335c0-53f7-4473-92aa-04301f33c411 None admin] RBAC: Authorizing `identity:get_project(project_id=20f771efd436479ebbfe994b525b28dc)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:13.305808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37335c0-53f7-4473-92aa-04301f33c411 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:13.307207 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 82/165] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:13 2022] GET /identity/v3/projects/20f771efd436479ebbfe994b525b28dc => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:13.314981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37335c0-53f7-4473-92aa-04301f33c411 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:13.432708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319874a-2a36-4e65-8960-7938f8e5f8ee None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:13.472619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a78378-8e12-403f-a007-88b750dd792b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:13.473585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a78378-8e12-403f-a007-88b750dd792b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:13.474013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a78378-8e12-403f-a007-88b750dd792b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:13.474463 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a78378-8e12-403f-a007-88b750dd792b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:13.487993 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a78378-8e12-403f-a007-88b750dd792b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:13.494357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a6a78378-8e12-403f-a007-88b750dd792b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:13.494357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:13.494357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:13.494357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:13.494357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:13.494357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:13.494357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:13.494357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:13.494357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:13.494357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:13.494357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:13.494357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:13.494357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:13.494357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:13.494357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:13.494357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:13.495215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:13.495215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:13.495215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:13.495215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:13.495215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:13.495215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:13.495215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:13.495215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:13.495215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:13.495215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:13.495215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:13.495215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:13.495215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:13.495215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:13.495215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:13.495215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:13.496275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:13.496275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:13.496275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:13.496275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:13.496275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:13.496275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:13.496275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:13.496275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:13.496275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:13.496275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:13.496275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:13.496275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:13.499233 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 84/166] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:57:13.501079 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054d00f-a91d-4364-a466-def3ae534338 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:13.501583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054d00f-a91d-4364-a466-def3ae534338 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:13.503102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054d00f-a91d-4364-a466-def3ae534338 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:13.504977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 85/167] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:13.505892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054d00f-a91d-4364-a466-def3ae534338 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:13.552825 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:13.593890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37335c0-53f7-4473-92aa-04301f33c411 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:13.642490 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:13.670816 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054d00f-a91d-4364-a466-def3ae534338 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:13.715813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b062a9-9ea4-416b-9611-f4e4149abdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:13.716687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b062a9-9ea4-416b-9611-f4e4149abdd6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:13.717107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b062a9-9ea4-416b-9611-f4e4149abdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:13.717534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b062a9-9ea4-416b-9611-f4e4149abdd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:13.718417 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b062a9-9ea4-416b-9611-f4e4149abdd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:13.718858 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b062a9-9ea4-416b-9611-f4e4149abdd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:13.721887 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b062a9-9ea4-416b-9611-f4e4149abdd6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:13.722181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc04db-9bf2-43dc-8550-0579e687d26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:13.722949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc04db-9bf2-43dc-8550-0579e687d26d None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:13.723355 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc04db-9bf2-43dc-8550-0579e687d26d None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:13.723741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc04db-9bf2-43dc-8550-0579e687d26d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:13.724724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc04db-9bf2-43dc-8550-0579e687d26d None admin] RBAC: Adding query filter params (role.id=c15ca78eb3c9472f94e15e2d28c7f403, scope.project.id=20f771efd436479ebbfe994b525b28dc, user.id=06f2ad1758af4022bd84ef137b10c0c7) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:13.725147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc04db-9bf2-43dc-8550-0579e687d26d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:13.729985 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc04db-9bf2-43dc-8550-0579e687d26d None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:13.732608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 86/168] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:13.734054 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dccf7a-91ae-4e59-8763-01f08799c69e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:13.734482 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dccf7a-91ae-4e59-8763-01f08799c69e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:13.734895 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dccf7a-91ae-4e59-8763-01f08799c69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:13.750551 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 83/169] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:57:13 2022] GET /identity/v3/role_assignments?user.id=06f2ad1758af4022bd84ef137b10c0c7&scope.project.id=20f771efd436479ebbfe994b525b28dc&role.id=c15ca78eb3c9472f94e15e2d28c7f403 => generated 608 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:13.753173 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc04db-9bf2-43dc-8550-0579e687d26d None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:13.766008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a2dccf7a-91ae-4e59-8763-01f08799c69e None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:13.769625 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a2dccf7a-91ae-4e59-8763-01f08799c69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:13.917923 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 87/170] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:13.989654 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dccf7a-91ae-4e59-8763-01f08799c69e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:14.041420 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:14.165502 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dccf7a-91ae-4e59-8763-01f08799c69e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:14.198546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc04db-9bf2-43dc-8550-0579e687d26d None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:14.234738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e6529-4bc4-486f-8b9e-7127be6c544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:14.235992 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e6529-4bc4-486f-8b9e-7127be6c544a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:14.236494 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e6529-4bc4-486f-8b9e-7127be6c544a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:14.236767 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e6529-4bc4-486f-8b9e-7127be6c544a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:14.252894 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e6529-4bc4-486f-8b9e-7127be6c544a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:14.258446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-3e6e6529-4bc4-486f-8b9e-7127be6c544a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:14.258446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:14.258446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:14.258446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:14.258446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:14.258446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:14.258446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:14.258446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:14.258446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:14.258446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:14.258446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:14.258446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:14.258446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:14.258446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:14.258446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:14.258446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:14.259339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:14.259339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:14.259339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:14.259339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:14.259339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:14.259339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:14.259339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:14.259339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:14.259339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:14.259339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:14.259339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:14.259339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:14.259339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:14.259339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:14.259339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:14.259339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:14.260119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:14.260119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:14.260119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:14.260119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:14.260119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:14.260119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:14.260119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:14.260119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:14.260119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:14.260119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:14.260119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:14.260119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:14.262505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 88/171] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:57:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:14.269363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e6529-4bc4-486f-8b9e-7127be6c544a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:14.306195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14526d6-f2a0-4f20-9dc4-9e0e558c9d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:14.307260 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14526d6-f2a0-4f20-9dc4-9e0e558c9d94 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:14.308058 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14526d6-f2a0-4f20-9dc4-9e0e558c9d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:14.308904 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14526d6-f2a0-4f20-9dc4-9e0e558c9d94 None admin] PATH_INFO: `/v3/users/931bf62912bf4be1b0054eaf8b68847c` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:14.313251 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14526d6-f2a0-4f20-9dc4-9e0e558c9d94 None admin] RBAC: Authorizing `identity:get_user(user_id=931bf62912bf4be1b0054eaf8b68847c)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:14.315446 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14526d6-f2a0-4f20-9dc4-9e0e558c9d94 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:14.317467 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 84/172] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:13 2022] GET /identity/v3/users/931bf62912bf4be1b0054eaf8b68847c => generated 275 bytes in 566 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:14.333944 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14526d6-f2a0-4f20-9dc4-9e0e558c9d94 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:14.401181 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:14.418086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e6529-4bc4-486f-8b9e-7127be6c544a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:14.483780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266dc1f-feb8-459c-bfcd-04e9164ca26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:14.484708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266dc1f-feb8-459c-bfcd-04e9164ca26c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:14.485156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266dc1f-feb8-459c-bfcd-04e9164ca26c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:14.486279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266dc1f-feb8-459c-bfcd-04e9164ca26c None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:14.487688 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266dc1f-feb8-459c-bfcd-04e9164ca26c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:14.488156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266dc1f-feb8-459c-bfcd-04e9164ca26c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:14.488800 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:14.491423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266dc1f-feb8-459c-bfcd-04e9164ca26c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:14.521228 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 89/173] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:57:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:14.522390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266dc1f-feb8-459c-bfcd-04e9164ca26c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:14.614928 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14526d6-f2a0-4f20-9dc4-9e0e558c9d94 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:14.697582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea07371-1fa1-4ba7-a71f-83ea99e4eda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:14.698456 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea07371-1fa1-4ba7-a71f-83ea99e4eda2 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:14.698910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea07371-1fa1-4ba7-a71f-83ea99e4eda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:14.699329 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea07371-1fa1-4ba7-a71f-83ea99e4eda2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:14.729258 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266dc1f-feb8-459c-bfcd-04e9164ca26c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:14.788034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71802812-9328-4fef-9ec0-8910acadc541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:14.788967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71802812-9328-4fef-9ec0-8910acadc541 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:14.789412 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71802812-9328-4fef-9ec0-8910acadc541 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:14.789833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71802812-9328-4fef-9ec0-8910acadc541 None admin] PATH_INFO: `/v3/users/931bf62912bf4be1b0054eaf8b68847c` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:14.791313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71802812-9328-4fef-9ec0-8910acadc541 None admin] RBAC: Authorizing `identity:get_user(user_id=931bf62912bf4be1b0054eaf8b68847c)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:14.792995 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71802812-9328-4fef-9ec0-8910acadc541 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:14.794785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 90/174] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:14 2022] GET /identity/v3/users/931bf62912bf4be1b0054eaf8b68847c => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:14.796121 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c2e2c-deec-428e-903c-0f934263f1e5 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:14.796613 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c2e2c-deec-428e-903c-0f934263f1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:14.797123 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c2e2c-deec-428e-903c-0f934263f1e5 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:14.799651 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 91/175] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:14.802342 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c2e2c-deec-428e-903c-0f934263f1e5 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:14.832592 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:14.879188 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea07371-1fa1-4ba7-a71f-83ea99e4eda2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:14.880965 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea07371-1fa1-4ba7-a71f-83ea99e4eda2 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:14.990301 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:15.037519 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c2e2c-deec-428e-903c-0f934263f1e5 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:15.107186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 85/176] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 774 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:15.111497 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f9515-6623-4e01-8e17-6538400435ac None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:15.113134 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2c8f9-28a0-4521-a651-e7d7d01ff65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:15.114264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2c8f9-28a0-4521-a651-e7d7d01ff65f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:15.114694 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2c8f9-28a0-4521-a651-e7d7d01ff65f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:15.115112 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2c8f9-28a0-4521-a651-e7d7d01ff65f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:15.116705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f9515-6623-4e01-8e17-6538400435ac None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:15.117479 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7f9515-6623-4e01-8e17-6538400435ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:15.148227 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-ac7f9515-6623-4e01-8e17-6538400435ac None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:15.153724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ac7f9515-6623-4e01-8e17-6538400435ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:15.224012 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2c8f9-28a0-4521-a651-e7d7d01ff65f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:15.225503 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b2c8f9-28a0-4521-a651-e7d7d01ff65f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:15.246934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:15.249712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 86/177] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:15.251172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f9515-6623-4e01-8e17-6538400435ac None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:15.354525 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 92/178] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:15.360399 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f682e-12ed-49dc-a967-b5faafdd893c None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:15.360958 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:15.361793 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f682e-12ed-49dc-a967-b5faafdd893c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:15.362257 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f682e-12ed-49dc-a967-b5faafdd893c None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:15.365031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 93/179] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:15.366269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f682e-12ed-49dc-a967-b5faafdd893c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:15.388823 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7f9515-6623-4e01-8e17-6538400435ac None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:15.427474 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466962f-cbf8-44d3-9e86-aa6a80873d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:15.428221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466962f-cbf8-44d3-9e86-aa6a80873d9f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:15.428732 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466962f-cbf8-44d3-9e86-aa6a80873d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:15.429153 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466962f-cbf8-44d3-9e86-aa6a80873d9f None admin] PATH_INFO: `/v3/projects/e5cff9501c6147edaf6a4409802856b7` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:15.430485 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466962f-cbf8-44d3-9e86-aa6a80873d9f None admin] RBAC: Authorizing `identity:get_project(project_id=e5cff9501c6147edaf6a4409802856b7)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:15.432193 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466962f-cbf8-44d3-9e86-aa6a80873d9f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:15.434282 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 87/180] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:15 2022] GET /identity/v3/projects/e5cff9501c6147edaf6a4409802856b7 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:15.435211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466962f-cbf8-44d3-9e86-aa6a80873d9f None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:15.482078 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f682e-12ed-49dc-a967-b5faafdd893c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:15.499086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:15.517784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d9b4e-11b4-4601-af6d-22f8836883f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:15.518434 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d9b4e-11b4-4601-af6d-22f8836883f4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:15.518716 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d9b4e-11b4-4601-af6d-22f8836883f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:15.518995 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d9b4e-11b4-4601-af6d-22f8836883f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:15.529360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d9b4e-11b4-4601-af6d-22f8836883f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:15.535196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-f79d9b4e-11b4-4601-af6d-22f8836883f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:57:15.535196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:15.535196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:15.535196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:15.535196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:15.535196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:15.535196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:15.535196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:15.535196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:15.535196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:15.535196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:15.535196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:15.535196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:15.535196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:15.535196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:15.535196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:15.536254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:15.536254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:15.536254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:15.536254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:15.536254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:15.536254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:15.536254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:15.536254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:15.536254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:15.536254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:15.536254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:15.536254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:15.536254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:15.536254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:15.536254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:15.536254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:15.537107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:15.537107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:15.537107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:15.537107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:15.537107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:15.537107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:15.537107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:15.537107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:15.537107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:15.537107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:15.537107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:57:15.537107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:15.537107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 94/181] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:57:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:15.537753 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d9666-4ffc-4812-84c4-d503e1d9e453 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:15.537818 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d9666-4ffc-4812-84c4-d503e1d9e453 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:15.538048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d9666-4ffc-4812-84c4-d503e1d9e453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:15.541491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466962f-cbf8-44d3-9e86-aa6a80873d9f None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:15.555539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7a4d9666-4ffc-4812-84c4-d503e1d9e453 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:15.556754 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7a4d9666-4ffc-4812-84c4-d503e1d9e453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:15.577085 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf4559-84b7-4623-8460-4369ae8c4a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:15.577739 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf4559-84b7-4623-8460-4369ae8c4a3a None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:15.578021 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf4559-84b7-4623-8460-4369ae8c4a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:15.578299 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf4559-84b7-4623-8460-4369ae8c4a3a None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:15.580402 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf4559-84b7-4623-8460-4369ae8c4a3a None admin] RBAC: Authorizing `identity:get_project(project_id=20f771efd436479ebbfe994b525b28dc)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:15.581895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf4559-84b7-4623-8460-4369ae8c4a3a None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:15.583560 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 88/182] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:15 2022] GET /identity/v3/projects/20f771efd436479ebbfe994b525b28dc => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:15.584718 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea4f76-70e0-4dfa-8c26-9c332f4e0a60 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:15.585006 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea4f76-70e0-4dfa-8c26-9c332f4e0a60 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:15.585282 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ea4f76-70e0-4dfa-8c26-9c332f4e0a60 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:15.586494 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 89/183] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:15.587334 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea4f76-70e0-4dfa-8c26-9c332f4e0a60 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:15.599957 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:15.630462 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 95/184] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:15.632806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf61fc-4d3a-4085-874a-7034483abbab None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:15.633100 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf61fc-4d3a-4085-874a-7034483abbab None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:15.633375 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf61fc-4d3a-4085-874a-7034483abbab None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:15.634640 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 96/185] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:15.635518 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf61fc-4d3a-4085-874a-7034483abbab None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:15.696193 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ea4f76-70e0-4dfa-8c26-9c332f4e0a60 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:15.730090 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e2012-e028-4071-a5fd-23176214e547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:15.730699 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e2012-e028-4071-a5fd-23176214e547 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:15.730978 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e2012-e028-4071-a5fd-23176214e547 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:15.731251 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e2012-e028-4071-a5fd-23176214e547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:15.732038 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e2012-e028-4071-a5fd-23176214e547 None admin] RBAC: Adding query filter params (role.id=a2d6e3ab7e054be982bc78ce3c0a9748, scope.project.id=e5cff9501c6147edaf6a4409802856b7, user.id=931bf62912bf4be1b0054eaf8b68847c) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:15.732345 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e2012-e028-4071-a5fd-23176214e547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:15.733810 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e2012-e028-4071-a5fd-23176214e547 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:15.748556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 90/186] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:57:15 2022] GET /identity/v3/role_assignments?user.id=931bf62912bf4be1b0054eaf8b68847c&scope.project.id=e5cff9501c6147edaf6a4409802856b7&role.id=a2d6e3ab7e054be982bc78ce3c0a9748 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:15.748556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e2012-e028-4071-a5fd-23176214e547 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:15.754653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf61fc-4d3a-4085-874a-7034483abbab None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:15.764095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:15.799070 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a24d71-bc59-4260-9fba-4f4cf41f24e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:15.799707 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a24d71-bc59-4260-9fba-4f4cf41f24e1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:15.799988 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a24d71-bc59-4260-9fba-4f4cf41f24e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:15.800256 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a24d71-bc59-4260-9fba-4f4cf41f24e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:15.801030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a24d71-bc59-4260-9fba-4f4cf41f24e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:15.801325 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a24d71-bc59-4260-9fba-4f4cf41f24e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:15.802722 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a24d71-bc59-4260-9fba-4f4cf41f24e1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:15.812222 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 97/187] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:15.819070 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee248971-6769-4d81-9727-f02817eaae20 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:15.819351 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee248971-6769-4d81-9727-f02817eaae20 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:15.819625 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee248971-6769-4d81-9727-f02817eaae20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:15.830599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:15.842324 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ee248971-6769-4d81-9727-f02817eaae20 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:15.843683 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ee248971-6769-4d81-9727-f02817eaae20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:15.860355 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e2012-e028-4071-a5fd-23176214e547 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:15.901566 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59572e72-38bb-433f-8773-6976a1ed5a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:15.902120 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59572e72-38bb-433f-8773-6976a1ed5a70 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:15.902405 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59572e72-38bb-433f-8773-6976a1ed5a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:15.902684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59572e72-38bb-433f-8773-6976a1ed5a70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:15.903487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59572e72-38bb-433f-8773-6976a1ed5a70 None admin] RBAC: Adding query filter params (role.id=cbb81f88446a46f38469b450c5f24624, scope.project.id=20f771efd436479ebbfe994b525b28dc, user.id=931bf62912bf4be1b0054eaf8b68847c) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:15.903802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59572e72-38bb-433f-8773-6976a1ed5a70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:15.905299 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59572e72-38bb-433f-8773-6976a1ed5a70 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:15.913474 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 91/188] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:57:15 2022] GET /identity/v3/role_assignments?user.id=931bf62912bf4be1b0054eaf8b68847c&scope.project.id=20f771efd436479ebbfe994b525b28dc&role.id=cbb81f88446a46f38469b450c5f24624 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:15.914713 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3551e-f4db-42d4-ad94-7cf4f26ae24c None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:15.915006 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3551e-f4db-42d4-ad94-7cf4f26ae24c None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:15.915295 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3551e-f4db-42d4-ad94-7cf4f26ae24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:15.924578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 98/189] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:15.925438 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee248971-6769-4d81-9727-f02817eaae20 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:15.936367 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-b6d3551e-f4db-42d4-ad94-7cf4f26ae24c None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:15.937574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b6d3551e-f4db-42d4-ad94-7cf4f26ae24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:16.026981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 92/190] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:16.027922 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3551e-f4db-42d4-ad94-7cf4f26ae24c None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:16.052841 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:16.055966 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee248971-6769-4d81-9727-f02817eaae20 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:16.097886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ba72a-3e09-4534-808d-58ee2f048bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:16.098885 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ba72a-3e09-4534-808d-58ee2f048bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:16.099167 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ba72a-3e09-4534-808d-58ee2f048bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:16.099441 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ba72a-3e09-4534-808d-58ee2f048bf0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:16.114149 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ba72a-3e09-4534-808d-58ee2f048bf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:16.119156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-192ba72a-3e09-4534-808d-58ee2f048bf0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:16.119156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:16.119156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:16.119156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:16.119156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:16.119156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:16.119156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:16.119156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:16.119156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:16.119156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:16.119156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:16.119156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:16.119156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:16.119156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:16.119156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:16.119156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:16.119996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:16.119996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:16.119996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:16.119996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:16.119996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:16.119996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:16.119996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:16.119996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:16.119996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:16.119996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:16.119996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:16.119996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:16.119996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:16.119996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:16.119996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:16.119996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:16.120867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:16.120867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:16.120867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:16.120867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:16.120867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:16.120867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:16.120867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:16.120867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:16.120867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:16.120867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:16.120867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:16.120867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:16.120867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 99/191] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:57:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:16.121501 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ba72a-3e09-4534-808d-58ee2f048bf0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:16.124262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:16.165183 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3551e-f4db-42d4-ad94-7cf4f26ae24c None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:16.200268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514b855-94f4-4467-b9fb-cdf31f2593eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:16.200970 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514b855-94f4-4467-b9fb-cdf31f2593eb None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:16.201257 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514b855-94f4-4467-b9fb-cdf31f2593eb None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:16.201535 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514b855-94f4-4467-b9fb-cdf31f2593eb None admin] PATH_INFO: `/v3/users/0729410e405547888666133c28f019d7` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:16.215641 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514b855-94f4-4467-b9fb-cdf31f2593eb None admin] RBAC: Authorizing `identity:get_user(user_id=0729410e405547888666133c28f019d7)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:16.217130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514b855-94f4-4467-b9fb-cdf31f2593eb None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:16.218767 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 93/192] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:16 2022] GET /identity/v3/users/0729410e405547888666133c28f019d7 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:16.223315 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514b855-94f4-4467-b9fb-cdf31f2593eb None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:16.236295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ba72a-3e09-4534-808d-58ee2f048bf0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:16.270714 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd70430-d188-471a-933d-1d7f2f2cd934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:16.271349 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd70430-d188-471a-933d-1d7f2f2cd934 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:16.271624 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd70430-d188-471a-933d-1d7f2f2cd934 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:16.271963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd70430-d188-471a-933d-1d7f2f2cd934 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:16.282583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd70430-d188-471a-933d-1d7f2f2cd934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:16.287597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-0bd70430-d188-471a-933d-1d7f2f2cd934 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:57:16.287597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:16.287597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:16.287597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:16.287597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:16.287597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:16.287597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:16.287597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:16.287597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:16.287597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:16.287597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:16.287597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:16.287597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:16.287597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:16.287597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:16.287597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:16.288573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:16.288573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:16.288573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:16.288573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:16.288573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:16.288573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:16.288573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:16.288573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:16.288573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:16.288573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:16.288573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:16.288573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:16.288573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:16.288573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:16.288573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:16.288573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:16.289364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:16.289364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:16.289364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:16.289364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:16.289364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:16.289364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:16.289364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:16.289364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:16.289364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:16.289364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:16.289364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:57:16.289364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:16.289364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 100/193] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:16.290016 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd70430-d188-471a-933d-1d7f2f2cd934 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:16.311210 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:16.325759 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514b855-94f4-4467-b9fb-cdf31f2593eb None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:16.352602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:16.364179 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f11f75-8fc7-4b3b-8aa6-c70a8417da7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:16.364898 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f11f75-8fc7-4b3b-8aa6-c70a8417da7e None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:16.365188 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f11f75-8fc7-4b3b-8aa6-c70a8417da7e None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:16.365460 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f11f75-8fc7-4b3b-8aa6-c70a8417da7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:16.366605 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f11f75-8fc7-4b3b-8aa6-c70a8417da7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:16.368048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f11f75-8fc7-4b3b-8aa6-c70a8417da7e None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:16.369667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 94/194] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:16.370429 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f11f75-8fc7-4b3b-8aa6-c70a8417da7e None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:16.397694 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd70430-d188-471a-933d-1d7f2f2cd934 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:16.433116 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b214f5-c7ac-40c8-b1b3-d5481bd565b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:16.433730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b214f5-c7ac-40c8-b1b3-d5481bd565b8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:16.434016 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b214f5-c7ac-40c8-b1b3-d5481bd565b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:16.434288 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b214f5-c7ac-40c8-b1b3-d5481bd565b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:16.435006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b214f5-c7ac-40c8-b1b3-d5481bd565b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:16.435311 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b214f5-c7ac-40c8-b1b3-d5481bd565b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:16.436712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b214f5-c7ac-40c8-b1b3-d5481bd565b8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:16.445075 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 101/195] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:57:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:16.445869 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b214f5-c7ac-40c8-b1b3-d5481bd565b8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:16.473503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f11f75-8fc7-4b3b-8aa6-c70a8417da7e None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:16.507182 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d5dd8-fdb9-4426-872c-b260d3c24617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:16.507786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d5dd8-fdb9-4426-872c-b260d3c24617 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:16.508062 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d5dd8-fdb9-4426-872c-b260d3c24617 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:16.508333 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d5dd8-fdb9-4426-872c-b260d3c24617 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:16.525789 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:16.545378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b214f5-c7ac-40c8-b1b3-d5481bd565b8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:16.567542 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:16.575566 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d5dd8-fdb9-4426-872c-b260d3c24617 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:16.577218 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d5dd8-fdb9-4426-872c-b260d3c24617 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:16.580389 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f63dd-8340-45f3-82b9-8d87b2209c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:16.581044 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f63dd-8340-45f3-82b9-8d87b2209c9c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:16.581325 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f63dd-8340-45f3-82b9-8d87b2209c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:16.581597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f63dd-8340-45f3-82b9-8d87b2209c9c None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:16.582310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f63dd-8340-45f3-82b9-8d87b2209c9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:16.582616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f63dd-8340-45f3-82b9-8d87b2209c9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:16.583974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f63dd-8340-45f3-82b9-8d87b2209c9c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:16.592087 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 102/196] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:16.592877 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f63dd-8340-45f3-82b9-8d87b2209c9c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:16.677006 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 95/197] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:16.680553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d5dd8-fdb9-4426-872c-b260d3c24617 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:16.693713 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f63dd-8340-45f3-82b9-8d87b2209c9c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:16.726591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7537412-4926-4b37-bfbe-038940cb346b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:16.727197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7537412-4926-4b37-bfbe-038940cb346b None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:16.727476 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7537412-4926-4b37-bfbe-038940cb346b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:16.727747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7537412-4926-4b37-bfbe-038940cb346b None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:16.728420 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7537412-4926-4b37-bfbe-038940cb346b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:16.729896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7537412-4926-4b37-bfbe-038940cb346b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:16.745192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:16.752783 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 103/198] 10.222.0.85 () {60 vars in 1132 bytes} [Tue Aug 2 09:57:16 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:57:16.753985 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7537412-4926-4b37-bfbe-038940cb346b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:16.782502 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:16.791073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d5dd8-fdb9-4426-872c-b260d3c24617 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:16.832943 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403f7a7-37a4-4e16-bfd7-480cd282f1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:16.833602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403f7a7-37a4-4e16-bfd7-480cd282f1af None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:16.834033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403f7a7-37a4-4e16-bfd7-480cd282f1af None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:16.834296 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403f7a7-37a4-4e16-bfd7-480cd282f1af None admin] PATH_INFO: `/v3/users/0729410e405547888666133c28f019d7` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:16.835578 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403f7a7-37a4-4e16-bfd7-480cd282f1af None admin] RBAC: Authorizing `identity:get_user(user_id=0729410e405547888666133c28f019d7)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:16.837110 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403f7a7-37a4-4e16-bfd7-480cd282f1af None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:16.839055 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 96/199] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:16 2022] GET /identity/v3/users/0729410e405547888666133c28f019d7 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:16.839832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403f7a7-37a4-4e16-bfd7-480cd282f1af None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:16.885568 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7537412-4926-4b37-bfbe-038940cb346b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:16.925671 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43f490-876a-4621-945c-8eb620863ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:16.927377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43f490-876a-4621-945c-8eb620863ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:16.927377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43f490-876a-4621-945c-8eb620863ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:16.927377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43f490-876a-4621-945c-8eb620863ed8 None admin] PATH_INFO: `/v3/users/d51fee4347f34eea80067f0d8e75f681` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:16.929657 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43f490-876a-4621-945c-8eb620863ed8 None admin] RBAC: Authorizing `identity:get_user(user_id=d51fee4347f34eea80067f0d8e75f681)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:16.930259 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43f490-876a-4621-945c-8eb620863ed8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:16.931994 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 104/200] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:16 2022] GET /identity/v3/users/d51fee4347f34eea80067f0d8e75f681 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:16.932842 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43f490-876a-4621-945c-8eb620863ed8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:16.968120 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403f7a7-37a4-4e16-bfd7-480cd282f1af None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:17.008498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1563c8-044d-407c-98db-ba2f6a449805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:17.009157 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1563c8-044d-407c-98db-ba2f6a449805 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:17.009439 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1563c8-044d-407c-98db-ba2f6a449805 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:17.009715 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1563c8-044d-407c-98db-ba2f6a449805 None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:17.010036 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:17.010906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1563c8-044d-407c-98db-ba2f6a449805 None admin] RBAC: Authorizing `identity:get_project(project_id=ef582d6737c842c69928f69bab3e3cf3)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:17.012865 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1563c8-044d-407c-98db-ba2f6a449805 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:17.016582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 97/201] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:16 2022] GET /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:17.016582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1563c8-044d-407c-98db-ba2f6a449805 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:17.054914 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:17.060494 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43f490-876a-4621-945c-8eb620863ed8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:17.113631 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf356a1-903e-4a74-a1be-bd7687f8f25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:17.114541 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf356a1-903e-4a74-a1be-bd7687f8f25b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:17.114828 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf356a1-903e-4a74-a1be-bd7687f8f25b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:17.115112 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf356a1-903e-4a74-a1be-bd7687f8f25b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:17.144038 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1563c8-044d-407c-98db-ba2f6a449805 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:17.183063 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7111bb-78f0-4568-8ae6-0acdf7891c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:17.184322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7111bb-78f0-4568-8ae6-0acdf7891c2a None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:17.184835 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7111bb-78f0-4568-8ae6-0acdf7891c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:17.185308 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7111bb-78f0-4568-8ae6-0acdf7891c2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:17.205254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf356a1-903e-4a74-a1be-bd7687f8f25b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:17.207455 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf356a1-903e-4a74-a1be-bd7687f8f25b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:17.274933 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7111bb-78f0-4568-8ae6-0acdf7891c2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:17.277028 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7111bb-78f0-4568-8ae6-0acdf7891c2a None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:17.289155 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:17.318493 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:17.344091 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 105/202] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:17.344091 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf356a1-903e-4a74-a1be-bd7687f8f25b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:17.428695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 98/203] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:17.428695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7111bb-78f0-4568-8ae6-0acdf7891c2a None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:17.458737 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf356a1-903e-4a74-a1be-bd7687f8f25b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:17.495346 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b178c19-7f4e-4895-b37a-dcf754a13f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:17.496230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b178c19-7f4e-4895-b37a-dcf754a13f32 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:17.496550 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b178c19-7f4e-4895-b37a-dcf754a13f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:17.496825 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b178c19-7f4e-4895-b37a-dcf754a13f32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:17.497619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b178c19-7f4e-4895-b37a-dcf754a13f32 None admin] RBAC: Adding query filter params (role.id=c15ca78eb3c9472f94e15e2d28c7f403, scope.project.id=ef582d6737c842c69928f69bab3e3cf3, user.id=0729410e405547888666133c28f019d7) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:17.497925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b178c19-7f4e-4895-b37a-dcf754a13f32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:17.500347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b178c19-7f4e-4895-b37a-dcf754a13f32 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:17.507015 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 106/204] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:57:17 2022] GET /identity/v3/role_assignments?user.id=0729410e405547888666133c28f019d7&scope.project.id=ef582d6737c842c69928f69bab3e3cf3&role.id=c15ca78eb3c9472f94e15e2d28c7f403 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:17.507824 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b178c19-7f4e-4895-b37a-dcf754a13f32 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:17.592594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:17.625357 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7111bb-78f0-4568-8ae6-0acdf7891c2a None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:17.672171 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:17.680489 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba24b4-b82b-45a0-84d3-3e5b1f689797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:17.682052 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba24b4-b82b-45a0-84d3-3e5b1f689797 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:17.682543 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba24b4-b82b-45a0-84d3-3e5b1f689797 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:17.683289 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba24b4-b82b-45a0-84d3-3e5b1f689797 None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:17.684977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba24b4-b82b-45a0-84d3-3e5b1f689797 None admin] RBAC: Authorizing `identity:get_project(project_id=ef582d6737c842c69928f69bab3e3cf3)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:17.687624 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba24b4-b82b-45a0-84d3-3e5b1f689797 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:17.689577 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 99/205] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:17 2022] GET /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:17.696553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba24b4-b82b-45a0-84d3-3e5b1f689797 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:17.734977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b178c19-7f4e-4895-b37a-dcf754a13f32 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:17.807972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba24b4-b82b-45a0-84d3-3e5b1f689797 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:17.820569 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad60e9a-8b8f-49af-9da9-0a39b9a7f056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:17.821222 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad60e9a-8b8f-49af-9da9-0a39b9a7f056 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:17.821501 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad60e9a-8b8f-49af-9da9-0a39b9a7f056 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:17.821774 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad60e9a-8b8f-49af-9da9-0a39b9a7f056 None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:17.822956 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad60e9a-8b8f-49af-9da9-0a39b9a7f056 None admin] RBAC: Authorizing `identity:get_project(project_id=20f771efd436479ebbfe994b525b28dc)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:17.824412 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad60e9a-8b8f-49af-9da9-0a39b9a7f056 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:17.839065 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 107/206] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:17 2022] GET /identity/v3/projects/20f771efd436479ebbfe994b525b28dc => generated 298 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:17.851370 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad60e9a-8b8f-49af-9da9-0a39b9a7f056 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:17.853733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fb45e-877c-4b77-a7a2-1c728d8c41f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:17.854606 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fb45e-877c-4b77-a7a2-1c728d8c41f8 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:17.855141 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fb45e-877c-4b77-a7a2-1c728d8c41f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:17.855632 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fb45e-877c-4b77-a7a2-1c728d8c41f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:17.856719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fb45e-877c-4b77-a7a2-1c728d8c41f8 None admin] RBAC: Adding query filter params (role.id=cbb81f88446a46f38469b450c5f24624, scope.project.id=ef582d6737c842c69928f69bab3e3cf3, user.id=0729410e405547888666133c28f019d7) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:17.857250 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fb45e-877c-4b77-a7a2-1c728d8c41f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:17.859420 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fb45e-877c-4b77-a7a2-1c728d8c41f8 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:17.866658 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 100/207] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:57:17 2022] GET /identity/v3/role_assignments?user.id=0729410e405547888666133c28f019d7&scope.project.id=ef582d6737c842c69928f69bab3e3cf3&role.id=cbb81f88446a46f38469b450c5f24624 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:17.982466 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:17.988372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad60e9a-8b8f-49af-9da9-0a39b9a7f056 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:18.037935 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31f1e6-5cf7-4d7c-839c-00ee43c509b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:18.038580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31f1e6-5cf7-4d7c-839c-00ee43c509b6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:18.038863 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31f1e6-5cf7-4d7c-839c-00ee43c509b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:18.039141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31f1e6-5cf7-4d7c-839c-00ee43c509b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:18.040029 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31f1e6-5cf7-4d7c-839c-00ee43c509b6 None admin] RBAC: Adding query filter params (role.id=3c4094b115cb4252aec1c29de8391a07, scope.project.id=20f771efd436479ebbfe994b525b28dc, user.id=d51fee4347f34eea80067f0d8e75f681) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:18.040347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31f1e6-5cf7-4d7c-839c-00ee43c509b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:18.041866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31f1e6-5cf7-4d7c-839c-00ee43c509b6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:18.056839 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 108/208] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:57:17 2022] GET /identity/v3/role_assignments?user.id=d51fee4347f34eea80067f0d8e75f681&scope.project.id=20f771efd436479ebbfe994b525b28dc&role.id=3c4094b115cb4252aec1c29de8391a07 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:19.017415 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b392f0-1f54-4d63-b09a-e223fffb6d0d None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:19.017929 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b392f0-1f54-4d63-b09a-e223fffb6d0d None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:19.018034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b392f0-1f54-4d63-b09a-e223fffb6d0d None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:19.019436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 101/209] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:57:19.025073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598e3ee-12d0-4f9d-b01e-3fa45bee1fa7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:19.025854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598e3ee-12d0-4f9d-b01e-3fa45bee1fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:19.026325 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598e3ee-12d0-4f9d-b01e-3fa45bee1fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:19.044932 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b598e3ee-12d0-4f9d-b01e-3fa45bee1fa7 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:19.047787 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b598e3ee-12d0-4f9d-b01e-3fa45bee1fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:19.070223 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000f85f-4f2e-4a93-9da0-e62029b31d5b None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:19.070808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000f85f-4f2e-4a93-9da0-e62029b31d5b None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:19.071348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000f85f-4f2e-4a93-9da0-e62029b31d5b None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:19.073606 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 102/210] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:19.089216 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509bd6c-0a48-45a2-adb5-913d4b78618a None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:19.089508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509bd6c-0a48-45a2-adb5-913d4b78618a None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:19.089787 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509bd6c-0a48-45a2-adb5-913d4b78618a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:19.112528 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-d509bd6c-0a48-45a2-adb5-913d4b78618a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:19.114195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-d509bd6c-0a48-45a2-adb5-913d4b78618a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:19.145112 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 109/211] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:19.168362 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598e3ee-12d0-4f9d-b01e-3fa45bee1fa7 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:19.197605 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:19.214760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 103/212] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:19.242507 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509bd6c-0a48-45a2-adb5-913d4b78618a None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:19.273053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:19.283710 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598e3ee-12d0-4f9d-b01e-3fa45bee1fa7 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:19.334663 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f1116-d78d-4090-b632-502d04a600cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:19.335408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f1116-d78d-4090-b632-502d04a600cb None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:19.335765 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f1116-d78d-4090-b632-502d04a600cb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:19.336120 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f1116-d78d-4090-b632-502d04a600cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:19.347933 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f1116-d78d-4090-b632-502d04a600cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:19.353381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-947f1116-d78d-4090-b632-502d04a600cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:19.353381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:19.353381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:19.353381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:19.353381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:19.353381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:19.353381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:19.353381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:19.353381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:19.353381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:19.353381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:19.353381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:19.353381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:19.353381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:19.353381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:19.353381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:19.354340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:19.354340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:19.354340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:19.354340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:19.354340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:19.354340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:19.354340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:19.354340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:19.354340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:19.354340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:19.354340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:19.354340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:19.354340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:19.354340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:19.354340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:19.354340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:19.355230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:19.355230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:19.355230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:19.355230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:19.355230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:19.355230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:19.355230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:19.355230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:19.355230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:19.355230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:19.355230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:19.355230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:19.356091 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d509bd6c-0a48-45a2-adb5-913d4b78618a None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:19.357151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 110/213] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:57:19.363367 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f1116-d78d-4090-b632-502d04a600cb None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:19.394413 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8b909-15af-47a8-8331-9360604c38f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:19.395292 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8b909-15af-47a8-8331-9360604c38f9 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:19.395750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8b909-15af-47a8-8331-9360604c38f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:19.396166 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8b909-15af-47a8-8331-9360604c38f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:19.397520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8b909-15af-47a8-8331-9360604c38f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:19.399414 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8b909-15af-47a8-8331-9360604c38f9 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:19.406887 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 104/214] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:19.407957 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8b909-15af-47a8-8331-9360604c38f9 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:19.473862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f1116-d78d-4090-b632-502d04a600cb None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:19.484844 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:19.512074 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358dd3df-34e7-492e-8ebc-3001acb5ce2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:19.512841 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dd3df-34e7-492e-8ebc-3001acb5ce2c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:19.513109 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dd3df-34e7-492e-8ebc-3001acb5ce2c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:19.513516 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dd3df-34e7-492e-8ebc-3001acb5ce2c None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:19.515173 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358dd3df-34e7-492e-8ebc-3001acb5ce2c None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:19.515356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358dd3df-34e7-492e-8ebc-3001acb5ce2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:19.516853 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358dd3df-34e7-492e-8ebc-3001acb5ce2c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:19.517111 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8b909-15af-47a8-8331-9360604c38f9 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:19.525982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 111/215] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:19.531577 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358dd3df-34e7-492e-8ebc-3001acb5ce2c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:19.548169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:19.554839 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d94aef-41a7-42d8-a3b4-922d80c333d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:19.555676 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d94aef-41a7-42d8-a3b4-922d80c333d4 None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:19.556156 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d94aef-41a7-42d8-a3b4-922d80c333d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:19.556640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d94aef-41a7-42d8-a3b4-922d80c333d4 None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:19.557543 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d94aef-41a7-42d8-a3b4-922d80c333d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:19.559212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d94aef-41a7-42d8-a3b4-922d80c333d4 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:19.588786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 105/216] 10.222.0.85 () {60 vars in 1132 bytes} [Tue Aug 2 09:57:19 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:57:19.651950 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358dd3df-34e7-492e-8ebc-3001acb5ce2c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:19.694126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ffc46-dbf1-49ff-b8c4-3ec4c078a2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:19.694790 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ffc46-dbf1-49ff-b8c4-3ec4c078a2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:19.695078 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ffc46-dbf1-49ff-b8c4-3ec4c078a2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:19.695356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ffc46-dbf1-49ff-b8c4-3ec4c078a2a0 None admin] PATH_INFO: `/v3/users/7b0d664f626c41a99bedc672e25c0643` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:19.711867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ffc46-dbf1-49ff-b8c4-3ec4c078a2a0 None admin] RBAC: Authorizing `identity:get_user(user_id=7b0d664f626c41a99bedc672e25c0643)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:19.713406 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ffc46-dbf1-49ff-b8c4-3ec4c078a2a0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:19.715372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 112/217] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:19 2022] GET /identity/v3/users/7b0d664f626c41a99bedc672e25c0643 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:19.721729 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d94aef-41a7-42d8-a3b4-922d80c333d4 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:19.809646 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80afd1-0d60-4e70-ad56-c9d1b36a897f None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:19.809884 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80afd1-0d60-4e70-ad56-c9d1b36a897f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:19.810134 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80afd1-0d60-4e70-ad56-c9d1b36a897f None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:19.812324 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 113/218] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:19.821307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660e923-2e1d-41e7-bbcd-a713f8339760 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:19.821598 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660e923-2e1d-41e7-bbcd-a713f8339760 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:19.821885 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660e923-2e1d-41e7-bbcd-a713f8339760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:19.839361 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d94aef-41a7-42d8-a3b4-922d80c333d4 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:19.845293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a660e923-2e1d-41e7-bbcd-a713f8339760 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:19.846991 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a660e923-2e1d-41e7-bbcd-a713f8339760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:19.863245 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:19.890861 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85fd8c-d09c-4843-b490-14007c587d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:19.891650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85fd8c-d09c-4843-b490-14007c587d52 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:19.892043 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85fd8c-d09c-4843-b490-14007c587d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:19.892395 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85fd8c-d09c-4843-b490-14007c587d52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:19.956922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 114/219] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:19.981104 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660e923-2e1d-41e7-bbcd-a713f8339760 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:19.984389 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:19.989487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85fd8c-d09c-4843-b490-14007c587d52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:19.990994 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85fd8c-d09c-4843-b490-14007c587d52 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:20.114550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 106/220] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:20.120311 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85fd8c-d09c-4843-b490-14007c587d52 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:20.124256 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660e923-2e1d-41e7-bbcd-a713f8339760 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:20.141090 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:20.167740 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60e05b-a5de-494c-bf3e-fb196b738558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:20.168656 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60e05b-a5de-494c-bf3e-fb196b738558 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:20.169078 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60e05b-a5de-494c-bf3e-fb196b738558 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:20.169489 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60e05b-a5de-494c-bf3e-fb196b738558 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:20.182335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60e05b-a5de-494c-bf3e-fb196b738558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:20.188347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-ac60e05b-a5de-494c-bf3e-fb196b738558 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:57:20.188347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:20.188347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:20.188347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:20.188347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:20.188347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:20.188347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:20.188347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:20.188347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:20.188347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:20.188347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:20.188347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:20.188347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:20.188347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:20.188347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:20.188347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:20.189372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:20.189372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:20.189372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:20.189372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:20.189372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:20.189372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:20.189372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:20.189372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:20.189372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:20.189372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:20.189372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:20.189372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:20.189372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:20.189372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:20.189372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:20.189372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:20.190328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:20.190328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:20.190328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:20.190328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:20.190328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:20.190328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:20.190328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:20.190328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:20.190328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:20.190328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:20.190328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:57:20.190328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:20.192572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 115/221] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:57:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:57:20.202232 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60e05b-a5de-494c-bf3e-fb196b738558 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:20.233601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85fd8c-d09c-4843-b490-14007c587d52 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:20.270984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d3e70-e2e9-489e-b6e1-7cf18b0c836b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:20.271648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d3e70-e2e9-489e-b6e1-7cf18b0c836b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:20.271928 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d3e70-e2e9-489e-b6e1-7cf18b0c836b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:20.272203 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d3e70-e2e9-489e-b6e1-7cf18b0c836b None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:20.273724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d3e70-e2e9-489e-b6e1-7cf18b0c836b None admin] RBAC: Authorizing `identity:get_project(project_id=ef582d6737c842c69928f69bab3e3cf3)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:20.274294 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:20.276402 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d3e70-e2e9-489e-b6e1-7cf18b0c836b None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:20.278154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 107/222] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:20 2022] GET /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:20.279551 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56b270-5627-49d9-837a-146691e7cec5 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:20.279843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56b270-5627-49d9-837a-146691e7cec5 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:20.280176 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56b270-5627-49d9-837a-146691e7cec5 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:20.281617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 108/223] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:20.286266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56b270-5627-49d9-837a-146691e7cec5 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:20.320526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60e05b-a5de-494c-bf3e-fb196b738558 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:20.359898 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf8077-1797-419c-872a-8ed71ec86455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:20.360851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf8077-1797-419c-872a-8ed71ec86455 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:20.361309 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf8077-1797-419c-872a-8ed71ec86455 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:20.361790 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf8077-1797-419c-872a-8ed71ec86455 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:20.362735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf8077-1797-419c-872a-8ed71ec86455 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:20.363187 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf8077-1797-419c-872a-8ed71ec86455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:20.364987 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf8077-1797-419c-872a-8ed71ec86455 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:20.375702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 116/224] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:20.377285 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2190265-9d59-40fb-98b6-faaacfd72d5e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:20.377717 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2190265-9d59-40fb-98b6-faaacfd72d5e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:20.378161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2190265-9d59-40fb-98b6-faaacfd72d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:20.398830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a2190265-9d59-40fb-98b6-faaacfd72d5e None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:20.400255 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a2190265-9d59-40fb-98b6-faaacfd72d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:20.405233 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:20.427378 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d56b270-5627-49d9-837a-146691e7cec5 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:20.474088 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76832f0e-3991-4955-b677-120136df67b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:20.474969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832f0e-3991-4955-b677-120136df67b6 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:20.475259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832f0e-3991-4955-b677-120136df67b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:20.475537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832f0e-3991-4955-b677-120136df67b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:20.476794 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76832f0e-3991-4955-b677-120136df67b6 None admin] RBAC: Adding query filter params (role.id=a2d6e3ab7e054be982bc78ce3c0a9748, scope.project.id=ef582d6737c842c69928f69bab3e3cf3, user.id=7b0d664f626c41a99bedc672e25c0643) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:20.477374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76832f0e-3991-4955-b677-120136df67b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:20.478980 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76832f0e-3991-4955-b677-120136df67b6 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:20.481308 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 117/225] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:20.483437 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2190265-9d59-40fb-98b6-faaacfd72d5e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:20.486500 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 109/226] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:57:20 2022] GET /identity/v3/role_assignments?user.id=7b0d664f626c41a99bedc672e25c0643&scope.project.id=ef582d6737c842c69928f69bab3e3cf3&role.id=a2d6e3ab7e054be982bc78ce3c0a9748 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:20.534112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76832f0e-3991-4955-b677-120136df67b6 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:20.557395 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:20.616675 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2190265-9d59-40fb-98b6-faaacfd72d5e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:20.682184 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76832f0e-3991-4955-b677-120136df67b6 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:20.696115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89d1df-2ad3-48a4-8198-2b9de4f5bc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:20.696826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89d1df-2ad3-48a4-8198-2b9de4f5bc94 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:20.697102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89d1df-2ad3-48a4-8198-2b9de4f5bc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:20.697664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89d1df-2ad3-48a4-8198-2b9de4f5bc94 None admin] PATH_INFO: `/v3/users/0729410e405547888666133c28f019d7` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:20.699139 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89d1df-2ad3-48a4-8198-2b9de4f5bc94 None admin] RBAC: Authorizing `identity:get_user(user_id=0729410e405547888666133c28f019d7)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:20.700827 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89d1df-2ad3-48a4-8198-2b9de4f5bc94 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:20.703423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 118/227] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:20 2022] GET /identity/v3/users/0729410e405547888666133c28f019d7 => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:20.709352 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89d1df-2ad3-48a4-8198-2b9de4f5bc94 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:20.727410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae66376-f543-4f6e-b154-e1746b018a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:20.728336 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae66376-f543-4f6e-b154-e1746b018a89 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:20.728775 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae66376-f543-4f6e-b154-e1746b018a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:20.729165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae66376-f543-4f6e-b154-e1746b018a89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:20.753026 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae66376-f543-4f6e-b154-e1746b018a89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:20.758946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-dae66376-f543-4f6e-b154-e1746b018a89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:20.758946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:20.758946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:20.758946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:20.758946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:20.758946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:20.758946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:20.758946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:20.758946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:20.758946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:20.758946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:20.758946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:20.758946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:20.758946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:20.758946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:20.758946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:20.759808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:20.759808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:20.759808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:20.759808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:20.759808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:20.759808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:20.759808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:20.759808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:20.759808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:20.759808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:20.759808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:20.759808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:20.759808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:20.759808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:20.759808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:20.759808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:20.760607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:20.760607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:20.760607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:20.760607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:20.760607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:20.760607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:20.760607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:20.760607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:20.760607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:20.760607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:20.760607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:20.760607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:20.760607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 110/228] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:57:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:57:20.767799 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae66376-f543-4f6e-b154-e1746b018a89 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:20.796547 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:20.872385 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89d1df-2ad3-48a4-8198-2b9de4f5bc94 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:20.919501 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:20.950306 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb11746-5897-49e7-b2e5-9c2439575ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:20.951544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae66376-f543-4f6e-b154-e1746b018a89 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:20.951680 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb11746-5897-49e7-b2e5-9c2439575ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:20.952526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb11746-5897-49e7-b2e5-9c2439575ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:20.952809 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb11746-5897-49e7-b2e5-9c2439575ed4 None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:20.957187 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb11746-5897-49e7-b2e5-9c2439575ed4 None admin] RBAC: Authorizing `identity:get_project(project_id=ef582d6737c842c69928f69bab3e3cf3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:20.958654 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb11746-5897-49e7-b2e5-9c2439575ed4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:20.960861 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 119/229] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:20 2022] GET /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:20.966413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb11746-5897-49e7-b2e5-9c2439575ed4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:20.993044 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29832ea-5905-4760-bef0-3293f6a62804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:20.994025 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29832ea-5905-4760-bef0-3293f6a62804 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:20.994538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29832ea-5905-4760-bef0-3293f6a62804 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:20.995041 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29832ea-5905-4760-bef0-3293f6a62804 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:20.995973 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29832ea-5905-4760-bef0-3293f6a62804 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:20.996510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29832ea-5905-4760-bef0-3293f6a62804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:21.004745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29832ea-5905-4760-bef0-3293f6a62804 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:21.025443 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 111/230] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:57:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:21.030329 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29832ea-5905-4760-bef0-3293f6a62804 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:21.126381 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:21.165124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29832ea-5905-4760-bef0-3293f6a62804 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:21.205946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4afee-9b55-47e9-b8a6-b5e18695b9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:21.206883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4afee-9b55-47e9-b8a6-b5e18695b9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:21.207337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4afee-9b55-47e9-b8a6-b5e18695b9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:21.207788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4afee-9b55-47e9-b8a6-b5e18695b9b5 None admin] PATH_INFO: `/v3/users/0729410e405547888666133c28f019d7` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:21.209145 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4afee-9b55-47e9-b8a6-b5e18695b9b5 None admin] RBAC: Authorizing `identity:get_user(user_id=0729410e405547888666133c28f019d7)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:21.212048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e4afee-9b55-47e9-b8a6-b5e18695b9b5 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:21.218124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 112/231] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:21 2022] GET /identity/v3/users/0729410e405547888666133c28f019d7 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:21.222204 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4afee-9b55-47e9-b8a6-b5e18695b9b5 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:21.234563 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb11746-5897-49e7-b2e5-9c2439575ed4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:21.281390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2b679-2c15-4ebd-8754-49ccca7be18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:21.282075 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2b679-2c15-4ebd-8754-49ccca7be18a None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:21.282426 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2b679-2c15-4ebd-8754-49ccca7be18a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:21.282637 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2b679-2c15-4ebd-8754-49ccca7be18a None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3/users/0729410e405547888666133c28f019d7/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:21.284685 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2b679-2c15-4ebd-8754-49ccca7be18a None admin] RBAC: Authorizing `identity:create_grant(project_id=ef582d6737c842c69928f69bab3e3cf3, user_id=0729410e405547888666133c28f019d7, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:21.286141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2b679-2c15-4ebd-8754-49ccca7be18a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:21.332490 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 120/232] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:57:20 2022] PUT /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3/users/0729410e405547888666133c28f019d7/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:57:21.371788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4afee-9b55-47e9-b8a6-b5e18695b9b5 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:21.434352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403b421-555f-4e32-b524-9d4d55d6e759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:21.436608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403b421-555f-4e32-b524-9d4d55d6e759 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:21.437100 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403b421-555f-4e32-b524-9d4d55d6e759 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:21.437588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403b421-555f-4e32-b524-9d4d55d6e759 None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:21.439149 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403b421-555f-4e32-b524-9d4d55d6e759 None admin] RBAC: Authorizing `identity:get_project(project_id=ef582d6737c842c69928f69bab3e3cf3)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:21.440936 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403b421-555f-4e32-b524-9d4d55d6e759 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:21.443283 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 113/233] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:21 2022] GET /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:21.448755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2b679-2c15-4ebd-8754-49ccca7be18a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:21.534232 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:21.590614 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2b679-2c15-4ebd-8754-49ccca7be18a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:21.628301 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad76418-702f-4aaa-ad6a-0515067058fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:21.629389 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad76418-702f-4aaa-ad6a-0515067058fe None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:21.629877 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad76418-702f-4aaa-ad6a-0515067058fe None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:21.630352 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad76418-702f-4aaa-ad6a-0515067058fe None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3/users/0729410e405547888666133c28f019d7/roles/cbb81f88446a46f38469b450c5f24624` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:21.632906 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad76418-702f-4aaa-ad6a-0515067058fe None admin] RBAC: Authorizing `identity:create_grant(project_id=ef582d6737c842c69928f69bab3e3cf3, user_id=0729410e405547888666133c28f019d7, role_id=cbb81f88446a46f38469b450c5f24624)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:21.634672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad76418-702f-4aaa-ad6a-0515067058fe None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:21.651034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 121/234] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:57:21 2022] PUT /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3/users/0729410e405547888666133c28f019d7/roles/cbb81f88446a46f38469b450c5f24624 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:57:22.152356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457e12c-9d3a-41a3-9e04-c80311759228 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:22.152917 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457e12c-9d3a-41a3-9e04-c80311759228 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:22.152917 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457e12c-9d3a-41a3-9e04-c80311759228 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:22.155130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 114/235] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:22.160403 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bd115-5167-466d-b057-6ae8a2904da6 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:22.160728 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bd115-5167-466d-b057-6ae8a2904da6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:22.161004 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bd115-5167-466d-b057-6ae8a2904da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:22.183166 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-337bd115-5167-466d-b057-6ae8a2904da6 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:22.184365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-337bd115-5167-466d-b057-6ae8a2904da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:22.280526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 122/236] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:22.308704 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457e12c-9d3a-41a3-9e04-c80311759228 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:22.323895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:22.452658 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0457e12c-9d3a-41a3-9e04-c80311759228 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:22.496789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4cef7-6a5f-4625-baf7-246ec6079e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:22.497120 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1860f-1aba-4817-9636-feb5a0078c84 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:22.497120 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1860f-1aba-4817-9636-feb5a0078c84 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:22.497872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1860f-1aba-4817-9636-feb5a0078c84 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:22.498028 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4cef7-6a5f-4625-baf7-246ec6079e72 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:22.498028 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4cef7-6a5f-4625-baf7-246ec6079e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:22.498507 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4cef7-6a5f-4625-baf7-246ec6079e72 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:22.498783 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 123/237] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:22.503639 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12f3f8-76ba-46c6-9531-780ad956a3d6 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:22.503922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12f3f8-76ba-46c6-9531-780ad956a3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:22.504199 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c12f3f8-76ba-46c6-9531-780ad956a3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:22.512515 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4cef7-6a5f-4625-baf7-246ec6079e72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:22.518558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-94a4cef7-6a5f-4625-baf7-246ec6079e72 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:57:22.518558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:22.518558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:22.518558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:22.518558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:22.518558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:22.518558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:22.518558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:22.518558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:22.518558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:22.518558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:22.518558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:22.518558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:22.518558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:22.518558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:22.518558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:22.521108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:22.521108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:22.521108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:22.521108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:22.521108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:22.521108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:22.521108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:22.521108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:22.521108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:22.521108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:22.521108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:22.521108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:22.521108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:22.521108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:22.521108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:22.521108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:22.522371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:22.522371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:22.522371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:22.522371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:22.522371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:22.522371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:22.522371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:22.522371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:22.522371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:22.522371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:22.522371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:57:22.522371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:22.522371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 115/238] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:22.525547 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8c12f3f8-76ba-46c6-9531-780ad956a3d6 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:22.526810 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8c12f3f8-76ba-46c6-9531-780ad956a3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:22.529986 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4cef7-6a5f-4625-baf7-246ec6079e72 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:22.585310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:22.649508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:22.652305 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 124/239] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:22.687038 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12f3f8-76ba-46c6-9531-780ad956a3d6 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:22.714779 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4cef7-6a5f-4625-baf7-246ec6079e72 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:22.770132 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51a447-ab30-49aa-a6af-4febb2e2b0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:22.771046 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51a447-ab30-49aa-a6af-4febb2e2b0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:22.771467 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51a447-ab30-49aa-a6af-4febb2e2b0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:22.772275 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51a447-ab30-49aa-a6af-4febb2e2b0a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:22.773636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51a447-ab30-49aa-a6af-4febb2e2b0a9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:22.774113 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51a447-ab30-49aa-a6af-4febb2e2b0a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:22.776519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51a447-ab30-49aa-a6af-4febb2e2b0a9 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:22.788539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 116/240] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:22.795042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51a447-ab30-49aa-a6af-4febb2e2b0a9 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:22.867151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c12f3f8-76ba-46c6-9531-780ad956a3d6 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:22.915813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ae717-b25e-4976-b003-fb68b3c577e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:22.917498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ae717-b25e-4976-b003-fb68b3c577e6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:22.917498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ae717-b25e-4976-b003-fb68b3c577e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:22.917498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ae717-b25e-4976-b003-fb68b3c577e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:22.920474 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ae717-b25e-4976-b003-fb68b3c577e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:22.922608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ae717-b25e-4976-b003-fb68b3c577e6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:22.924200 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51a447-ab30-49aa-a6af-4febb2e2b0a9 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:22.924572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 125/241] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:22.925889 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7c0bd-a46a-4ee2-8686-47bc0284e57b None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:22.926172 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7c0bd-a46a-4ee2-8686-47bc0284e57b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:22.926446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7c0bd-a46a-4ee2-8686-47bc0284e57b None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:22.929182 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 126/242] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:22.929455 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7c0bd-a46a-4ee2-8686-47bc0284e57b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:22.955122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:22.965237 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb5670-cb3d-4cc2-a487-0880d36692d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:22.966211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb5670-cb3d-4cc2-a487-0880d36692d3 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:22.966675 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb5670-cb3d-4cc2-a487-0880d36692d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:22.967147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb5670-cb3d-4cc2-a487-0880d36692d3 None admin] PATH_INFO: `/v3/users/7beed4f078e84ea7a9c12db0f5f8b1c9` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:22.981884 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb5670-cb3d-4cc2-a487-0880d36692d3 None admin] RBAC: Authorizing `identity:get_user(user_id=7beed4f078e84ea7a9c12db0f5f8b1c9)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:22.982320 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:22.983774 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb5670-cb3d-4cc2-a487-0880d36692d3 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:22.985962 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 117/243] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:22 2022] GET /identity/v3/users/7beed4f078e84ea7a9c12db0f5f8b1c9 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:22.987448 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfb020-a7c0-4e37-be81-88318756f95a None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:22.987970 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfb020-a7c0-4e37-be81-88318756f95a None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:22.988450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfb020-a7c0-4e37-be81-88318756f95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:23.007612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-f9dfb020-a7c0-4e37-be81-88318756f95a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:23.009145 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f9dfb020-a7c0-4e37-be81-88318756f95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:23.048933 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7c0bd-a46a-4ee2-8686-47bc0284e57b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:23.079908 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 118/244] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:23.081209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfb020-a7c0-4e37-be81-88318756f95a None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:23.114048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1be81-e230-4485-88a3-1eecfd606b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:23.114681 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1be81-e230-4485-88a3-1eecfd606b14 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:23.114966 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1be81-e230-4485-88a3-1eecfd606b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:23.115301 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a1be81-e230-4485-88a3-1eecfd606b14 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:23.116012 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1be81-e230-4485-88a3-1eecfd606b14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:23.117641 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a1be81-e230-4485-88a3-1eecfd606b14 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:23.156091 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 127/245] 10.222.0.85 () {60 vars in 1132 bytes} [Tue Aug 2 09:57:22 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:57:23.160530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1be81-e230-4485-88a3-1eecfd606b14 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:23.214208 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfb020-a7c0-4e37-be81-88318756f95a None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:23.238374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:23.302284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41d411-989c-4c0d-8eba-992dadc95dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:23.304403 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41d411-989c-4c0d-8eba-992dadc95dcd None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:23.305843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41d411-989c-4c0d-8eba-992dadc95dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:23.307473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41d411-989c-4c0d-8eba-992dadc95dcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:23.358598 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:23.369988 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a1be81-e230-4485-88a3-1eecfd606b14 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:23.425272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3a0b4-f9ac-4be9-b5bf-7ec2cdecfcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:23.426821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3a0b4-f9ac-4be9-b5bf-7ec2cdecfcb5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:23.427454 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3a0b4-f9ac-4be9-b5bf-7ec2cdecfcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:23.429965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3a0b4-f9ac-4be9-b5bf-7ec2cdecfcb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:23.431595 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41d411-989c-4c0d-8eba-992dadc95dcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:23.433482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41d411-989c-4c0d-8eba-992dadc95dcd None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:23.452697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3a0b4-f9ac-4be9-b5bf-7ec2cdecfcb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:23.463978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-7ca3a0b4-f9ac-4be9-b5bf-7ec2cdecfcb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:23.463978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:23.463978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:23.463978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:23.463978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:23.463978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:23.463978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:23.463978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:23.463978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:23.463978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:23.463978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:23.463978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:23.463978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:23.463978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:23.463978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:23.463978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:23.464921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:23.464921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:23.464921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:23.464921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:23.464921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:23.464921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:23.464921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:23.464921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:23.464921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:23.464921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:23.464921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:23.464921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:23.464921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:23.464921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:23.464921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:23.464921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:23.469533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:23.469533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:23.469533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:23.469533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:23.469533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:23.469533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:23.469533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:23.469533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:23.469533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:23.469533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:23.469533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:23.469533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:23.469533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 128/246] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:23.474166 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3a0b4-f9ac-4be9-b5bf-7ec2cdecfcb5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:23.584543 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 119/247] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:23.590555 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41d411-989c-4c0d-8eba-992dadc95dcd None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:23.610941 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:23.613362 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3a0b4-f9ac-4be9-b5bf-7ec2cdecfcb5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:23.661008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e0494-61e4-4027-bc0c-e6f4fe73e925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:23.662124 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e0494-61e4-4027-bc0c-e6f4fe73e925 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:23.662635 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e0494-61e4-4027-bc0c-e6f4fe73e925 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:23.663114 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e0494-61e4-4027-bc0c-e6f4fe73e925 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:23.664043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e0494-61e4-4027-bc0c-e6f4fe73e925 None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:23.664575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e0494-61e4-4027-bc0c-e6f4fe73e925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:23.666171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e0494-61e4-4027-bc0c-e6f4fe73e925 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:23.677926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 129/248] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:23.686197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e0494-61e4-4027-bc0c-e6f4fe73e925 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:23.710939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:23.724360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41d411-989c-4c0d-8eba-992dadc95dcd None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:23.782378 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8149f-5c6b-426b-82a1-5638cda4d2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:23.783156 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8149f-5c6b-426b-82a1-5638cda4d2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:23.783514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8149f-5c6b-426b-82a1-5638cda4d2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:23.783870 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8149f-5c6b-426b-82a1-5638cda4d2b1 None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:23.786392 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8149f-5c6b-426b-82a1-5638cda4d2b1 None admin] RBAC: Authorizing `identity:get_project(project_id=ef582d6737c842c69928f69bab3e3cf3)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:23.788641 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8149f-5c6b-426b-82a1-5638cda4d2b1 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:23.791332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 120/249] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:23 2022] GET /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:23.797161 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8149f-5c6b-426b-82a1-5638cda4d2b1 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:23.826469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e0494-61e4-4027-bc0c-e6f4fe73e925 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:23.869198 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd0b94-a400-401e-93d7-68aed7a512ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:23.870205 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd0b94-a400-401e-93d7-68aed7a512ca None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:23.870703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd0b94-a400-401e-93d7-68aed7a512ca None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:23.871142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd0b94-a400-401e-93d7-68aed7a512ca None admin] PATH_INFO: `/v3/users/7b0d664f626c41a99bedc672e25c0643` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:23.873365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd0b94-a400-401e-93d7-68aed7a512ca None admin] RBAC: Authorizing `identity:get_user(user_id=7b0d664f626c41a99bedc672e25c0643)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:23.875124 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd0b94-a400-401e-93d7-68aed7a512ca None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:23.877429 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 130/250] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:23 2022] GET /identity/v3/users/7b0d664f626c41a99bedc672e25c0643 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:23.886825 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd0b94-a400-401e-93d7-68aed7a512ca None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:23.924115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:23.944588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8149f-5c6b-426b-82a1-5638cda4d2b1 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:23.988402 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74892ea2-92fb-4e52-9e59-a75517b10b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:23.989741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74892ea2-92fb-4e52-9e59-a75517b10b49 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:23.989741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74892ea2-92fb-4e52-9e59-a75517b10b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:23.989935 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74892ea2-92fb-4e52-9e59-a75517b10b49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:23.990715 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74892ea2-92fb-4e52-9e59-a75517b10b49 None admin] RBAC: Adding query filter params (role.id=3c4094b115cb4252aec1c29de8391a07, scope.project.id=ef582d6737c842c69928f69bab3e3cf3, user.id=7beed4f078e84ea7a9c12db0f5f8b1c9) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:23.991108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74892ea2-92fb-4e52-9e59-a75517b10b49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:23.993568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74892ea2-92fb-4e52-9e59-a75517b10b49 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:24.001278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 121/251] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:57:23 2022] GET /identity/v3/role_assignments?user.id=7beed4f078e84ea7a9c12db0f5f8b1c9&scope.project.id=ef582d6737c842c69928f69bab3e3cf3&role.id=3c4094b115cb4252aec1c29de8391a07 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:24.002644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38f78e-3754-49b1-8bf5-ef93b61a1cd5 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:24.003007 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38f78e-3754-49b1-8bf5-ef93b61a1cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:24.003404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38f78e-3754-49b1-8bf5-ef93b61a1cd5 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:24.008948 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:24.010308 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 122/252] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:24.017025 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54dce2-2a22-4b3f-9287-be1e02a93c14 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:24.017389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54dce2-2a22-4b3f-9287-be1e02a93c14 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:24.017581 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd54dce2-2a22-4b3f-9287-be1e02a93c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:24.044958 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd0b94-a400-401e-93d7-68aed7a512ca None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:24.051604 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-dd54dce2-2a22-4b3f-9287-be1e02a93c14 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:24.053608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-dd54dce2-2a22-4b3f-9287-be1e02a93c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:24.110377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27b54e-4b90-4bb9-a123-5a6b838c84c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:24.111077 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27b54e-4b90-4bb9-a123-5a6b838c84c7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:24.111357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27b54e-4b90-4bb9-a123-5a6b838c84c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:24.111633 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f27b54e-4b90-4bb9-a123-5a6b838c84c7 None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:24.116171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27b54e-4b90-4bb9-a123-5a6b838c84c7 None admin] RBAC: Authorizing `identity:get_project(project_id=ef582d6737c842c69928f69bab3e3cf3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:24.116480 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f27b54e-4b90-4bb9-a123-5a6b838c84c7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:24.119459 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 131/253] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:23 2022] GET /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:24.125686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27b54e-4b90-4bb9-a123-5a6b838c84c7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:24.256791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 123/254] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:24.264114 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f27b54e-4b90-4bb9-a123-5a6b838c84c7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:24.304511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f951b-ebda-477a-a9b5-fbbc7a8a9741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:24.304511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f951b-ebda-477a-a9b5-fbbc7a8a9741 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:24.304511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f951b-ebda-477a-a9b5-fbbc7a8a9741 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:24.304511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f951b-ebda-477a-a9b5-fbbc7a8a9741 None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3/users/7b0d664f626c41a99bedc672e25c0643/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:24.305707 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f951b-ebda-477a-a9b5-fbbc7a8a9741 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef582d6737c842c69928f69bab3e3cf3, user_id=7b0d664f626c41a99bedc672e25c0643, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:24.306286 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54dce2-2a22-4b3f-9287-be1e02a93c14 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:24.307156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f951b-ebda-477a-a9b5-fbbc7a8a9741 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:24.335392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 132/255] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:57:24 2022] PUT /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3/users/7b0d664f626c41a99bedc672e25c0643/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:57:24.442266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:24.443287 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8fa5b-08c8-4e22-9093-bc1b2a534b45 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:24.444057 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8fa5b-08c8-4e22-9093-bc1b2a534b45 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:24.444953 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8fa5b-08c8-4e22-9093-bc1b2a534b45 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:24.446743 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 133/256] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:57:24.453647 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad64fad-25d2-46b3-9bb6-73bb71d27a05 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:24.454174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad64fad-25d2-46b3-9bb6-73bb71d27a05 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:24.454772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad64fad-25d2-46b3-9bb6-73bb71d27a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:24.489514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd54dce2-2a22-4b3f-9287-be1e02a93c14 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:24.492138 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5ad64fad-25d2-46b3-9bb6-73bb71d27a05 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:24.493409 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5ad64fad-25d2-46b3-9bb6-73bb71d27a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:24.508854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:24.573505 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f7f47-c82a-4dd6-9cb1-696d600d70ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:24.574702 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f7f47-c82a-4dd6-9cb1-696d600d70ef None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:24.575009 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f7f47-c82a-4dd6-9cb1-696d600d70ef None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:24.575291 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f7f47-c82a-4dd6-9cb1-696d600d70ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:24.602366 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f7f47-c82a-4dd6-9cb1-696d600d70ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:24.607868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-305f7f47-c82a-4dd6-9cb1-696d600d70ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:57:24.607868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:24.607868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:24.607868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:24.607868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:24.607868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:24.607868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:24.607868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:24.607868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:24.607868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:24.607868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:24.607868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:24.607868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:24.607868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:24.607868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:24.607868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:24.608791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:24.608791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:24.608791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:24.608791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:24.608791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:24.608791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:24.608791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:24.608791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:24.608791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:24.608791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:24.608791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:24.608791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:24.608791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:24.608791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:24.608791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:24.608791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:24.609582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:24.609582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:24.609582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:24.609582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:24.609582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:24.609582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:24.609582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:24.609582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:24.609582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:24.609582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:24.609582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:57:24.609582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:24.612074 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 124/257] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:57:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:24.618306 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f7f47-c82a-4dd6-9cb1-696d600d70ef None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:24.645732 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 134/258] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:24.688416 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad64fad-25d2-46b3-9bb6-73bb71d27a05 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:24.748918 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f7f47-c82a-4dd6-9cb1-696d600d70ef None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:24.805139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6f2b8-3d55-4232-99ef-b493b533750b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:24.806112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6f2b8-3d55-4232-99ef-b493b533750b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:24.806634 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6f2b8-3d55-4232-99ef-b493b533750b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:24.807104 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da6f2b8-3d55-4232-99ef-b493b533750b None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:24.808019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da6f2b8-3d55-4232-99ef-b493b533750b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:24.809122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da6f2b8-3d55-4232-99ef-b493b533750b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:24.811234 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da6f2b8-3d55-4232-99ef-b493b533750b None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:24.825052 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:24.831319 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 125/259] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:24.835984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6f2b8-3d55-4232-99ef-b493b533750b None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:24.894134 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad64fad-25d2-46b3-9bb6-73bb71d27a05 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:24.990773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da6f2b8-3d55-4232-99ef-b493b533750b None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:24.993176 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91a841-950c-42f7-bdd1-b5bc556ad8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:24.993845 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91a841-950c-42f7-bdd1-b5bc556ad8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:24.994131 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91a841-950c-42f7-bdd1-b5bc556ad8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:24.994411 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91a841-950c-42f7-bdd1-b5bc556ad8d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:25.036100 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91a841-950c-42f7-bdd1-b5bc556ad8d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:25.040104 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c840c6a-3a93-4190-a382-9f5e9a018c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:25.041045 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c840c6a-3a93-4190-a382-9f5e9a018c0c None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:25.041152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-9c91a841-950c-42f7-bdd1-b5bc556ad8d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:25.041152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:25.041152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:25.041152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:25.041152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:25.041152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:25.041152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:25.041152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:25.041152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:25.041152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:25.041152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:25.041152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:25.041152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:25.041152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:25.041152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:25.041152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:25.041975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:25.041975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:25.041975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:25.041975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:25.041975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:25.041975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:25.041975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:25.041975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:25.041975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:25.041975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:25.041975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:25.041975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:25.041975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:25.041975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:25.041975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:25.041975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:25.042768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:25.042768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:25.042768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:25.042768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:25.042768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:25.042768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:25.042768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:25.042768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:25.042768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:25.042768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:25.042768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:25.042768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:25.042768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 135/260] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:57:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:25.044950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c840c6a-3a93-4190-a382-9f5e9a018c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:25.045441 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c840c6a-3a93-4190-a382-9f5e9a018c0c None admin] PATH_INFO: `/v3/users/0729410e405547888666133c28f019d7` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:25.052503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c840c6a-3a93-4190-a382-9f5e9a018c0c None admin] RBAC: Authorizing `identity:get_user(user_id=0729410e405547888666133c28f019d7)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:25.052698 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91a841-950c-42f7-bdd1-b5bc556ad8d2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:25.054949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c840c6a-3a93-4190-a382-9f5e9a018c0c None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:25.057360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 126/261] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:24 2022] GET /identity/v3/users/0729410e405547888666133c28f019d7 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:25.063805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:25.065072 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c840c6a-3a93-4190-a382-9f5e9a018c0c None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:25.172866 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:25.213825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c840c6a-3a93-4190-a382-9f5e9a018c0c None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:25.282627 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce88a1-a333-4eca-a139-34c7de302d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:25.283277 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce88a1-a333-4eca-a139-34c7de302d82 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:25.283536 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce88a1-a333-4eca-a139-34c7de302d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:25.283820 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce88a1-a333-4eca-a139-34c7de302d82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:25.357644 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91a841-950c-42f7-bdd1-b5bc556ad8d2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:25.399125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce88a1-a333-4eca-a139-34c7de302d82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:25.400649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce88a1-a333-4eca-a139-34c7de302d82 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:25.462080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edad51-b97c-4146-b30f-9bd934e405b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:25.462735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edad51-b97c-4146-b30f-9bd934e405b8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:25.462994 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edad51-b97c-4146-b30f-9bd934e405b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:25.463269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edad51-b97c-4146-b30f-9bd934e405b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:25.463999 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edad51-b97c-4146-b30f-9bd934e405b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:25.464307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edad51-b97c-4146-b30f-9bd934e405b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:25.465969 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edad51-b97c-4146-b30f-9bd934e405b8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:25.476067 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 136/262] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:57:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:25.487155 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edad51-b97c-4146-b30f-9bd934e405b8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:25.552235 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:25.576716 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:25.634907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 127/263] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 09:57:25.637745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce88a1-a333-4eca-a139-34c7de302d82 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:25.640031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edad51-b97c-4146-b30f-9bd934e405b8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:25.710983 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc11b77-b9f8-4b42-918a-47ae0c728b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:25.717217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc11b77-b9f8-4b42-918a-47ae0c728b36 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:25.717788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc11b77-b9f8-4b42-918a-47ae0c728b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:25.718263 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc11b77-b9f8-4b42-918a-47ae0c728b36 None admin] PATH_INFO: `/v3/users/0729410e405547888666133c28f019d7` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:25.719816 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc11b77-b9f8-4b42-918a-47ae0c728b36 None admin] RBAC: Authorizing `identity:get_user(user_id=0729410e405547888666133c28f019d7)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:25.721676 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc11b77-b9f8-4b42-918a-47ae0c728b36 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:25.726053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 137/264] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:25 2022] GET /identity/v3/users/0729410e405547888666133c28f019d7 => generated 283 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:25.731861 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc11b77-b9f8-4b42-918a-47ae0c728b36 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:25.847306 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce88a1-a333-4eca-a139-34c7de302d82 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:25.871609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc11b77-b9f8-4b42-918a-47ae0c728b36 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:25.902787 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:25.909803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce846d60-5bdd-4473-9e9c-8a4c3a5f2f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:25.910691 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce846d60-5bdd-4473-9e9c-8a4c3a5f2f43 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:25.911170 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce846d60-5bdd-4473-9e9c-8a4c3a5f2f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:25.911638 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce846d60-5bdd-4473-9e9c-8a4c3a5f2f43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:25.957765 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf5640-db5b-4ad2-b341-fe22e8a0dfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:25.958727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf5640-db5b-4ad2-b341-fe22e8a0dfab None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:25.958727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf5640-db5b-4ad2-b341-fe22e8a0dfab None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:25.959022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf5640-db5b-4ad2-b341-fe22e8a0dfab None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:25.965220 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf5640-db5b-4ad2-b341-fe22e8a0dfab None admin] RBAC: Authorizing `identity:get_project(project_id=ef582d6737c842c69928f69bab3e3cf3)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:25.966709 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf5640-db5b-4ad2-b341-fe22e8a0dfab None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:25.968757 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 128/265] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:25 2022] GET /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3 => generated 302 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:25.974487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf5640-db5b-4ad2-b341-fe22e8a0dfab None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:25.989474 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce846d60-5bdd-4473-9e9c-8a4c3a5f2f43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:25.991338 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce846d60-5bdd-4473-9e9c-8a4c3a5f2f43 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:26.069508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:26.102468 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 138/266] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:26.109749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce846d60-5bdd-4473-9e9c-8a4c3a5f2f43 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:26.144246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:26.224121 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce846d60-5bdd-4473-9e9c-8a4c3a5f2f43 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:26.234730 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf5640-db5b-4ad2-b341-fe22e8a0dfab None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:26.264868 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e431e-82df-41c7-9f7e-cb80486a7de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:26.265902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e431e-82df-41c7-9f7e-cb80486a7de4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:26.266430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e431e-82df-41c7-9f7e-cb80486a7de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:26.266973 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e431e-82df-41c7-9f7e-cb80486a7de4 None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:26.268353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e431e-82df-41c7-9f7e-cb80486a7de4 None admin] RBAC: Authorizing `identity:get_project(project_id=ef582d6737c842c69928f69bab3e3cf3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:26.270191 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e431e-82df-41c7-9f7e-cb80486a7de4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:26.272742 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 139/267] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:26 2022] GET /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:26.284147 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e431e-82df-41c7-9f7e-cb80486a7de4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:26.321201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233239d-6d29-445d-9ed3-50761239ea05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:26.321937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233239d-6d29-445d-9ed3-50761239ea05 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:26.322115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233239d-6d29-445d-9ed3-50761239ea05 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:26.322389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233239d-6d29-445d-9ed3-50761239ea05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:26.323197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233239d-6d29-445d-9ed3-50761239ea05 None admin] RBAC: Adding query filter params (role.id=c15ca78eb3c9472f94e15e2d28c7f403, scope.project.id=ef582d6737c842c69928f69bab3e3cf3, user.id=0729410e405547888666133c28f019d7) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:26.323548 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233239d-6d29-445d-9ed3-50761239ea05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:26.325042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233239d-6d29-445d-9ed3-50761239ea05 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:26.335909 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 129/268] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:57:25 2022] GET /identity/v3/role_assignments?user.id=0729410e405547888666133c28f019d7&scope.project.id=ef582d6737c842c69928f69bab3e3cf3&role.id=c15ca78eb3c9472f94e15e2d28c7f403 => generated 608 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:26.360512 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579704a-e0a8-457a-b3ab-ce46d07699f4 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:26.360845 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579704a-e0a8-457a-b3ab-ce46d07699f4 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:26.361016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579704a-e0a8-457a-b3ab-ce46d07699f4 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:26.362446 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 130/269] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:57:26.368155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16b6c4-0516-4552-9ddf-f97037bbe7ec None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:26.368481 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16b6c4-0516-4552-9ddf-f97037bbe7ec None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:26.368758 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16b6c4-0516-4552-9ddf-f97037bbe7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:26.404084 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:26.408661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e431e-82df-41c7-9f7e-cb80486a7de4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:26.413653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-cd16b6c4-0516-4552-9ddf-f97037bbe7ec None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:26.414897 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-cd16b6c4-0516-4552-9ddf-f97037bbe7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:26.451384 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568c0d5-7d4f-485a-9ca7-f7595ad01c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:26.452376 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568c0d5-7d4f-485a-9ca7-f7595ad01c8f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:26.452881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568c0d5-7d4f-485a-9ca7-f7595ad01c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:26.453379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568c0d5-7d4f-485a-9ca7-f7595ad01c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:26.454580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568c0d5-7d4f-485a-9ca7-f7595ad01c8f None admin] RBAC: Adding query filter params (role.id=cbb81f88446a46f38469b450c5f24624, scope.project.id=ef582d6737c842c69928f69bab3e3cf3, user.id=0729410e405547888666133c28f019d7) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:26.455093 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568c0d5-7d4f-485a-9ca7-f7595ad01c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:26.456795 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5568c0d5-7d4f-485a-9ca7-f7595ad01c8f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:26.464676 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 140/270] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:57:26 2022] GET /identity/v3/role_assignments?user.id=0729410e405547888666133c28f019d7&scope.project.id=ef582d6737c842c69928f69bab3e3cf3&role.id=cbb81f88446a46f38469b450c5f24624 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:26.557436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 131/271] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:26.604363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568c0d5-7d4f-485a-9ca7-f7595ad01c8f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:26.739937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568c0d5-7d4f-485a-9ca7-f7595ad01c8f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:26.778897 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9dd1d-88d0-4895-a97f-a4d111eb841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:26.779938 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9dd1d-88d0-4895-a97f-a4d111eb841a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:26.780420 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9dd1d-88d0-4895-a97f-a4d111eb841a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:26.780916 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9dd1d-88d0-4895-a97f-a4d111eb841a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:26.793863 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9dd1d-88d0-4895-a97f-a4d111eb841a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:26.800522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-f0b9dd1d-88d0-4895-a97f-a4d111eb841a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:26.800522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:26.800522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:26.800522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:26.800522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:26.800522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:26.800522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:26.800522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:26.800522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:26.800522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:26.800522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:26.800522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:26.800522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:26.800522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:26.800522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:26.800522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:26.801461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:26.801461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:26.801461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:26.801461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:26.801461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:26.801461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:26.801461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:26.801461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:26.801461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:26.801461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:26.801461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:26.801461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:26.801461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:26.801461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:26.801461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:26.801461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:26.802271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:26.802271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:26.802271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:26.802271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:26.802271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:26.802271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:26.802271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:26.802271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:26.802271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:26.802271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:26.802271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:26.802271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:26.805044 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 141/272] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:26.813623 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16b6c4-0516-4552-9ddf-f97037bbe7ec None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:26.858524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:26.864631 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc58440-f8c5-4f7f-8b21-9c0d3ab727a2 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:26.864940 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc58440-f8c5-4f7f-8b21-9c0d3ab727a2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:26.865222 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc58440-f8c5-4f7f-8b21-9c0d3ab727a2 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:26.866752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 142/273] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:26.872414 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dddd88-4874-4df3-ab28-b1ee685b7906 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:26.872755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dddd88-4874-4df3-ab28-b1ee685b7906 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:26.873039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dddd88-4874-4df3-ab28-b1ee685b7906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:26.899198 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-20dddd88-4874-4df3-ab28-b1ee685b7906 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:26.901291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-20dddd88-4874-4df3-ab28-b1ee685b7906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:26.930559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:26.954905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16b6c4-0516-4552-9ddf-f97037bbe7ec None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:27.001753 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 143/274] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:27.007927 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716ec88-49d5-4c04-b3e5-a5408cf07cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:27.008625 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716ec88-49d5-4c04-b3e5-a5408cf07cdc None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:27.008911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716ec88-49d5-4c04-b3e5-a5408cf07cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:27.009193 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d716ec88-49d5-4c04-b3e5-a5408cf07cdc None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:27.009927 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716ec88-49d5-4c04-b3e5-a5408cf07cdc None admin] RBAC: Adding query filter params (name=member) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:27.010233 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716ec88-49d5-4c04-b3e5-a5408cf07cdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:27.011727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d716ec88-49d5-4c04-b3e5-a5408cf07cdc None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:27.021018 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 132/275] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:27.027219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dddd88-4874-4df3-ab28-b1ee685b7906 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:27.036392 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716ec88-49d5-4c04-b3e5-a5408cf07cdc None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:27.154840 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:27.165390 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d716ec88-49d5-4c04-b3e5-a5408cf07cdc None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:27.166066 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dddd88-4874-4df3-ab28-b1ee685b7906 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:27.202540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e64e18-3465-4cd1-865b-d1698be7645f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:27.203283 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e64e18-3465-4cd1-865b-d1698be7645f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:27.203650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e64e18-3465-4cd1-865b-d1698be7645f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:27.203985 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e64e18-3465-4cd1-865b-d1698be7645f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:27.205299 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e64e18-3465-4cd1-865b-d1698be7645f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:27.206859 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e64e18-3465-4cd1-865b-d1698be7645f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:27.208598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 133/276] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:27.215122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e64e18-3465-4cd1-865b-d1698be7645f None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:27.217307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de3975-ba4d-46f5-94c3-1c54c6bd2030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:27.217968 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de3975-ba4d-46f5-94c3-1c54c6bd2030 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:27.218249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de3975-ba4d-46f5-94c3-1c54c6bd2030 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:27.218525 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de3975-ba4d-46f5-94c3-1c54c6bd2030 None admin] PATH_INFO: `/v3/users/844bd5217bdd4719a867aeef56cd28fe` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:27.233970 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de3975-ba4d-46f5-94c3-1c54c6bd2030 None admin] RBAC: Authorizing `identity:get_user(user_id=844bd5217bdd4719a867aeef56cd28fe)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:27.235511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de3975-ba4d-46f5-94c3-1c54c6bd2030 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:27.242234 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 144/277] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:27 2022] GET /identity/v3/users/844bd5217bdd4719a867aeef56cd28fe => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:27.243296 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de3975-ba4d-46f5-94c3-1c54c6bd2030 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:27.259411 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:27.357556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e64e18-3465-4cd1-865b-d1698be7645f None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:27.367335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de3975-ba4d-46f5-94c3-1c54c6bd2030 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:27.398180 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c50827-38ea-433e-9b5e-779f2c72470c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:27.398802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c50827-38ea-433e-9b5e-779f2c72470c None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:27.399088 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c50827-38ea-433e-9b5e-779f2c72470c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:27.399365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c50827-38ea-433e-9b5e-779f2c72470c None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:27.400054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c50827-38ea-433e-9b5e-779f2c72470c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:27.401558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c50827-38ea-433e-9b5e-779f2c72470c None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:27.402636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cd94b-a238-456f-8ab7-b7b7a775c5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:27.403244 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cd94b-a238-456f-8ab7-b7b7a775c5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:27.403527 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cd94b-a238-456f-8ab7-b7b7a775c5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:27.403803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cd94b-a238-456f-8ab7-b7b7a775c5a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:27.404694 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cd94b-a238-456f-8ab7-b7b7a775c5a0 None admin] RBAC: Adding query filter params (role.id=a2d6e3ab7e054be982bc78ce3c0a9748, user.id=844bd5217bdd4719a867aeef56cd28fe, scope.system=all) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:27.405002 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cd94b-a238-456f-8ab7-b7b7a775c5a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:27.406453 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9cd94b-a238-456f-8ab7-b7b7a775c5a0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:27.411784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 145/278] 10.222.0.85 () {56 vars in 1308 bytes} [Tue Aug 2 09:57:27 2022] GET /identity/v3/role_assignments?user.id=844bd5217bdd4719a867aeef56cd28fe&scope.system=all&role.id=a2d6e3ab7e054be982bc78ce3c0a9748 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:27.411784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24b06-586f-4dd5-bda0-de644530fe5a None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:27.411784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24b06-586f-4dd5-bda0-de644530fe5a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:27.411784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24b06-586f-4dd5-bda0-de644530fe5a None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:27.411784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 146/279] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:27.411784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d57d1-7b29-448f-9d55-9c8fe316db64 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:27.421015 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d57d1-7b29-448f-9d55-9c8fe316db64 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:27.421015 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d57d1-7b29-448f-9d55-9c8fe316db64 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:27.421015 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 147/280] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:27.422063 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e2507-a144-42cc-a4b2-3ea97c6c0a2f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:27.422396 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e2507-a144-42cc-a4b2-3ea97c6c0a2f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:27.422917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e2507-a144-42cc-a4b2-3ea97c6c0a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:27.438284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 134/281] 10.222.0.85 () {60 vars in 1132 bytes} [Tue Aug 2 09:57:27 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:57:27.439718 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c05a0-59cb-47c9-a24f-50a9de3ab2d5 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:27.440081 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c05a0-59cb-47c9-a24f-50a9de3ab2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:27.440553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c05a0-59cb-47c9-a24f-50a9de3ab2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:27.453494 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ca6e2507-a144-42cc-a4b2-3ea97c6c0a2f None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:27.455135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ca6e2507-a144-42cc-a4b2-3ea97c6c0a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:27.462015 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-496c05a0-59cb-47c9-a24f-50a9de3ab2d5 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:27.463532 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-496c05a0-59cb-47c9-a24f-50a9de3ab2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:27.488899 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:27.548830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 135/282] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:27.560719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 148/283] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:27.577905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c05a0-59cb-47c9-a24f-50a9de3ab2d5 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:27.583394 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e2507-a144-42cc-a4b2-3ea97c6c0a2f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:27.593946 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:27.709585 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c05a0-59cb-47c9-a24f-50a9de3ab2d5 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:27.721150 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e2507-a144-42cc-a4b2-3ea97c6c0a2f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:27.764653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a605ad-992d-427e-95e0-4f4c48ea9cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:27.765308 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a605ad-992d-427e-95e0-4f4c48ea9cff None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:27.765589 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a605ad-992d-427e-95e0-4f4c48ea9cff None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:27.765875 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a605ad-992d-427e-95e0-4f4c48ea9cff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:27.768522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221a3d4-426f-4a5c-8add-24f2e4d2008c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:27.769454 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221a3d4-426f-4a5c-8add-24f2e4d2008c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:27.771164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221a3d4-426f-4a5c-8add-24f2e4d2008c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:27.771657 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221a3d4-426f-4a5c-8add-24f2e4d2008c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:27.780024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a605ad-992d-427e-95e0-4f4c48ea9cff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:27.784450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-62a605ad-992d-427e-95e0-4f4c48ea9cff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:27.784450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:27.784450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:27.784450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:27.784450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:27.784450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:27.784450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:27.784450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:27.784450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:27.784450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:27.784450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:27.784450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:27.784450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:27.784450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:27.784450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:27.784450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:27.785363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:27.785363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:27.785363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:27.785363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:27.785363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:27.785363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:27.785363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:27.785363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:27.785363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:27.785363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:27.785363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:27.785363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:27.785363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:27.785363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:27.785363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:27.785363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:27.786142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:27.786142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:27.786142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:27.786142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:27.786142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:27.786142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:27.786142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:27.786142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:27.786142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:27.786142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:27.786142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:27.786142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:27.786142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 136/284] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:57:27.790818 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221a3d4-426f-4a5c-8add-24f2e4d2008c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:27.793184 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a605ad-992d-427e-95e0-4f4c48ea9cff None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:27.797972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-9221a3d4-426f-4a5c-8add-24f2e4d2008c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:57:27.797972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:27.797972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:27.797972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:27.797972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:27.797972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:27.797972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:27.797972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:27.797972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:27.797972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:27.797972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:27.797972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:27.797972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:27.797972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:27.797972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:27.797972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:27.798896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:27.798896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:27.798896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:27.798896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:27.798896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:27.798896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:27.798896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:27.798896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:27.798896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:27.798896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:27.798896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:27.798896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:27.798896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:27.798896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:27.798896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:27.798896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:27.799837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:27.799837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:27.799837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:27.799837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:27.799837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:27.799837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:27.799837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:27.799837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:27.799837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:27.799837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:27.799837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:57:27.799837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:27.799837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 149/285] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:57:27.808086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:27.813471 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221a3d4-426f-4a5c-8add-24f2e4d2008c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:27.890870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:27.926751 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a605ad-992d-427e-95e0-4f4c48ea9cff None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:27.929084 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221a3d4-426f-4a5c-8add-24f2e4d2008c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:27.965456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc3396-2406-442f-aebd-c23ff2bdd521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:27.966081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc3396-2406-442f-aebd-c23ff2bdd521 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:27.966360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc3396-2406-442f-aebd-c23ff2bdd521 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:27.966727 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc3396-2406-442f-aebd-c23ff2bdd521 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:27.967416 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404b25d-b1a0-4ea8-8a98-4ebee46a03e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:27.967555 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc3396-2406-442f-aebd-c23ff2bdd521 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:27.967743 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc3396-2406-442f-aebd-c23ff2bdd521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:27.968426 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404b25d-b1a0-4ea8-8a98-4ebee46a03e7 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:27.968891 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404b25d-b1a0-4ea8-8a98-4ebee46a03e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:27.969161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc3396-2406-442f-aebd-c23ff2bdd521 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:27.969452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404b25d-b1a0-4ea8-8a98-4ebee46a03e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:27.970332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404b25d-b1a0-4ea8-8a98-4ebee46a03e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:27.970832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404b25d-b1a0-4ea8-8a98-4ebee46a03e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:27.972575 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404b25d-b1a0-4ea8-8a98-4ebee46a03e7 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:27.978247 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 150/286] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:27.983130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 137/287] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:27.986418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc3396-2406-442f-aebd-c23ff2bdd521 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:27.989175 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404b25d-b1a0-4ea8-8a98-4ebee46a03e7 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:28.066035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:28.090007 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc3396-2406-442f-aebd-c23ff2bdd521 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:28.108099 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404b25d-b1a0-4ea8-8a98-4ebee46a03e7 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:28.117027 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:28.125269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75c4e3-2c70-4f9c-8f3f-27f10841fcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:28.125915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75c4e3-2c70-4f9c-8f3f-27f10841fcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:28.126223 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75c4e3-2c70-4f9c-8f3f-27f10841fcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:28.126776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75c4e3-2c70-4f9c-8f3f-27f10841fcf8 None admin] PATH_INFO: `/v3/users/7beed4f078e84ea7a9c12db0f5f8b1c9` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:28.127794 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75c4e3-2c70-4f9c-8f3f-27f10841fcf8 None admin] RBAC: Authorizing `identity:get_user(user_id=7beed4f078e84ea7a9c12db0f5f8b1c9)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:28.129262 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75c4e3-2c70-4f9c-8f3f-27f10841fcf8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:28.131432 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 151/288] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:27 2022] GET /identity/v3/users/7beed4f078e84ea7a9c12db0f5f8b1c9 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:28.137592 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75c4e3-2c70-4f9c-8f3f-27f10841fcf8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:28.150594 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b71f1a-aaa4-4b67-b7cf-c21ab09e4d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:28.152820 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b71f1a-aaa4-4b67-b7cf-c21ab09e4d83 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:28.153562 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b71f1a-aaa4-4b67-b7cf-c21ab09e4d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:28.154348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b71f1a-aaa4-4b67-b7cf-c21ab09e4d83 None admin] PATH_INFO: `/v3/users/7b0d664f626c41a99bedc672e25c0643` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:28.157281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b71f1a-aaa4-4b67-b7cf-c21ab09e4d83 None admin] RBAC: Authorizing `identity:get_user(user_id=7b0d664f626c41a99bedc672e25c0643)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:28.160732 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b71f1a-aaa4-4b67-b7cf-c21ab09e4d83 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:28.163176 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 138/289] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:27 2022] GET /identity/v3/users/7b0d664f626c41a99bedc672e25c0643 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:28.169482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b71f1a-aaa4-4b67-b7cf-c21ab09e4d83 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:28.248016 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75c4e3-2c70-4f9c-8f3f-27f10841fcf8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:28.286972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aeb526-c7fa-4b25-93c8-e2ea1431bb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:28.287624 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeb526-c7fa-4b25-93c8-e2ea1431bb62 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:28.287903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeb526-c7fa-4b25-93c8-e2ea1431bb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:28.288487 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aeb526-c7fa-4b25-93c8-e2ea1431bb62 None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:28.289551 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aeb526-c7fa-4b25-93c8-e2ea1431bb62 None admin] RBAC: Authorizing `identity:get_project(project_id=ef582d6737c842c69928f69bab3e3cf3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:28.291112 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aeb526-c7fa-4b25-93c8-e2ea1431bb62 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:28.293079 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 152/290] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:28 2022] GET /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:28.305093 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aeb526-c7fa-4b25-93c8-e2ea1431bb62 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:28.305193 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b71f1a-aaa4-4b67-b7cf-c21ab09e4d83 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:28.343580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadce46-57a3-4269-afc1-60d1a502800f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:28.344219 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadce46-57a3-4269-afc1-60d1a502800f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:28.344598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadce46-57a3-4269-afc1-60d1a502800f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:28.344942 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadce46-57a3-4269-afc1-60d1a502800f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:28.348786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:28.377943 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:28.420171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aeb526-c7fa-4b25-93c8-e2ea1431bb62 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:28.424408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadce46-57a3-4269-afc1-60d1a502800f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:28.426453 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadce46-57a3-4269-afc1-60d1a502800f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:28.456100 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfc0fb-4c30-4d8d-b5ff-9d3e89bdb759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:28.456795 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfc0fb-4c30-4d8d-b5ff-9d3e89bdb759 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:28.457075 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfc0fb-4c30-4d8d-b5ff-9d3e89bdb759 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:28.457350 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dfc0fb-4c30-4d8d-b5ff-9d3e89bdb759 None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3/users/7beed4f078e84ea7a9c12db0f5f8b1c9/roles/3c4094b115cb4252aec1c29de8391a07` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:28.459285 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dfc0fb-4c30-4d8d-b5ff-9d3e89bdb759 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef582d6737c842c69928f69bab3e3cf3, user_id=7beed4f078e84ea7a9c12db0f5f8b1c9, role_id=3c4094b115cb4252aec1c29de8391a07)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:28.460865 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dfc0fb-4c30-4d8d-b5ff-9d3e89bdb759 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:28.483911 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 153/291] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:57:28 2022] PUT /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3/users/7beed4f078e84ea7a9c12db0f5f8b1c9/roles/3c4094b115cb4252aec1c29de8391a07 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:57:28.539815 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 139/292] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:28.546498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfc0fb-4c30-4d8d-b5ff-9d3e89bdb759 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:28.706304 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dfc0fb-4c30-4d8d-b5ff-9d3e89bdb759 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:28.732337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:28.748161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184735ed-e115-436e-9e32-cd1974b5f19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:28.748858 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184735ed-e115-436e-9e32-cd1974b5f19a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:28.749142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184735ed-e115-436e-9e32-cd1974b5f19a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:28.749422 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184735ed-e115-436e-9e32-cd1974b5f19a None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:28.751337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184735ed-e115-436e-9e32-cd1974b5f19a None admin] RBAC: Authorizing `identity:get_project(project_id=ef582d6737c842c69928f69bab3e3cf3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:28.752819 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184735ed-e115-436e-9e32-cd1974b5f19a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:28.754784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 154/293] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:28 2022] GET /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:28.761403 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadce46-57a3-4269-afc1-60d1a502800f None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:28.803119 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:28.895835 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadce46-57a3-4269-afc1-60d1a502800f None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:28.939875 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d58af-7116-43d3-8599-052b1a831591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:28.940522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d58af-7116-43d3-8599-052b1a831591 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:28.940812 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d58af-7116-43d3-8599-052b1a831591 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:28.941092 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d58af-7116-43d3-8599-052b1a831591 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:28.941899 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d58af-7116-43d3-8599-052b1a831591 None admin] RBAC: Adding query filter params (role.id=a2d6e3ab7e054be982bc78ce3c0a9748, scope.project.id=ef582d6737c842c69928f69bab3e3cf3, user.id=7b0d664f626c41a99bedc672e25c0643) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:28.942215 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d58af-7116-43d3-8599-052b1a831591 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:28.943658 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d58af-7116-43d3-8599-052b1a831591 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:28.950138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 140/294] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:57:28 2022] GET /identity/v3/role_assignments?user.id=7b0d664f626c41a99bedc672e25c0643&scope.project.id=ef582d6737c842c69928f69bab3e3cf3&role.id=a2d6e3ab7e054be982bc78ce3c0a9748 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:29.804437 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58db8b2-b204-4d0d-9299-a19da9790856 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:29.804987 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58db8b2-b204-4d0d-9299-a19da9790856 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:29.804987 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58db8b2-b204-4d0d-9299-a19da9790856 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:29.806648 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 155/295] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:29.812138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91be3d-4902-42ce-b290-69eedabbaec6 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:29.812577 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91be3d-4902-42ce-b290-69eedabbaec6 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:29.812751 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91be3d-4902-42ce-b290-69eedabbaec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:29.832526 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-db91be3d-4902-42ce-b290-69eedabbaec6 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:29.833726 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-db91be3d-4902-42ce-b290-69eedabbaec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:29.908885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 141/296] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:29.930283 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58db8b2-b204-4d0d-9299-a19da9790856 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:30.046124 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58db8b2-b204-4d0d-9299-a19da9790856 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:30.083600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b3b3d-7c5f-4575-8009-c6f2a53392ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:30.084738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b3b3d-7c5f-4575-8009-c6f2a53392ff None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:30.085221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b3b3d-7c5f-4575-8009-c6f2a53392ff None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:30.085692 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b3b3d-7c5f-4575-8009-c6f2a53392ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:30.097615 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3b3b3d-7c5f-4575-8009-c6f2a53392ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:30.103912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-cf3b3b3d-7c5f-4575-8009-c6f2a53392ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:30.103912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:30.103912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:30.103912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:30.103912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:30.103912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:30.103912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:30.103912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:30.103912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:30.103912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:30.103912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:30.103912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:30.103912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:30.103912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:30.103912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:30.103912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:30.104844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:30.104844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:30.104844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:30.104844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:30.104844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:30.104844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:30.104844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:30.104844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:30.104844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:30.104844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:30.104844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:30.104844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:30.104844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:30.104844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:30.104844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:30.104844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:30.105664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:30.105664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:30.105664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:30.105664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:30.105664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:30.105664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:30.105664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:30.105664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:30.105664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:30.105664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:30.105664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:30.105664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:30.108117 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 156/297] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:30.116713 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91be3d-4902-42ce-b290-69eedabbaec6 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:30.147436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:30.159487 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd690e-caca-40e2-afcb-90129cf7d519 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:30.159487 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd690e-caca-40e2-afcb-90129cf7d519 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:30.159775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd690e-caca-40e2-afcb-90129cf7d519 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:30.161235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 157/298] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:30.166717 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a84671-4a2d-42f7-a23d-d1f631eddb43 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:30.167044 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a84671-4a2d-42f7-a23d-d1f631eddb43 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:30.167368 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a84671-4a2d-42f7-a23d-d1f631eddb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:30.185710 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-28a84671-4a2d-42f7-a23d-d1f631eddb43 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:30.186907 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-28a84671-4a2d-42f7-a23d-d1f631eddb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:30.229262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91be3d-4902-42ce-b290-69eedabbaec6 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:30.244517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:30.266759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 158/299] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:30.267764 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb1177-9a9c-4c61-94d0-8ce703bba3c4 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:30.268054 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb1177-9a9c-4c61-94d0-8ce703bba3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:30.268331 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb1177-9a9c-4c61-94d0-8ce703bba3c4 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:30.269888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 159/300] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:30.278336 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39448c-b2da-41c1-af22-ecedba4c1428 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:30.278745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39448c-b2da-41c1-af22-ecedba4c1428 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:30.279128 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c39448c-b2da-41c1-af22-ecedba4c1428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:30.279971 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44f867-d664-464f-9c90-8838a1353a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:30.280850 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44f867-d664-464f-9c90-8838a1353a8c None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:30.281294 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44f867-d664-464f-9c90-8838a1353a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:30.281710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44f867-d664-464f-9c90-8838a1353a8c None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:30.282613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44f867-d664-464f-9c90-8838a1353a8c None admin] RBAC: Adding query filter params (name=member) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:30.283076 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44f867-d664-464f-9c90-8838a1353a8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:30.284706 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44f867-d664-464f-9c90-8838a1353a8c None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:30.296648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 142/301] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:30.300253 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44f867-d664-464f-9c90-8838a1353a8c None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:30.308942 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9c39448c-b2da-41c1-af22-ecedba4c1428 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:30.310275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9c39448c-b2da-41c1-af22-ecedba4c1428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:30.384409 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 160/302] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:30.385528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39448c-b2da-41c1-af22-ecedba4c1428 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:30.399869 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:30.410411 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44f867-d664-464f-9c90-8838a1353a8c None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:30.447727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237917c-3691-42e3-9df5-8c57b18e2db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:30.448372 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237917c-3691-42e3-9df5-8c57b18e2db3 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:30.448710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237917c-3691-42e3-9df5-8c57b18e2db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:30.448982 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237917c-3691-42e3-9df5-8c57b18e2db3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:30.459199 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237917c-3691-42e3-9df5-8c57b18e2db3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:30.464950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-d237917c-3691-42e3-9df5-8c57b18e2db3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:57:30.464950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:30.464950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:30.464950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:30.464950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:30.464950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:30.464950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:30.464950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:30.464950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:30.464950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:30.464950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:30.464950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:30.464950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:30.464950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:30.464950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:30.464950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:30.465996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:30.465996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:30.465996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:30.465996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:30.465996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:30.465996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:30.465996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:30.465996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:30.465996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:30.465996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:30.465996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:30.465996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:30.465996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:30.465996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:30.465996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:30.465996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:30.469335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:30.469335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:30.469335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:30.469335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:30.469335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:30.469335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:30.469335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:30.469335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:30.469335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:30.469335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:30.469335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:57:30.469335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:30.469335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 143/303] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:30.469335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237917c-3691-42e3-9df5-8c57b18e2db3 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:30.497523 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c39448c-b2da-41c1-af22-ecedba4c1428 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:30.513352 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:30.538619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01211db-4165-424c-b9e0-63448071bdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:30.539282 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01211db-4165-424c-b9e0-63448071bdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:30.539542 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01211db-4165-424c-b9e0-63448071bdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:30.539822 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01211db-4165-424c-b9e0-63448071bdc6 None admin] PATH_INFO: `/v3/users/844bd5217bdd4719a867aeef56cd28fe` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:30.541087 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01211db-4165-424c-b9e0-63448071bdc6 None admin] RBAC: Authorizing `identity:get_user(user_id=844bd5217bdd4719a867aeef56cd28fe)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:30.542538 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01211db-4165-424c-b9e0-63448071bdc6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:30.544154 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 161/304] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:30 2022] GET /identity/v3/users/844bd5217bdd4719a867aeef56cd28fe => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:30.549833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01211db-4165-424c-b9e0-63448071bdc6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:30.575147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237917c-3691-42e3-9df5-8c57b18e2db3 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:30.610887 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245846b0-2511-4721-82ef-4cb54077f2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:30.611606 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245846b0-2511-4721-82ef-4cb54077f2ad None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:30.611966 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245846b0-2511-4721-82ef-4cb54077f2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:30.612299 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245846b0-2511-4721-82ef-4cb54077f2ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:30.613532 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245846b0-2511-4721-82ef-4cb54077f2ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:30.615075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245846b0-2511-4721-82ef-4cb54077f2ad None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:30.616753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 144/305] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:30.617532 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245846b0-2511-4721-82ef-4cb54077f2ad None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:30.642097 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:30.668607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01211db-4165-424c-b9e0-63448071bdc6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:30.704077 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575f18a-6580-4895-9983-d469ac336833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:30.704817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575f18a-6580-4895-9983-d469ac336833 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:30.705098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575f18a-6580-4895-9983-d469ac336833 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:30.705446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575f18a-6580-4895-9983-d469ac336833 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:30.706154 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575f18a-6580-4895-9983-d469ac336833 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:30.706453 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575f18a-6580-4895-9983-d469ac336833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:30.707823 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575f18a-6580-4895-9983-d469ac336833 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:30.720836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 162/306] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:30.721566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575f18a-6580-4895-9983-d469ac336833 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:30.729920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245846b0-2511-4721-82ef-4cb54077f2ad None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:30.765635 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48613c2-31af-4bec-a255-78d15851fb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:30.766482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48613c2-31af-4bec-a255-78d15851fb79 None admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:30.766868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48613c2-31af-4bec-a255-78d15851fb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:30.767252 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48613c2-31af-4bec-a255-78d15851fb79 None admin] PATH_INFO: `/v3/system/users/844bd5217bdd4719a867aeef56cd28fe/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:30.769912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:30.770403 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48613c2-31af-4bec-a255-78d15851fb79 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=844bd5217bdd4719a867aeef56cd28fe, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:30.772252 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48613c2-31af-4bec-a255-78d15851fb79 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:30.792509 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 145/307] 10.222.0.85 () {58 vars in 1334 bytes} [Tue Aug 2 09:57:30 2022] PUT /identity/v3/system/users/844bd5217bdd4719a867aeef56cd28fe/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:57:30.792509 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48613c2-31af-4bec-a255-78d15851fb79 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:30.850179 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575f18a-6580-4895-9983-d469ac336833 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:30.889811 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b34882-7c4e-45c5-a7f7-ddedbae80b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:30.890454 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b34882-7c4e-45c5-a7f7-ddedbae80b04 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:30.890739 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b34882-7c4e-45c5-a7f7-ddedbae80b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:30.891022 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b34882-7c4e-45c5-a7f7-ddedbae80b04 None admin] PATH_INFO: `/v3/groups` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:30.891701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b34882-7c4e-45c5-a7f7-ddedbae80b04 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:30.893279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b34882-7c4e-45c5-a7f7-ddedbae80b04 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:30.899381 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:30.912977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 163/308] 10.222.0.85 () {60 vars in 1134 bytes} [Tue Aug 2 09:57:30 2022] POST /identity/v3/groups => generated 229 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:57:30.920328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48613c2-31af-4bec-a255-78d15851fb79 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:30.926077 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8298e12-6337-4b43-9aa2-2a12ffdfd269 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:30.926434 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8298e12-6337-4b43-9aa2-2a12ffdfd269 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:30.926645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8298e12-6337-4b43-9aa2-2a12ffdfd269 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:30.928508 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 164/309] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:30.934493 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64723c-ccb1-4cd7-b606-37f884bf8285 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:30.934775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64723c-ccb1-4cd7-b606-37f884bf8285 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:30.935048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64723c-ccb1-4cd7-b606-37f884bf8285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:30.968496 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-cf64723c-ccb1-4cd7-b606-37f884bf8285 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:30.969751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cf64723c-ccb1-4cd7-b606-37f884bf8285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:30.976188 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e283f-5684-4f0d-928b-dd422272cccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:30.977230 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e283f-5684-4f0d-928b-dd422272cccb None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:30.977652 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e283f-5684-4f0d-928b-dd422272cccb None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:30.978733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e283f-5684-4f0d-928b-dd422272cccb None admin] PATH_INFO: `/v3/users/920abe704b8e49a59d7271751f85877e` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:31.003820 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e283f-5684-4f0d-928b-dd422272cccb None admin] RBAC: Authorizing `identity:get_user(user_id=920abe704b8e49a59d7271751f85877e)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:31.005368 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e283f-5684-4f0d-928b-dd422272cccb None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:31.007358 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 146/310] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:30 2022] GET /identity/v3/users/920abe704b8e49a59d7271751f85877e => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:31.013827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e283f-5684-4f0d-928b-dd422272cccb None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:31.079636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 165/311] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:31.104029 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64723c-ccb1-4cd7-b606-37f884bf8285 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:31.139153 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:31.143171 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e283f-5684-4f0d-928b-dd422272cccb None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:31.192334 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b02160-96ad-4bac-b08a-ad86bae0f6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:31.193342 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b02160-96ad-4bac-b08a-ad86bae0f6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:31.194333 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b02160-96ad-4bac-b08a-ad86bae0f6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:31.194808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b02160-96ad-4bac-b08a-ad86bae0f6f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:31.196301 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b02160-96ad-4bac-b08a-ad86bae0f6f1 None admin] RBAC: Adding query filter params (role.id=3c4094b115cb4252aec1c29de8391a07, user.id=920abe704b8e49a59d7271751f85877e, scope.system=all) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:31.197453 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b02160-96ad-4bac-b08a-ad86bae0f6f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:31.199733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b02160-96ad-4bac-b08a-ad86bae0f6f1 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:31.207529 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 147/312] 10.222.0.85 () {56 vars in 1308 bytes} [Tue Aug 2 09:57:31 2022] GET /identity/v3/role_assignments?user.id=920abe704b8e49a59d7271751f85877e&scope.system=all&role.id=3c4094b115cb4252aec1c29de8391a07 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:31.238616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64723c-ccb1-4cd7-b606-37f884bf8285 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:31.281122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0a20a-0e20-4819-b2bd-8d0315e6956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:31.282132 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0a20a-0e20-4819-b2bd-8d0315e6956f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:31.282710 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0a20a-0e20-4819-b2bd-8d0315e6956f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:31.283178 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0a20a-0e20-4819-b2bd-8d0315e6956f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:31.296335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0a20a-0e20-4819-b2bd-8d0315e6956f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:31.301892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-eff0a20a-0e20-4819-b2bd-8d0315e6956f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:57:31.301892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:31.301892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:31.301892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:31.301892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:31.301892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:31.301892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:31.301892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:31.301892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:31.301892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:31.301892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:31.301892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:31.301892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:31.301892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:31.301892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:31.301892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:31.302836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:31.302836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:31.302836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:31.302836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:31.302836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:31.302836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:31.302836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:31.302836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:31.302836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:31.302836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:31.302836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:31.302836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:31.302836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:31.302836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:31.302836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:31.302836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:31.304144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:31.304144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:31.304144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:31.304144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:31.304144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:31.304144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:31.304144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:31.304144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:31.304144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:31.304144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:31.304144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:57:31.304144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:31.307821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 166/313] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:31.313461 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b02160-96ad-4bac-b08a-ad86bae0f6f1 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:31.324884 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:31.433316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b02160-96ad-4bac-b08a-ad86bae0f6f1 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:31.471211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57836509-b1e1-4411-9bb1-b3461285a0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:31.471752 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57836509-b1e1-4411-9bb1-b3461285a0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:31.472072 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57836509-b1e1-4411-9bb1-b3461285a0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:31.472348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57836509-b1e1-4411-9bb1-b3461285a0d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:31.473105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57836509-b1e1-4411-9bb1-b3461285a0d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:31.473413 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57836509-b1e1-4411-9bb1-b3461285a0d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:31.474798 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57836509-b1e1-4411-9bb1-b3461285a0d3 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:31.484872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 148/314] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:31.490441 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0a20a-0e20-4819-b2bd-8d0315e6956f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:31.592030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:31.601522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0a20a-0e20-4819-b2bd-8d0315e6956f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:31.640421 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370470b-734c-4f8d-8ed3-d0ee1deb17df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:31.641119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370470b-734c-4f8d-8ed3-d0ee1deb17df None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:31.641399 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370470b-734c-4f8d-8ed3-d0ee1deb17df None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:31.641719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370470b-734c-4f8d-8ed3-d0ee1deb17df None admin] PATH_INFO: `/v3/users/7beed4f078e84ea7a9c12db0f5f8b1c9` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:31.642893 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370470b-734c-4f8d-8ed3-d0ee1deb17df None admin] RBAC: Authorizing `identity:get_user(user_id=7beed4f078e84ea7a9c12db0f5f8b1c9)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:31.644640 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370470b-734c-4f8d-8ed3-d0ee1deb17df None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:31.646524 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 167/315] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:31 2022] GET /identity/v3/users/7beed4f078e84ea7a9c12db0f5f8b1c9 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:31.653340 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57836509-b1e1-4411-9bb1-b3461285a0d3 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:31.726782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:31.765743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57836509-b1e1-4411-9bb1-b3461285a0d3 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:31.805475 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3b31c-8eac-4316-8fb1-cbe5c7431f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:31.806885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3b31c-8eac-4316-8fb1-cbe5c7431f9c None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:31.807173 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3b31c-8eac-4316-8fb1-cbe5c7431f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:31.807450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3b31c-8eac-4316-8fb1-cbe5c7431f9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:31.881180 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3b31c-8eac-4316-8fb1-cbe5c7431f9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:31.882751 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3b31c-8eac-4316-8fb1-cbe5c7431f9c None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:31.952156 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:31.991746 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 149/316] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:32.000684 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370470b-734c-4f8d-8ed3-d0ee1deb17df None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:32.111635 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370470b-734c-4f8d-8ed3-d0ee1deb17df None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:32.148318 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db59b4-6ca7-4d5b-b1c6-f2b2f7710fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:32.148990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db59b4-6ca7-4d5b-b1c6-f2b2f7710fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:32.149919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db59b4-6ca7-4d5b-b1c6-f2b2f7710fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:32.150760 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db59b4-6ca7-4d5b-b1c6-f2b2f7710fc1 None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:32.151951 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db59b4-6ca7-4d5b-b1c6-f2b2f7710fc1 None admin] RBAC: Authorizing `identity:get_project(project_id=ef582d6737c842c69928f69bab3e3cf3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:32.153430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db59b4-6ca7-4d5b-b1c6-f2b2f7710fc1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:32.155251 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 168/317] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:31 2022] GET /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:32.160928 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3b31c-8eac-4316-8fb1-cbe5c7431f9c None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:32.271686 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3b31c-8eac-4316-8fb1-cbe5c7431f9c None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:32.317758 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa133c-5316-450f-b627-e4ca3a6301c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:32.318389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa133c-5316-450f-b627-e4ca3a6301c0 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:32.318671 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa133c-5316-450f-b627-e4ca3a6301c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:32.318950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa133c-5316-450f-b627-e4ca3a6301c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:32.319808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa133c-5316-450f-b627-e4ca3a6301c0 None admin] RBAC: Adding query filter params (role.id=3c4094b115cb4252aec1c29de8391a07, scope.project.id=ef582d6737c842c69928f69bab3e3cf3, user.id=7beed4f078e84ea7a9c12db0f5f8b1c9) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:32.320124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa133c-5316-450f-b627-e4ca3a6301c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:32.321676 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa133c-5316-450f-b627-e4ca3a6301c0 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:32.328275 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 150/318] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:57:32 2022] GET /identity/v3/role_assignments?user.id=7beed4f078e84ea7a9c12db0f5f8b1c9&scope.project.id=ef582d6737c842c69928f69bab3e3cf3&role.id=3c4094b115cb4252aec1c29de8391a07 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:32.898573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f271f-327a-4c59-a211-06a5c14124b5 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:32.898963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f271f-327a-4c59-a211-06a5c14124b5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:32.899682 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f271f-327a-4c59-a211-06a5c14124b5 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:32.901116 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 169/319] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:32.906279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd8795-8d73-44db-bec8-a3645becf8d7 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:32.906580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd8795-8d73-44db-bec8-a3645becf8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:32.906860 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd8795-8d73-44db-bec8-a3645becf8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:32.925068 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-00cd8795-8d73-44db-bec8-a3645becf8d7 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:32.926279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-00cd8795-8d73-44db-bec8-a3645becf8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:32.953192 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:32.999602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 151/320] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:33.022145 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f271f-327a-4c59-a211-06a5c14124b5 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:33.052831 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:33.113104 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497a438-8a8d-48fb-85e4-221975e86af7 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:33.113396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497a438-8a8d-48fb-85e4-221975e86af7 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:33.113682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497a438-8a8d-48fb-85e4-221975e86af7 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:33.115185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 152/321] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:57:33.120212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b82e2-cc49-4b80-87e8-943e0bfcb0fd None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:33.120534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b82e2-cc49-4b80-87e8-943e0bfcb0fd None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:33.120813 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b82e2-cc49-4b80-87e8-943e0bfcb0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:33.132496 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f271f-327a-4c59-a211-06a5c14124b5 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:33.139279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-719b82e2-cc49-4b80-87e8-943e0bfcb0fd None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:33.140495 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-719b82e2-cc49-4b80-87e8-943e0bfcb0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:33.171818 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680199b-9730-40a6-aa48-f6759e689029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:33.172396 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680199b-9730-40a6-aa48-f6759e689029 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:33.172710 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680199b-9730-40a6-aa48-f6759e689029 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:33.173405 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680199b-9730-40a6-aa48-f6759e689029 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:33.185541 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c680199b-9730-40a6-aa48-f6759e689029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:33.191677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-c680199b-9730-40a6-aa48-f6759e689029 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:33.191677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:33.191677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:33.191677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:33.191677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:33.191677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:33.191677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:33.191677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:33.191677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:33.191677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:33.191677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:33.191677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:33.191677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:33.191677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:33.191677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:33.191677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:33.192583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:33.192583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:33.192583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:33.192583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:33.192583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:33.192583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:33.192583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:33.192583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:33.192583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:33.192583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:33.192583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:33.192583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:33.192583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:33.192583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:33.192583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:33.192583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:33.193379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:33.193379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:33.193379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:33.193379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:33.193379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:33.193379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:33.193379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:33.193379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:33.193379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:33.193379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:33.193379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:33.193379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:33.193379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 170/322] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:33.199600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680199b-9730-40a6-aa48-f6759e689029 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:33.217033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 153/323] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:33.240429 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b82e2-cc49-4b80-87e8-943e0bfcb0fd None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:33.308013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:33.322431 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c680199b-9730-40a6-aa48-f6759e689029 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:33.349584 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:33.360239 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b82e2-cc49-4b80-87e8-943e0bfcb0fd None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:33.360507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149dcbd0-4919-484e-9c0a-158234dbb777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:33.361126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dcbd0-4919-484e-9c0a-158234dbb777 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:33.361396 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dcbd0-4919-484e-9c0a-158234dbb777 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:33.361666 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149dcbd0-4919-484e-9c0a-158234dbb777 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:33.362380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149dcbd0-4919-484e-9c0a-158234dbb777 None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:33.362674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149dcbd0-4919-484e-9c0a-158234dbb777 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:33.364023 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149dcbd0-4919-484e-9c0a-158234dbb777 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:33.372868 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 171/324] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:33.377690 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce3848-7aa1-4672-9e1b-6133fbc1185b None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:33.378003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce3848-7aa1-4672-9e1b-6133fbc1185b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:33.378277 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce3848-7aa1-4672-9e1b-6133fbc1185b None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:33.379572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 172/325] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:33.380251 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce3848-7aa1-4672-9e1b-6133fbc1185b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:33.394685 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4f4cb-7eb4-47c8-bffe-6d04877103e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:33.395331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4f4cb-7eb4-47c8-bffe-6d04877103e3 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:33.395617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4f4cb-7eb4-47c8-bffe-6d04877103e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:33.395895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4f4cb-7eb4-47c8-bffe-6d04877103e3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:33.397075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4f4cb-7eb4-47c8-bffe-6d04877103e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:33.398537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4f4cb-7eb4-47c8-bffe-6d04877103e3 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:33.400504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 154/326] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:33.401621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f1658-c714-4233-b244-3e63bf6c1975 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:33.401910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f1658-c714-4233-b244-3e63bf6c1975 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:33.402187 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f1658-c714-4233-b244-3e63bf6c1975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:33.420436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-0b6f1658-c714-4233-b244-3e63bf6c1975 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:33.421658 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-0b6f1658-c714-4233-b244-3e63bf6c1975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:33.487063 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbce3848-7aa1-4672-9e1b-6133fbc1185b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:33.487243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 155/327] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:33.487921 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f1658-c714-4233-b244-3e63bf6c1975 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:33.522928 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe239f78-eca8-482a-a6cd-5332c8332aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:33.523569 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe239f78-eca8-482a-a6cd-5332c8332aeb None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:33.523886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe239f78-eca8-482a-a6cd-5332c8332aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:33.524164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe239f78-eca8-482a-a6cd-5332c8332aeb None admin] PATH_INFO: `/v3/users/844bd5217bdd4719a867aeef56cd28fe` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:33.525347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe239f78-eca8-482a-a6cd-5332c8332aeb None admin] RBAC: Authorizing `identity:get_user(user_id=844bd5217bdd4719a867aeef56cd28fe)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:33.526778 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe239f78-eca8-482a-a6cd-5332c8332aeb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:33.533256 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 173/328] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:33 2022] GET /identity/v3/users/844bd5217bdd4719a867aeef56cd28fe => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:33.533256 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe239f78-eca8-482a-a6cd-5332c8332aeb None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:33.551082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:33.584718 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:33.595016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f1658-c714-4233-b244-3e63bf6c1975 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:33.628870 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c3c20-6a8a-4633-bf8b-bdaffadb1026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:33.629487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c3c20-6a8a-4633-bf8b-bdaffadb1026 None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:33.629765 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c3c20-6a8a-4633-bf8b-bdaffadb1026 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:33.630044 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c3c20-6a8a-4633-bf8b-bdaffadb1026 None admin] PATH_INFO: `/v3/groups` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:33.630701 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c3c20-6a8a-4633-bf8b-bdaffadb1026 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:33.632141 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c3c20-6a8a-4633-bf8b-bdaffadb1026 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:33.632720 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe239f78-eca8-482a-a6cd-5332c8332aeb None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:33.647740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 156/329] 10.222.0.85 () {60 vars in 1134 bytes} [Tue Aug 2 09:57:33 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:57:33.649499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c3c20-6a8a-4633-bf8b-bdaffadb1026 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:33.675160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f5841-d645-413a-9fa6-346e2c985e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:33.675869 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f5841-d645-413a-9fa6-346e2c985e56 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:33.676158 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f5841-d645-413a-9fa6-346e2c985e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:33.676509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f5841-d645-413a-9fa6-346e2c985e56 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:33.690109 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f5841-d645-413a-9fa6-346e2c985e56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:33.696989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-cb4f5841-d645-413a-9fa6-346e2c985e56 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:57:33.696989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:33.696989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:33.696989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:33.696989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:33.696989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:33.696989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:33.696989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:33.696989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:33.696989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:33.696989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:33.696989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:33.696989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:33.696989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:33.696989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:33.696989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:33.697982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:33.697982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:33.697982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:33.697982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:33.697982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:33.697982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:33.697982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:33.697982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:33.697982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:33.697982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:33.697982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:33.697982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:33.697982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:33.697982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:33.697982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:33.697982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:33.698801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:33.698801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:33.698801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:33.698801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:33.698801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:33.698801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:33.698801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:33.698801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:33.698801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:33.698801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:33.698801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:57:33.698801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:33.698801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 174/330] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:33.704401 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f5841-d645-413a-9fa6-346e2c985e56 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:33.770586 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c3c20-6a8a-4633-bf8b-bdaffadb1026 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:33.797207 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:33.815954 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df935a-62a6-40fd-b731-c012c416bfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:33.816684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df935a-62a6-40fd-b731-c012c416bfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:33.818519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df935a-62a6-40fd-b731-c012c416bfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:33.818519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6df935a-62a6-40fd-b731-c012c416bfc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:33.818519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df935a-62a6-40fd-b731-c012c416bfc2 None admin] RBAC: Adding query filter params (role.id=a2d6e3ab7e054be982bc78ce3c0a9748, user.id=844bd5217bdd4719a867aeef56cd28fe, scope.system=all) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:33.818735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df935a-62a6-40fd-b731-c012c416bfc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:33.820085 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6df935a-62a6-40fd-b731-c012c416bfc2 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:33.824246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f5841-d645-413a-9fa6-346e2c985e56 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:33.834213 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 157/331] 10.222.0.85 () {56 vars in 1308 bytes} [Tue Aug 2 09:57:33 2022] GET /identity/v3/role_assignments?user.id=844bd5217bdd4719a867aeef56cd28fe&scope.system=all&role.id=a2d6e3ab7e054be982bc78ce3c0a9748 => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:33.863911 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a79524-1b1b-4957-9b13-762bec2eb873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:33.864581 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a79524-1b1b-4957-9b13-762bec2eb873 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:33.864970 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a79524-1b1b-4957-9b13-762bec2eb873 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:33.865271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a79524-1b1b-4957-9b13-762bec2eb873 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:33.866863 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a79524-1b1b-4957-9b13-762bec2eb873 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:33.866863 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a79524-1b1b-4957-9b13-762bec2eb873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:33.868478 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a79524-1b1b-4957-9b13-762bec2eb873 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:33.878673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 175/332] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:33.885315 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df935a-62a6-40fd-b731-c012c416bfc2 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:33.900820 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:34.012530 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6df935a-62a6-40fd-b731-c012c416bfc2 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:34.050763 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd36c9-33cd-4ca9-b781-dbf4379efa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:34.051389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd36c9-33cd-4ca9-b781-dbf4379efa4f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:34.051671 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd36c9-33cd-4ca9-b781-dbf4379efa4f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:34.051942 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd36c9-33cd-4ca9-b781-dbf4379efa4f None admin] PATH_INFO: `/v3/users/920abe704b8e49a59d7271751f85877e` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:34.053154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd36c9-33cd-4ca9-b781-dbf4379efa4f None admin] RBAC: Authorizing `identity:get_user(user_id=920abe704b8e49a59d7271751f85877e)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:34.054605 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfd36c9-33cd-4ca9-b781-dbf4379efa4f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:34.057166 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 158/333] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:33 2022] GET /identity/v3/users/920abe704b8e49a59d7271751f85877e => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:34.062689 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a79524-1b1b-4957-9b13-762bec2eb873 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:34.174118 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a79524-1b1b-4957-9b13-762bec2eb873 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:34.210665 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c677e789-c277-4130-9bd0-19151d7bed5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:34.211588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677e789-c277-4130-9bd0-19151d7bed5f None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:34.211939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677e789-c277-4130-9bd0-19151d7bed5f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:34.212222 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c677e789-c277-4130-9bd0-19151d7bed5f None admin] PATH_INFO: `/v3/system/users/920abe704b8e49a59d7271751f85877e/roles/3c4094b115cb4252aec1c29de8391a07` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:34.213741 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677e789-c277-4130-9bd0-19151d7bed5f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=920abe704b8e49a59d7271751f85877e, role_id=3c4094b115cb4252aec1c29de8391a07)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:34.215125 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c677e789-c277-4130-9bd0-19151d7bed5f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:34.226299 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 176/334] 10.222.0.85 () {58 vars in 1334 bytes} [Tue Aug 2 09:57:34 2022] PUT /identity/v3/system/users/920abe704b8e49a59d7271751f85877e/roles/3c4094b115cb4252aec1c29de8391a07 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:57:36.112784 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156142d-6c58-4661-b8e8-143315e3803a None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:36.113312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156142d-6c58-4661-b8e8-143315e3803a None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:36.113312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156142d-6c58-4661-b8e8-143315e3803a None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:36.114692 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 159/335] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:36.120264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75693745-aa34-47da-b153-83fdea339dbb None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:36.120716 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75693745-aa34-47da-b153-83fdea339dbb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:36.120889 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75693745-aa34-47da-b153-83fdea339dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:36.131253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:36.144731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-75693745-aa34-47da-b153-83fdea339dbb None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:36.145985 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-75693745-aa34-47da-b153-83fdea339dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:36.239832 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 177/336] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:36.278724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156142d-6c58-4661-b8e8-143315e3803a None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:36.377386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:36.405780 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156142d-6c58-4661-b8e8-143315e3803a None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:36.450016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd51821-eed8-4bed-b258-07b6e50d9561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:36.450660 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd51821-eed8-4bed-b258-07b6e50d9561 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:36.450943 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd51821-eed8-4bed-b258-07b6e50d9561 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:36.451219 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd51821-eed8-4bed-b258-07b6e50d9561 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:36.472067 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb8a47-5253-42f9-8f22-ca527a628e7d None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:36.472381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb8a47-5253-42f9-8f22-ca527a628e7d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:36.472652 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb8a47-5253-42f9-8f22-ca527a628e7d None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:36.474065 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 178/337] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:57:36.474931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd51821-eed8-4bed-b258-07b6e50d9561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:36.480088 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b04f31-b9c5-46dd-b00a-99f648ffd59b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:36.480380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b04f31-b9c5-46dd-b00a-99f648ffd59b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:36.480686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b04f31-b9c5-46dd-b00a-99f648ffd59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:36.481165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-5bd51821-eed8-4bed-b258-07b6e50d9561 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:36.481165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:36.481165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:36.481165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:36.481165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:36.481165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:36.481165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:36.481165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:36.481165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:36.481165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:36.481165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:36.481165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:36.481165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:36.481165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:36.481165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:36.481165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:36.482024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:36.482024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:36.482024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:36.482024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:36.482024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:36.482024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:36.482024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:36.482024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:36.482024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:36.482024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:36.482024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:36.482024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:36.482024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:36.482024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:36.482024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:36.482024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:36.483096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:36.483096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:36.483096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:36.483096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:36.483096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:36.483096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:36.483096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:36.483096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:36.483096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:36.483096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:36.483096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:36.483096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:36.483096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 160/338] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:36.493518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd51821-eed8-4bed-b258-07b6e50d9561 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:36.502363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b2b04f31-b9c5-46dd-b00a-99f648ffd59b None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:36.503589 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b2b04f31-b9c5-46dd-b00a-99f648ffd59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:36.583584 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 179/339] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:36.610204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c29c6-6df0-41a7-9e21-5564ba8c1792 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:36.610502 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c29c6-6df0-41a7-9e21-5564ba8c1792 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:36.610774 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c29c6-6df0-41a7-9e21-5564ba8c1792 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:36.612188 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 180/340] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:36.612975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c29c6-6df0-41a7-9e21-5564ba8c1792 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:36.632584 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd51821-eed8-4bed-b258-07b6e50d9561 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:36.675598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153aecf4-7d63-4a22-9399-cc3c9a76646f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:36.678088 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153aecf4-7d63-4a22-9399-cc3c9a76646f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:36.678376 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153aecf4-7d63-4a22-9399-cc3c9a76646f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:36.678651 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153aecf4-7d63-4a22-9399-cc3c9a76646f None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:36.681599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153aecf4-7d63-4a22-9399-cc3c9a76646f None admin] RBAC: Adding query filter params (name=member) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:36.683747 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153aecf4-7d63-4a22-9399-cc3c9a76646f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:36.685882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153aecf4-7d63-4a22-9399-cc3c9a76646f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:36.691481 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:36.707107 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 161/341] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:36.711617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dc096-ed54-4ca5-9161-c684a51acf11 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:36.711904 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dc096-ed54-4ca5-9161-c684a51acf11 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:36.712181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dc096-ed54-4ca5-9161-c684a51acf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:36.750680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-ba3dc096-ed54-4ca5-9161-c684a51acf11 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:36.751880 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ba3dc096-ed54-4ca5-9161-c684a51acf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:36.768887 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:36.851119 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 162/342] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:36.852242 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dc096-ed54-4ca5-9161-c684a51acf11 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:36.890092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c29c6-6df0-41a7-9e21-5564ba8c1792 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:36.969174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb0836-345f-42d0-afd2-fd790d67a261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:36.969868 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb0836-345f-42d0-afd2-fd790d67a261 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:36.970147 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb0836-345f-42d0-afd2-fd790d67a261 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:36.970419 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acb0836-345f-42d0-afd2-fd790d67a261 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:36.986650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dc096-ed54-4ca5-9161-c684a51acf11 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:36.994030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acb0836-345f-42d0-afd2-fd790d67a261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:36.999018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-9acb0836-345f-42d0-afd2-fd790d67a261 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:36.999018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:36.999018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:36.999018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:36.999018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:36.999018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:36.999018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:36.999018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:36.999018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:36.999018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:36.999018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:36.999018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:36.999018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:36.999018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:36.999018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:36.999018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:36.999910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:36.999910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:36.999910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:36.999910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:36.999910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:36.999910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:36.999910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:36.999910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:36.999910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:36.999910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:36.999910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:36.999910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:36.999910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:36.999910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:36.999910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:36.999910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:37.000967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:37.000967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:37.000967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:37.000967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:37.000967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:37.000967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:37.000967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:37.000967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:37.000967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:37.000967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:37.000967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:37.000967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:37.000967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 181/343] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:57:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:37.001631 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb0836-345f-42d0-afd2-fd790d67a261 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:37.018882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:37.026479 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e9d07-488d-42b5-8404-3f04454e7b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:37.028031 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e9d07-488d-42b5-8404-3f04454e7b6b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:37.028373 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e9d07-488d-42b5-8404-3f04454e7b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:37.029541 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e9d07-488d-42b5-8404-3f04454e7b6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:37.125530 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e9d07-488d-42b5-8404-3f04454e7b6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:37.127681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e9d07-488d-42b5-8404-3f04454e7b6b None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:37.137578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acb0836-345f-42d0-afd2-fd790d67a261 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:37.173302 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:37.188221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07168e9-d9d8-413c-a17a-af13c6d8d462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:37.189282 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07168e9-d9d8-413c-a17a-af13c6d8d462 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:37.189568 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07168e9-d9d8-413c-a17a-af13c6d8d462 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:37.189844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07168e9-d9d8-413c-a17a-af13c6d8d462 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:37.205006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07168e9-d9d8-413c-a17a-af13c6d8d462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:37.212390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e07168e9-d9d8-413c-a17a-af13c6d8d462 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:37.212390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:37.212390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:37.212390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:37.212390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:37.212390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:37.212390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:37.212390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:37.212390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:37.212390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:37.212390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:37.212390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:37.212390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:37.212390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:37.212390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:37.212390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:37.213345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:37.213345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:37.213345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:37.213345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:37.213345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:37.213345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:37.213345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:37.213345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:37.213345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:37.213345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:37.213345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:37.213345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:37.213345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:37.213345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:37.213345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:37.213345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:37.215021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:37.215021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:37.215021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:37.215021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:37.215021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:37.215021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:37.215021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:37.215021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:37.215021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:37.215021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:37.215021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:37.215021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:37.215021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 182/344] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:37.216874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07168e9-d9d8-413c-a17a-af13c6d8d462 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:37.254574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 163/345] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:37.257328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47b4d3-6d4a-4167-bbe6-d1c2a6af2772 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:37.257680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47b4d3-6d4a-4167-bbe6-d1c2a6af2772 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:37.257956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47b4d3-6d4a-4167-bbe6-d1c2a6af2772 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:37.259373 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 164/346] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:37.260174 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47b4d3-6d4a-4167-bbe6-d1c2a6af2772 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:37.297501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:37.360967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07168e9-d9d8-413c-a17a-af13c6d8d462 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:37.399126 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47b4d3-6d4a-4167-bbe6-d1c2a6af2772 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:37.404990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac530c7-85ec-474b-b93f-c715629920be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:37.405611 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac530c7-85ec-474b-b93f-c715629920be None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:37.405888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac530c7-85ec-474b-b93f-c715629920be None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:37.406164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac530c7-85ec-474b-b93f-c715629920be None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:37.406879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac530c7-85ec-474b-b93f-c715629920be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:37.407179 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac530c7-85ec-474b-b93f-c715629920be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:37.408570 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac530c7-85ec-474b-b93f-c715629920be None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:37.423538 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 183/347] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:57:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:37.424397 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac530c7-85ec-474b-b93f-c715629920be None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:37.447033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f81ea-dcdf-49ac-bf0c-c4b89b779393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:37.447989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f81ea-dcdf-49ac-bf0c-c4b89b779393 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:37.448416 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f81ea-dcdf-49ac-bf0c-c4b89b779393 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:37.448914 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f81ea-dcdf-49ac-bf0c-c4b89b779393 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:37.450344 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f81ea-dcdf-49ac-bf0c-c4b89b779393 None admin] RBAC: Adding query filter params (name=member) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:37.450810 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f81ea-dcdf-49ac-bf0c-c4b89b779393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:37.452829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f81ea-dcdf-49ac-bf0c-c4b89b779393 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:37.466016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 165/348] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:37.466797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8af143-8179-40d1-92f3-f26724d9b09b None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:37.467081 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8af143-8179-40d1-92f3-f26724d9b09b None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:37.467354 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8af143-8179-40d1-92f3-f26724d9b09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:37.490449 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:37.494225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-ba8af143-8179-40d1-92f3-f26724d9b09b None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:37.496094 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ba8af143-8179-40d1-92f3-f26724d9b09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:37.559041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac530c7-85ec-474b-b93f-c715629920be None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:37.592556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 166/349] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:37.593737 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8af143-8179-40d1-92f3-f26724d9b09b None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:37.606134 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38997d6-4d88-4fd1-a6db-832ff4d3db27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:37.607059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38997d6-4d88-4fd1-a6db-832ff4d3db27 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:37.607168 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38997d6-4d88-4fd1-a6db-832ff4d3db27 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:37.607426 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38997d6-4d88-4fd1-a6db-832ff4d3db27 None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:37.610614 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38997d6-4d88-4fd1-a6db-832ff4d3db27 None admin] RBAC: Authorizing `identity:get_project(project_id=20f771efd436479ebbfe994b525b28dc)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:37.612204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38997d6-4d88-4fd1-a6db-832ff4d3db27 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:37.614209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 184/350] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:37 2022] GET /identity/v3/projects/20f771efd436479ebbfe994b525b28dc => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:37.615281 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38997d6-4d88-4fd1-a6db-832ff4d3db27 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:37.618472 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:37.721032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8af143-8179-40d1-92f3-f26724d9b09b None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:37.741886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38997d6-4d88-4fd1-a6db-832ff4d3db27 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:37.756411 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:37.760585 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5810e-fc19-4698-aa1e-ef1da9c8a41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:37.761766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5810e-fc19-4698-aa1e-ef1da9c8a41d None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:37.762248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5810e-fc19-4698-aa1e-ef1da9c8a41d None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:37.762739 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5810e-fc19-4698-aa1e-ef1da9c8a41d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:37.798063 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd55596-06a0-4626-bf5e-ba643b55dc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:37.798690 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd55596-06a0-4626-bf5e-ba643b55dc0b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:37.798969 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd55596-06a0-4626-bf5e-ba643b55dc0b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:37.799241 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd55596-06a0-4626-bf5e-ba643b55dc0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:37.836996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5810e-fc19-4698-aa1e-ef1da9c8a41d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:37.838840 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5810e-fc19-4698-aa1e-ef1da9c8a41d None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:37.862369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:37.890608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd55596-06a0-4626-bf5e-ba643b55dc0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:37.893474 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd55596-06a0-4626-bf5e-ba643b55dc0b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:37.970311 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 167/351] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:37.971583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5810e-fc19-4698-aa1e-ef1da9c8a41d None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:38.043372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 185/352] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:38.044531 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd55596-06a0-4626-bf5e-ba643b55dc0b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:38.067409 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:38.110463 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5810e-fc19-4698-aa1e-ef1da9c8a41d None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:38.134724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:38.161640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babe8cd-9648-42cf-b1c0-a92bde337fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:38.162289 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babe8cd-9648-42cf-b1c0-a92bde337fbf None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:38.162573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babe8cd-9648-42cf-b1c0-a92bde337fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:38.162956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babe8cd-9648-42cf-b1c0-a92bde337fbf None admin] PATH_INFO: `/v3/groups/36f39ddbfde94ebfa23871c68389822b` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:38.169817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babe8cd-9648-42cf-b1c0-a92bde337fbf None admin] RBAC: Authorizing `identity:get_group(group_id=36f39ddbfde94ebfa23871c68389822b)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:38.171269 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babe8cd-9648-42cf-b1c0-a92bde337fbf None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:38.173255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 168/353] 10.222.0.85 () {56 vars in 1180 bytes} [Tue Aug 2 09:57:37 2022] GET /identity/v3/groups/36f39ddbfde94ebfa23871c68389822b => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:38.181457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf739ce7-8165-4589-8611-6c9bfd9e0603 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:38.181457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf739ce7-8165-4589-8611-6c9bfd9e0603 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:38.181457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf739ce7-8165-4589-8611-6c9bfd9e0603 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:38.185476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 169/354] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:38.185476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf739ce7-8165-4589-8611-6c9bfd9e0603 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:38.185650 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd55596-06a0-4626-bf5e-ba643b55dc0b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:38.229742 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c90e96-cf21-426a-82f2-f3fbe04a96d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:38.230303 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c90e96-cf21-426a-82f2-f3fbe04a96d9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:38.230592 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c90e96-cf21-426a-82f2-f3fbe04a96d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:38.230866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c90e96-cf21-426a-82f2-f3fbe04a96d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:38.242335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c90e96-cf21-426a-82f2-f3fbe04a96d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:38.247360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e9c90e96-cf21-426a-82f2-f3fbe04a96d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:57:38.247360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:38.247360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:38.247360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:38.247360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:38.247360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:38.247360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:38.247360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:38.247360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:38.247360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:38.247360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:38.247360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:38.247360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:38.247360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:38.247360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:38.247360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:38.248293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:38.248293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:38.248293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:38.248293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:38.248293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:38.248293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:38.248293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:38.248293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:38.248293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:38.248293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:38.248293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:38.248293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:38.248293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:38.248293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:38.248293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:38.248293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:38.249103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:38.249103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:38.249103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:38.249103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:38.249103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:38.249103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:38.249103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:38.249103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:38.249103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:38.249103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:38.249103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 09:57:38.249103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:38.249103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 186/355] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:38.249768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c90e96-cf21-426a-82f2-f3fbe04a96d9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:38.330142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf739ce7-8165-4589-8611-6c9bfd9e0603 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:38.347146 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:38.373832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08999970-6725-4651-ac25-8aebec08556a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:38.374533 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08999970-6725-4651-ac25-8aebec08556a None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:38.374819 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08999970-6725-4651-ac25-8aebec08556a None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:38.375096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08999970-6725-4651-ac25-8aebec08556a None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:38.376379 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08999970-6725-4651-ac25-8aebec08556a None admin] RBAC: Authorizing `identity:get_project(project_id=20f771efd436479ebbfe994b525b28dc)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:38.379220 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08999970-6725-4651-ac25-8aebec08556a None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:38.380535 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c90e96-cf21-426a-82f2-f3fbe04a96d9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:38.381137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 170/356] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:38 2022] GET /identity/v3/projects/20f771efd436479ebbfe994b525b28dc => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:38.384520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08999970-6725-4651-ac25-8aebec08556a None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:38.423185 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40be3a4-0008-4988-9da1-1f46c1adae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:38.423836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40be3a4-0008-4988-9da1-1f46c1adae4d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:38.424117 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40be3a4-0008-4988-9da1-1f46c1adae4d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:38.424393 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40be3a4-0008-4988-9da1-1f46c1adae4d None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:38.425693 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40be3a4-0008-4988-9da1-1f46c1adae4d None admin] RBAC: Authorizing `identity:get_project(project_id=ef582d6737c842c69928f69bab3e3cf3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:38.427285 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40be3a4-0008-4988-9da1-1f46c1adae4d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:38.429840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 187/357] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:38 2022] GET /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:38.430853 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc907a88-bb8e-4a59-83ee-148ee068cd6e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:38.431145 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc907a88-bb8e-4a59-83ee-148ee068cd6e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:38.431456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc907a88-bb8e-4a59-83ee-148ee068cd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:38.448429 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:38.454027 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-cc907a88-bb8e-4a59-83ee-148ee068cd6e None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:38.454849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cc907a88-bb8e-4a59-83ee-148ee068cd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:38.509557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08999970-6725-4651-ac25-8aebec08556a None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:38.545734 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 188/358] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:38.546773 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc907a88-bb8e-4a59-83ee-148ee068cd6e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:38.559743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bb63e-1f65-4b9c-ab06-e3fe533974ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:38.560368 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bb63e-1f65-4b9c-ab06-e3fe533974ce None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:38.560726 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bb63e-1f65-4b9c-ab06-e3fe533974ce None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:38.561012 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bb63e-1f65-4b9c-ab06-e3fe533974ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:38.561806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304bb63e-1f65-4b9c-ab06-e3fe533974ce None admin] RBAC: Adding query filter params (group.id=36f39ddbfde94ebfa23871c68389822b, role.id=a2d6e3ab7e054be982bc78ce3c0a9748, scope.project.id=20f771efd436479ebbfe994b525b28dc) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:38.562118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304bb63e-1f65-4b9c-ab06-e3fe533974ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:38.563571 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304bb63e-1f65-4b9c-ab06-e3fe533974ce None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:38.571886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 171/359] 10.222.0.85 () {56 vars in 1376 bytes} [Tue Aug 2 09:57:38 2022] GET /identity/v3/role_assignments?group.id=36f39ddbfde94ebfa23871c68389822b&scope.project.id=20f771efd436479ebbfe994b525b28dc&role.id=a2d6e3ab7e054be982bc78ce3c0a9748 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:38.573151 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca4015-e2b2-42c4-a3d0-ecc9631ce924 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:38.573442 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca4015-e2b2-42c4-a3d0-ecc9631ce924 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:38.573720 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca4015-e2b2-42c4-a3d0-ecc9631ce924 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:38.575110 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 172/360] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:38.582308 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca4015-e2b2-42c4-a3d0-ecc9631ce924 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:38.645636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:38.698067 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc907a88-bb8e-4a59-83ee-148ee068cd6e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:38.728022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca4015-e2b2-42c4-a3d0-ecc9631ce924 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:38.742724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aec604-d338-4f72-bc9f-5f0302fd5425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:38.743975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aec604-d338-4f72-bc9f-5f0302fd5425 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:38.743975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aec604-d338-4f72-bc9f-5f0302fd5425 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:38.743975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aec604-d338-4f72-bc9f-5f0302fd5425 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:38.746251 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aec604-d338-4f72-bc9f-5f0302fd5425 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:38.746251 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aec604-d338-4f72-bc9f-5f0302fd5425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:38.746251 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aec604-d338-4f72-bc9f-5f0302fd5425 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:38.750516 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:38.757793 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 189/361] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:38.758663 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aec604-d338-4f72-bc9f-5f0302fd5425 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:38.775243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a401188-5eaa-460d-a92a-da3083e36137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:38.775864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a401188-5eaa-460d-a92a-da3083e36137 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:38.776155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a401188-5eaa-460d-a92a-da3083e36137 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:38.776433 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a401188-5eaa-460d-a92a-da3083e36137 None admin] PATH_INFO: `/v3/groups/36f39ddbfde94ebfa23871c68389822b` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:38.777890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a401188-5eaa-460d-a92a-da3083e36137 None admin] RBAC: Authorizing `identity:get_group(group_id=36f39ddbfde94ebfa23871c68389822b)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:38.779361 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a401188-5eaa-460d-a92a-da3083e36137 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:38.782875 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 173/362] 10.222.0.85 () {56 vars in 1180 bytes} [Tue Aug 2 09:57:38 2022] GET /identity/v3/groups/36f39ddbfde94ebfa23871c68389822b => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:38.782875 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a401188-5eaa-460d-a92a-da3083e36137 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:38.895338 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aec604-d338-4f72-bc9f-5f0302fd5425 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:38.923077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a401188-5eaa-460d-a92a-da3083e36137 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:38.939436 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237861d-458c-4e78-97a4-4f635f09d61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:38.940087 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237861d-458c-4e78-97a4-4f635f09d61f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:38.940366 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237861d-458c-4e78-97a4-4f635f09d61f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:38.940684 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237861d-458c-4e78-97a4-4f635f09d61f None admin] PATH_INFO: `/v3/groups/36f39ddbfde94ebfa23871c68389822b` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:38.941865 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237861d-458c-4e78-97a4-4f635f09d61f None admin] RBAC: Authorizing `identity:get_group(group_id=36f39ddbfde94ebfa23871c68389822b)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:38.943309 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237861d-458c-4e78-97a4-4f635f09d61f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:38.949963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 190/363] 10.222.0.85 () {56 vars in 1180 bytes} [Tue Aug 2 09:57:38 2022] GET /identity/v3/groups/36f39ddbfde94ebfa23871c68389822b => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:38.949963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9764ee-64b8-4b78-9998-404807d7f6eb None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:38.949963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9764ee-64b8-4b78-9998-404807d7f6eb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:38.949963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9764ee-64b8-4b78-9998-404807d7f6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:38.955079 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:38.969838 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7b9764ee-64b8-4b78-9998-404807d7f6eb None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:38.971125 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7b9764ee-64b8-4b78-9998-404807d7f6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:38.972431 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40416214-7cf5-47f5-b5cd-a9965a5c161d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:38.973251 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40416214-7cf5-47f5-b5cd-a9965a5c161d None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:38.973781 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40416214-7cf5-47f5-b5cd-a9965a5c161d None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:38.974193 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40416214-7cf5-47f5-b5cd-a9965a5c161d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:38.988301 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40416214-7cf5-47f5-b5cd-a9965a5c161d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:38.995211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-40416214-7cf5-47f5-b5cd-a9965a5c161d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:38.995211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:38.995211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:38.995211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:38.995211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:38.995211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:38.995211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:38.995211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:38.995211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:38.995211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:38.995211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:38.995211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:38.995211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:38.995211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:38.995211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:38.995211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:38.996122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:38.996122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:38.996122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:38.996122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:38.996122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:38.996122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:38.996122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:38.996122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:38.996122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:38.996122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:38.996122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:38.996122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:38.996122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:38.996122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:38.996122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:38.996122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:38.996955 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:38.996955 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:38.996955 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:38.996955 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:38.996955 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:38.996955 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:38.996955 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:38.996955 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:38.996955 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:38.996955 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:38.996955 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:38.996955 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:39.000627 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 174/364] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:57:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:39.002240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40416214-7cf5-47f5-b5cd-a9965a5c161d None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:39.064240 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 191/365] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:39.065091 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9764ee-64b8-4b78-9998-404807d7f6eb None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:39.071128 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:39.155160 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40416214-7cf5-47f5-b5cd-a9965a5c161d None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:39.200403 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c04ca8-5e61-411c-a1f3-a197a7ba7517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:39.201125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c04ca8-5e61-411c-a1f3-a197a7ba7517 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:39.201228 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9764ee-64b8-4b78-9998-404807d7f6eb None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:39.202836 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c04ca8-5e61-411c-a1f3-a197a7ba7517 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:39.202836 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c04ca8-5e61-411c-a1f3-a197a7ba7517 None admin] PATH_INFO: `/v3/users/920abe704b8e49a59d7271751f85877e` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:39.203085 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c04ca8-5e61-411c-a1f3-a197a7ba7517 None admin] RBAC: Authorizing `identity:get_user(user_id=920abe704b8e49a59d7271751f85877e)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:39.212288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c04ca8-5e61-411c-a1f3-a197a7ba7517 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:39.212288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 175/366] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:57:39 2022] GET /identity/v3/users/920abe704b8e49a59d7271751f85877e => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:39.212288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c04ca8-5e61-411c-a1f3-a197a7ba7517 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:39.238426 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:39.244300 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96034555-cb96-40ad-ada7-98b315577250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:39.245560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96034555-cb96-40ad-ada7-98b315577250 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:39.246133 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96034555-cb96-40ad-ada7-98b315577250 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:39.246424 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96034555-cb96-40ad-ada7-98b315577250 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:39.247244 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96034555-cb96-40ad-ada7-98b315577250 None admin] RBAC: Adding query filter params (group.id=36f39ddbfde94ebfa23871c68389822b, role.id=cbb81f88446a46f38469b450c5f24624, scope.project.id=20f771efd436479ebbfe994b525b28dc) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:39.248684 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96034555-cb96-40ad-ada7-98b315577250 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:39.251005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96034555-cb96-40ad-ada7-98b315577250 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:39.259244 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 192/367] 10.222.0.85 () {56 vars in 1376 bytes} [Tue Aug 2 09:57:39 2022] GET /identity/v3/role_assignments?group.id=36f39ddbfde94ebfa23871c68389822b&scope.project.id=20f771efd436479ebbfe994b525b28dc&role.id=cbb81f88446a46f38469b450c5f24624 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:39.260515 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96034555-cb96-40ad-ada7-98b315577250 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:39.347428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c04ca8-5e61-411c-a1f3-a197a7ba7517 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:39.362806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:39.391409 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435f672-8341-4b6d-bc36-68ef97331e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:39.392049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435f672-8341-4b6d-bc36-68ef97331e44 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:39.392339 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435f672-8341-4b6d-bc36-68ef97331e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:39.392661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435f672-8341-4b6d-bc36-68ef97331e44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:39.392862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96034555-cb96-40ad-ada7-98b315577250 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:39.393477 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435f672-8341-4b6d-bc36-68ef97331e44 None admin] RBAC: Adding query filter params (group.id=36f39ddbfde94ebfa23871c68389822b, role.id=a2d6e3ab7e054be982bc78ce3c0a9748, scope.project.id=ef582d6737c842c69928f69bab3e3cf3) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:39.393801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435f672-8341-4b6d-bc36-68ef97331e44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:39.396210 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435f672-8341-4b6d-bc36-68ef97331e44 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:39.403792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 176/368] 10.222.0.85 () {56 vars in 1376 bytes} [Tue Aug 2 09:57:39 2022] GET /identity/v3/role_assignments?group.id=36f39ddbfde94ebfa23871c68389822b&scope.project.id=ef582d6737c842c69928f69bab3e3cf3&role.id=a2d6e3ab7e054be982bc78ce3c0a9748 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:39.408884 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435f672-8341-4b6d-bc36-68ef97331e44 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:39.448243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815aec63-1593-4bc5-8f30-eec36bd93aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:39.448914 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aec63-1593-4bc5-8f30-eec36bd93aac None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:39.449199 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aec63-1593-4bc5-8f30-eec36bd93aac None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:39.449477 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aec63-1593-4bc5-8f30-eec36bd93aac None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:39.450211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815aec63-1593-4bc5-8f30-eec36bd93aac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:39.450577 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815aec63-1593-4bc5-8f30-eec36bd93aac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:39.452095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815aec63-1593-4bc5-8f30-eec36bd93aac None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:39.472163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 193/369] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:57:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:39.473207 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815aec63-1593-4bc5-8f30-eec36bd93aac None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:39.582384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435f672-8341-4b6d-bc36-68ef97331e44 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:39.632970 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:39.656755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24871f7-b0f8-4eaf-8b0b-1305669c27c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:39.657416 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24871f7-b0f8-4eaf-8b0b-1305669c27c1 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:39.657704 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24871f7-b0f8-4eaf-8b0b-1305669c27c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:39.657985 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24871f7-b0f8-4eaf-8b0b-1305669c27c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:39.681591 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24871f7-b0f8-4eaf-8b0b-1305669c27c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:39.683835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815aec63-1593-4bc5-8f30-eec36bd93aac None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:39.690683 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-d24871f7-b0f8-4eaf-8b0b-1305669c27c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:57:39.690683 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:39.690683 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:39.690683 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:39.690683 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:39.690683 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:39.690683 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:39.690683 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:39.690683 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:39.690683 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:39.690683 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:39.690683 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:39.690683 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:39.690683 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:39.690683 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:39.690683 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:39.691644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:39.691644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:39.691644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:39.691644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:39.691644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:39.691644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:39.691644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:39.691644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:39.691644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:39.691644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:39.691644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:39.691644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:39.691644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:39.691644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:39.691644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:39.691644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:39.692518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:39.692518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:39.692518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:39.692518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:39.692518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:39.692518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:39.692518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:39.692518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:39.692518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:39.692518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:39.692518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:57:39.692518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:39.692518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 177/370] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:57:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:39.693775 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24871f7-b0f8-4eaf-8b0b-1305669c27c1 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:39.759149 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42fab2-4226-4ee8-aca1-7f4097660630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:39.759780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42fab2-4226-4ee8-aca1-7f4097660630 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:39.760064 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42fab2-4226-4ee8-aca1-7f4097660630 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:39.760339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42fab2-4226-4ee8-aca1-7f4097660630 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:39.761184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42fab2-4226-4ee8-aca1-7f4097660630 None admin] RBAC: Adding query filter params (role.id=3c4094b115cb4252aec1c29de8391a07, user.id=920abe704b8e49a59d7271751f85877e, scope.system=all) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:39.761495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42fab2-4226-4ee8-aca1-7f4097660630 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:39.763212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42fab2-4226-4ee8-aca1-7f4097660630 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:39.781426 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:39.795111 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 194/371] 10.222.0.85 () {56 vars in 1308 bytes} [Tue Aug 2 09:57:39 2022] GET /identity/v3/role_assignments?user.id=920abe704b8e49a59d7271751f85877e&scope.system=all&role.id=3c4094b115cb4252aec1c29de8391a07 => generated 510 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:39.795982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42fab2-4226-4ee8-aca1-7f4097660630 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:39.944232 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24871f7-b0f8-4eaf-8b0b-1305669c27c1 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:39.948834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42fab2-4226-4ee8-aca1-7f4097660630 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:39.968999 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:40.000851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92632f-54cb-4d8a-b10b-99611ff43d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:40.001791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92632f-54cb-4d8a-b10b-99611ff43d07 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:40.002217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92632f-54cb-4d8a-b10b-99611ff43d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:40.002638 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92632f-54cb-4d8a-b10b-99611ff43d07 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:40.003944 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92632f-54cb-4d8a-b10b-99611ff43d07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:40.004617 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92632f-54cb-4d8a-b10b-99611ff43d07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:40.007696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92632f-54cb-4d8a-b10b-99611ff43d07 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:40.009218 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd4716-af9f-4297-b910-595269d8ebd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:40.009995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd4716-af9f-4297-b910-595269d8ebd6 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:40.010287 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd4716-af9f-4297-b910-595269d8ebd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:40.010566 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd4716-af9f-4297-b910-595269d8ebd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:40.028086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 195/372] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:40.035208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92632f-54cb-4d8a-b10b-99611ff43d07 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:40.116604 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd4716-af9f-4297-b910-595269d8ebd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:40.118556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd4716-af9f-4297-b910-595269d8ebd6 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:40.181386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:40.196857 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92632f-54cb-4d8a-b10b-99611ff43d07 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:40.241728 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb60f78-3e35-4f4e-90ad-de5e3c143dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:40.243146 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb60f78-3e35-4f4e-90ad-de5e3c143dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:40.243575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb60f78-3e35-4f4e-90ad-de5e3c143dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:40.244002 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb60f78-3e35-4f4e-90ad-de5e3c143dc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:40.313230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:40.346530 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 178/373] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:40.356029 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd4716-af9f-4297-b910-595269d8ebd6 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:40.360045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb60f78-3e35-4f4e-90ad-de5e3c143dc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:40.361550 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb60f78-3e35-4f4e-90ad-de5e3c143dc4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:40.508539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd4716-af9f-4297-b910-595269d8ebd6 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:40.533729 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 196/374] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 09:57:40.539641 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb60f78-3e35-4f4e-90ad-de5e3c143dc4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:40.590907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d063876-c44f-414c-bcfd-2d907e43e3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:40.591575 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d063876-c44f-414c-bcfd-2d907e43e3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:40.591862 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d063876-c44f-414c-bcfd-2d907e43e3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:40.592140 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d063876-c44f-414c-bcfd-2d907e43e3c4 None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:40.597819 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d063876-c44f-414c-bcfd-2d907e43e3c4 None admin] RBAC: Authorizing `identity:get_project(project_id=ef582d6737c842c69928f69bab3e3cf3)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:40.600575 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d063876-c44f-414c-bcfd-2d907e43e3c4 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:40.603719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 179/375] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:40 2022] GET /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:40.609684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d063876-c44f-414c-bcfd-2d907e43e3c4 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:40.616791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:40.666519 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:40.713255 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb60f78-3e35-4f4e-90ad-de5e3c143dc4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:40.770340 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d063876-c44f-414c-bcfd-2d907e43e3c4 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:40.811286 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0fe78-e3a7-49c8-8d35-7d57c55a1c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:40.812313 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0fe78-e3a7-49c8-8d35-7d57c55a1c84 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:40.812815 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0fe78-e3a7-49c8-8d35-7d57c55a1c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:40.813158 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31f5cf-f0da-4ffc-b372-5291cf33cbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:40.813529 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0fe78-e3a7-49c8-8d35-7d57c55a1c84 None admin] PATH_INFO: `/v3/groups/36f39ddbfde94ebfa23871c68389822b` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:40.813817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31f5cf-f0da-4ffc-b372-5291cf33cbbd None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:40.814102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31f5cf-f0da-4ffc-b372-5291cf33cbbd None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:40.814384 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31f5cf-f0da-4ffc-b372-5291cf33cbbd None admin] PATH_INFO: `/v3/projects/c3d1fabb05ac40668bd828447419da5a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:40.815611 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0fe78-e3a7-49c8-8d35-7d57c55a1c84 None admin] RBAC: Authorizing `identity:get_group(group_id=36f39ddbfde94ebfa23871c68389822b)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:40.815721 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31f5cf-f0da-4ffc-b372-5291cf33cbbd None admin] RBAC: Authorizing `identity:get_project(project_id=c3d1fabb05ac40668bd828447419da5a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:40.817144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31f5cf-f0da-4ffc-b372-5291cf33cbbd None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:40.817600 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0fe78-e3a7-49c8-8d35-7d57c55a1c84 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:40.819943 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 197/376] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:40 2022] GET /identity/v3/projects/c3d1fabb05ac40668bd828447419da5a => generated 344 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:40.821069 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 180/377] 10.222.0.85 () {56 vars in 1180 bytes} [Tue Aug 2 09:57:40 2022] GET /identity/v3/groups/36f39ddbfde94ebfa23871c68389822b => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:40.825023 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31f5cf-f0da-4ffc-b372-5291cf33cbbd None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:40.826611 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0fe78-e3a7-49c8-8d35-7d57c55a1c84 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:40.907579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:40.945027 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0fe78-e3a7-49c8-8d35-7d57c55a1c84 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:40.980597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31f5cf-f0da-4ffc-b372-5291cf33cbbd None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:40.997443 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb89fb3e-e3c5-4f0b-8b23-6e7628f1208c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:40.998470 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89fb3e-e3c5-4f0b-8b23-6e7628f1208c None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:40.998981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89fb3e-e3c5-4f0b-8b23-6e7628f1208c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:40.999464 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89fb3e-e3c5-4f0b-8b23-6e7628f1208c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:41.000543 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89fb3e-e3c5-4f0b-8b23-6e7628f1208c None admin] RBAC: Adding query filter params (group.id=36f39ddbfde94ebfa23871c68389822b, role.id=cbb81f88446a46f38469b450c5f24624, scope.project.id=ef582d6737c842c69928f69bab3e3cf3) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:41.001073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89fb3e-e3c5-4f0b-8b23-6e7628f1208c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:41.002769 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb89fb3e-e3c5-4f0b-8b23-6e7628f1208c None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:41.011204 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 181/378] 10.222.0.85 () {56 vars in 1376 bytes} [Tue Aug 2 09:57:40 2022] GET /identity/v3/role_assignments?group.id=36f39ddbfde94ebfa23871c68389822b&scope.project.id=ef582d6737c842c69928f69bab3e3cf3&role.id=cbb81f88446a46f38469b450c5f24624 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:41.029679 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da184f68-c5cd-4879-9b8d-fea6634b35ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:41.030377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da184f68-c5cd-4879-9b8d-fea6634b35ff None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:41.030673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da184f68-c5cd-4879-9b8d-fea6634b35ff None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:41.030955 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da184f68-c5cd-4879-9b8d-fea6634b35ff None admin] PATH_INFO: `/v3/groups/ec8c1bd6f62d41988248ccb1e0505669` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:41.032533 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4206a4-ec0a-4ac9-b828-9e977dcce0cf None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:41.032805 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4206a4-ec0a-4ac9-b828-9e977dcce0cf None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:41.033086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4206a4-ec0a-4ac9-b828-9e977dcce0cf None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:41.034795 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 182/379] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:41.041133 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fde1e-9739-402c-98f9-35996a6c8ea4 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:41.041479 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fde1e-9739-402c-98f9-35996a6c8ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:41.041697 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fde1e-9739-402c-98f9-35996a6c8ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:41.050896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da184f68-c5cd-4879-9b8d-fea6634b35ff None admin] RBAC: Authorizing `identity:get_group(group_id=ec8c1bd6f62d41988248ccb1e0505669)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:41.052392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da184f68-c5cd-4879-9b8d-fea6634b35ff None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:41.063579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 198/380] 10.222.0.85 () {56 vars in 1180 bytes} [Tue Aug 2 09:57:40 2022] GET /identity/v3/groups/ec8c1bd6f62d41988248ccb1e0505669 => generated 229 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:41.069987 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da184f68-c5cd-4879-9b8d-fea6634b35ff None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:41.075267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-a49fde1e-9739-402c-98f9-35996a6c8ea4 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:41.076512 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a49fde1e-9739-402c-98f9-35996a6c8ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:41.096719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:41.204487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 183/381] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:41.244954 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fde1e-9739-402c-98f9-35996a6c8ea4 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:41.261546 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da184f68-c5cd-4879-9b8d-fea6634b35ff None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:41.303885 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40367f-2a6d-4bf1-8c63-f4c5d1551235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:41.308530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40367f-2a6d-4bf1-8c63-f4c5d1551235 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:41.308530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40367f-2a6d-4bf1-8c63-f4c5d1551235 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:41.308530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40367f-2a6d-4bf1-8c63-f4c5d1551235 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:41.308530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40367f-2a6d-4bf1-8c63-f4c5d1551235 None admin] RBAC: Adding query filter params (group.id=ec8c1bd6f62d41988248ccb1e0505669, role.id=c15ca78eb3c9472f94e15e2d28c7f403, scope.project.id=c3d1fabb05ac40668bd828447419da5a) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:41.308530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40367f-2a6d-4bf1-8c63-f4c5d1551235 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:41.308530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40367f-2a6d-4bf1-8c63-f4c5d1551235 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:41.314358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 199/382] 10.222.0.85 () {56 vars in 1376 bytes} [Tue Aug 2 09:57:41 2022] GET /identity/v3/role_assignments?group.id=ec8c1bd6f62d41988248ccb1e0505669&scope.project.id=c3d1fabb05ac40668bd828447419da5a&role.id=c15ca78eb3c9472f94e15e2d28c7f403 => generated 260 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:41.384218 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:41.431440 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fde1e-9739-402c-98f9-35996a6c8ea4 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:41.477823 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379cde-6cb6-4097-b1c5-5aa5378f908c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:41.478796 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379cde-6cb6-4097-b1c5-5aa5378f908c None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:41.479243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379cde-6cb6-4097-b1c5-5aa5378f908c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:41.479661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379cde-6cb6-4097-b1c5-5aa5378f908c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:41.495097 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8379cde-6cb6-4097-b1c5-5aa5378f908c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:41.500549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-d8379cde-6cb6-4097-b1c5-5aa5378f908c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:41.500549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:41.500549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:41.500549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:41.500549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:41.500549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:41.500549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:41.500549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:41.500549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:41.500549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:41.500549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:41.500549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:41.500549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:41.500549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:41.500549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:41.500549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:41.501619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:41.501619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:41.501619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:41.501619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:41.501619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:41.501619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:41.501619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:41.501619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:41.501619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:41.501619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:41.501619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:41.501619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:41.501619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:41.501619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:41.501619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:41.501619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:41.502601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:41.502601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:41.502601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:41.502601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:41.502601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:41.502601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:41.502601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:41.502601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:41.502601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:41.502601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:41.502601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:41.502601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:41.504805 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 184/383] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:41.511387 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40367f-2a6d-4bf1-8c63-f4c5d1551235 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:41.638917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:41.676157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40367f-2a6d-4bf1-8c63-f4c5d1551235 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:41.723988 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30850cc0-9dec-428d-b48f-e81e050d0b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:41.725421 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30850cc0-9dec-428d-b48f-e81e050d0b0f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:41.726416 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30850cc0-9dec-428d-b48f-e81e050d0b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:41.726697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30850cc0-9dec-428d-b48f-e81e050d0b0f None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:41.728088 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30850cc0-9dec-428d-b48f-e81e050d0b0f None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:41.728395 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30850cc0-9dec-428d-b48f-e81e050d0b0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:41.729802 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30850cc0-9dec-428d-b48f-e81e050d0b0f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:41.746623 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 200/384] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:41.751149 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379cde-6cb6-4097-b1c5-5aa5378f908c None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:41.886619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379cde-6cb6-4097-b1c5-5aa5378f908c None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:41.915620 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:41.931659 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6822b7-bb28-4cec-a310-2da536054a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:41.932617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6822b7-bb28-4cec-a310-2da536054a0a None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:41.933041 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6822b7-bb28-4cec-a310-2da536054a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:41.933478 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6822b7-bb28-4cec-a310-2da536054a0a None admin] PATH_INFO: `/v3/groups/36f39ddbfde94ebfa23871c68389822b` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:41.934799 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6822b7-bb28-4cec-a310-2da536054a0a None admin] RBAC: Authorizing `identity:get_group(group_id=36f39ddbfde94ebfa23871c68389822b)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:41.936397 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6822b7-bb28-4cec-a310-2da536054a0a None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:41.938176 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 185/385] 10.222.0.85 () {56 vars in 1180 bytes} [Tue Aug 2 09:57:41 2022] GET /identity/v3/groups/36f39ddbfde94ebfa23871c68389822b => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:41.944494 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30850cc0-9dec-428d-b48f-e81e050d0b0f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:42.143373 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4196e8b-b503-4b79-bfa3-7cd8406f93dc None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:42.143658 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4196e8b-b503-4b79-bfa3-7cd8406f93dc None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:42.143966 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4196e8b-b503-4b79-bfa3-7cd8406f93dc None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:42.145577 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 186/386] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:42.157703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30850cc0-9dec-428d-b48f-e81e050d0b0f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:42.157865 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf74ebf-1ac4-41e6-b12a-22a475378e1d None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:42.158039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf74ebf-1ac4-41e6-b12a-22a475378e1d None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:42.158316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf74ebf-1ac4-41e6-b12a-22a475378e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:42.180261 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-1cf74ebf-1ac4-41e6-b12a-22a475378e1d None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:42.181486 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-1cf74ebf-1ac4-41e6-b12a-22a475378e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:42.231198 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd7fde-fda2-42a0-b7a2-d7e88bbf37ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:42.232197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd7fde-fda2-42a0-b7a2-d7e88bbf37ac None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:42.232692 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd7fde-fda2-42a0-b7a2-d7e88bbf37ac None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:42.233158 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd7fde-fda2-42a0-b7a2-d7e88bbf37ac None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:42.236875 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd7fde-fda2-42a0-b7a2-d7e88bbf37ac None admin] RBAC: Authorizing `identity:get_project(project_id=20f771efd436479ebbfe994b525b28dc)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:42.238633 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd7fde-fda2-42a0-b7a2-d7e88bbf37ac None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:42.241019 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 201/387] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:41 2022] GET /identity/v3/projects/20f771efd436479ebbfe994b525b28dc => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:42.246586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd7fde-fda2-42a0-b7a2-d7e88bbf37ac None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:42.253454 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:42.262809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 187/388] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:42.298008 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf74ebf-1ac4-41e6-b12a-22a475378e1d None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:42.416597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf74ebf-1ac4-41e6-b12a-22a475378e1d None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:42.422676 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd7fde-fda2-42a0-b7a2-d7e88bbf37ac None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:42.437530 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:42.452972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45829d1-51e2-4021-bf7e-7328521305d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:42.453613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45829d1-51e2-4021-bf7e-7328521305d8 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:42.453894 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45829d1-51e2-4021-bf7e-7328521305d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:42.454168 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45829d1-51e2-4021-bf7e-7328521305d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:42.476617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45829d1-51e2-4021-bf7e-7328521305d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:42.483961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-c45829d1-51e2-4021-bf7e-7328521305d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:42.483961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:42.483961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:42.483961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:42.483961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:42.483961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:42.483961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:42.483961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:42.483961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:42.483961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:42.483961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:42.483961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:42.483961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:42.483961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:42.483961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:42.483961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:42.484841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:42.484841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:42.484841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:42.484841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:42.484841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:42.484841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:42.484841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:42.484841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:42.484841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:42.484841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:42.484841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:42.484841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:42.484841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:42.484841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:42.484841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:42.484841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:42.485631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:42.485631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:42.485631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:42.485631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:42.485631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:42.485631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:42.485631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:42.485631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:42.485631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:42.485631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:42.485631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:42.485631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:42.486231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 188/389] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:57:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:42.491559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45829d1-51e2-4021-bf7e-7328521305d8 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:42.506854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29c7e0-9ce3-404f-b31a-098495905e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:42.507829 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29c7e0-9ce3-404f-b31a-098495905e5d None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:42.508164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29c7e0-9ce3-404f-b31a-098495905e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:42.508936 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29c7e0-9ce3-404f-b31a-098495905e5d None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc/groups/36f39ddbfde94ebfa23871c68389822b/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:42.510936 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29c7e0-9ce3-404f-b31a-098495905e5d None admin] RBAC: Authorizing `identity:create_grant(project_id=20f771efd436479ebbfe994b525b28dc, group_id=36f39ddbfde94ebfa23871c68389822b, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:42.512496 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29c7e0-9ce3-404f-b31a-098495905e5d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:42.530928 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 202/390] 10.222.0.85 () {58 vars in 1442 bytes} [Tue Aug 2 09:57:42 2022] PUT /identity/v3/projects/20f771efd436479ebbfe994b525b28dc/groups/36f39ddbfde94ebfa23871c68389822b/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:57:42.621945 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45829d1-51e2-4021-bf7e-7328521305d8 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:42.627492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7e124-5932-419e-b59e-2c9e19c1b415 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:42.628128 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7e124-5932-419e-b59e-2c9e19c1b415 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:42.628807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7e124-5932-419e-b59e-2c9e19c1b415 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:42.640774 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 203/391] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:42 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:57:42.649992 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd7fed-b7fd-401c-b925-537becf68cd9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:42.650330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd7fed-b7fd-401c-b925-537becf68cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:42.650559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd7fed-b7fd-401c-b925-537becf68cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:42.667227 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b179d7-1bb3-4b39-bbf7-43bf31fc0d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:42.667911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b179d7-1bb3-4b39-bbf7-43bf31fc0d8e None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:42.668203 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b179d7-1bb3-4b39-bbf7-43bf31fc0d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:42.668496 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b179d7-1bb3-4b39-bbf7-43bf31fc0d8e None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:42.669238 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b179d7-1bb3-4b39-bbf7-43bf31fc0d8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:42.669546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b179d7-1bb3-4b39-bbf7-43bf31fc0d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:42.672620 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b179d7-1bb3-4b39-bbf7-43bf31fc0d8e None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:42.693079 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 189/392] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:57:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:42.693638 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8bdd7fed-b7fd-401c-b925-537becf68cd9 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:42.694878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8bdd7fed-b7fd-401c-b925-537becf68cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:42.696899 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b179d7-1bb3-4b39-bbf7-43bf31fc0d8e None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:42.768022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:42.796922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:42.810984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 204/393] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:42.835438 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd7fed-b7fd-401c-b925-537becf68cd9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:42.836719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b179d7-1bb3-4b39-bbf7-43bf31fc0d8e None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:42.876066 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da0182-e7af-4a97-8495-f49be546b3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:42.876749 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da0182-e7af-4a97-8495-f49be546b3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:42.877197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da0182-e7af-4a97-8495-f49be546b3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:42.877482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da0182-e7af-4a97-8495-f49be546b3b1 None admin] PATH_INFO: `/v3/groups/36f39ddbfde94ebfa23871c68389822b` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:42.878654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da0182-e7af-4a97-8495-f49be546b3b1 None admin] RBAC: Authorizing `identity:get_group(group_id=36f39ddbfde94ebfa23871c68389822b)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:42.880353 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da0182-e7af-4a97-8495-f49be546b3b1 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:42.882222 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 190/394] 10.222.0.85 () {56 vars in 1180 bytes} [Tue Aug 2 09:57:42 2022] GET /identity/v3/groups/36f39ddbfde94ebfa23871c68389822b => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:42.887821 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da0182-e7af-4a97-8495-f49be546b3b1 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:42.997665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da0182-e7af-4a97-8495-f49be546b3b1 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:43.016910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:43.032764 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd7fed-b7fd-401c-b925-537becf68cd9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:43.036059 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac57cdc-8098-4f85-8c48-3f0ff10940c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:43.036949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac57cdc-8098-4f85-8c48-3f0ff10940c1 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:43.037221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac57cdc-8098-4f85-8c48-3f0ff10940c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:43.037505 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac57cdc-8098-4f85-8c48-3f0ff10940c1 None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:43.038782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac57cdc-8098-4f85-8c48-3f0ff10940c1 None admin] RBAC: Authorizing `identity:get_project(project_id=20f771efd436479ebbfe994b525b28dc)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:43.040300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac57cdc-8098-4f85-8c48-3f0ff10940c1 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:43.046907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 191/395] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:42 2022] GET /identity/v3/projects/20f771efd436479ebbfe994b525b28dc => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:43.048193 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac57cdc-8098-4f85-8c48-3f0ff10940c1 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:43.106445 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc32944-be23-47a1-91b8-14fdf2349d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:43.107100 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc32944-be23-47a1-91b8-14fdf2349d16 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:43.107433 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc32944-be23-47a1-91b8-14fdf2349d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:43.107718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc32944-be23-47a1-91b8-14fdf2349d16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:43.135781 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc32944-be23-47a1-91b8-14fdf2349d16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:43.147286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-6bc32944-be23-47a1-91b8-14fdf2349d16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:43.147286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:43.147286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:43.147286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:43.147286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:43.147286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:43.147286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:43.147286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:43.147286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:43.147286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:43.147286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:43.147286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:43.147286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:43.147286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:43.147286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:43.147286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:43.148203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:43.148203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:43.148203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:43.148203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:43.148203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:43.148203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:43.148203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:43.148203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:43.148203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:43.148203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:43.148203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:43.148203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:43.148203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:43.148203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:43.148203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:43.148203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:43.149034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:43.149034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:43.149034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:43.149034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:43.149034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:43.149034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:43.149034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:43.149034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:43.149034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:43.149034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:43.149034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:43.149034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:43.151675 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 205/396] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:57:43.156900 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc32944-be23-47a1-91b8-14fdf2349d16 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:43.203754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac57cdc-8098-4f85-8c48-3f0ff10940c1 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:43.240624 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c652c0-d5ee-4c67-a4db-4fda439ece17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:43.241316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c652c0-d5ee-4c67-a4db-4fda439ece17 None admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:43.241608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c652c0-d5ee-4c67-a4db-4fda439ece17 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:43.241896 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c652c0-d5ee-4c67-a4db-4fda439ece17 None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc/groups/36f39ddbfde94ebfa23871c68389822b/roles/cbb81f88446a46f38469b450c5f24624` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:43.244169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c652c0-d5ee-4c67-a4db-4fda439ece17 None admin] RBAC: Authorizing `identity:create_grant(project_id=20f771efd436479ebbfe994b525b28dc, group_id=36f39ddbfde94ebfa23871c68389822b, role_id=cbb81f88446a46f38469b450c5f24624)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:43.245679 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c652c0-d5ee-4c67-a4db-4fda439ece17 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:43.265013 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 192/397] 10.222.0.85 () {58 vars in 1442 bytes} [Tue Aug 2 09:57:43 2022] PUT /identity/v3/projects/20f771efd436479ebbfe994b525b28dc/groups/36f39ddbfde94ebfa23871c68389822b/roles/cbb81f88446a46f38469b450c5f24624 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:57:43.282214 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:43.365582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc32944-be23-47a1-91b8-14fdf2349d16 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:43.398959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcc694-034b-4162-a1cb-5328d360afd6 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:43.399285 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcc694-034b-4162-a1cb-5328d360afd6 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:43.399527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcc694-034b-4162-a1cb-5328d360afd6 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:43.401091 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 193/398] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:57:43.414946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab33c61-0e88-4c89-9787-53e3a516190c None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:43.415251 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab33c61-0e88-4c89-9787-53e3a516190c None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:43.415518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab33c61-0e88-4c89-9787-53e3a516190c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:43.419812 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bb464-d898-4041-9be8-73e4791b2d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:43.420701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bb464-d898-4041-9be8-73e4791b2d54 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:43.421207 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bb464-d898-4041-9be8-73e4791b2d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:43.421689 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bb464-d898-4041-9be8-73e4791b2d54 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:43.422628 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bb464-d898-4041-9be8-73e4791b2d54 None admin] RBAC: Adding query filter params (name=member) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:43.423156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bb464-d898-4041-9be8-73e4791b2d54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:43.425219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bb464-d898-4041-9be8-73e4791b2d54 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:43.436044 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 206/399] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:43.445517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bb464-d898-4041-9be8-73e4791b2d54 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:43.450556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-0ab33c61-0e88-4c89-9787-53e3a516190c None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:43.451794 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-0ab33c61-0e88-4c89-9787-53e3a516190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:43.509021 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:43.543997 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 194/400] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:43.564151 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab33c61-0e88-4c89-9787-53e3a516190c None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:43.584284 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bb464-d898-4041-9be8-73e4791b2d54 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:43.603661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:43.646050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471586b-ecb9-4cb9-b746-768554342c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:43.646715 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471586b-ecb9-4cb9-b746-768554342c5f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:43.646993 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471586b-ecb9-4cb9-b746-768554342c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:43.647268 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1471586b-ecb9-4cb9-b746-768554342c5f None admin] PATH_INFO: `/v3/groups/36f39ddbfde94ebfa23871c68389822b` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:43.648596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471586b-ecb9-4cb9-b746-768554342c5f None admin] RBAC: Authorizing `identity:get_group(group_id=36f39ddbfde94ebfa23871c68389822b)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:43.650107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1471586b-ecb9-4cb9-b746-768554342c5f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:43.651731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 207/401] 10.222.0.85 () {56 vars in 1180 bytes} [Tue Aug 2 09:57:43 2022] GET /identity/v3/groups/36f39ddbfde94ebfa23871c68389822b => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:43.657918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471586b-ecb9-4cb9-b746-768554342c5f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:43.758242 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab33c61-0e88-4c89-9787-53e3a516190c None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:43.805267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989a530-8071-4df0-844c-6629b7fd3213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:43.805846 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989a530-8071-4df0-844c-6629b7fd3213 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:43.806134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989a530-8071-4df0-844c-6629b7fd3213 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:43.806417 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989a530-8071-4df0-844c-6629b7fd3213 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:43.828614 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1471586b-ecb9-4cb9-b746-768554342c5f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:43.829638 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989a530-8071-4df0-844c-6629b7fd3213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:43.835300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-a989a530-8071-4df0-844c-6629b7fd3213 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:43.835300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:43.835300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:43.835300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:43.835300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:43.835300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:43.835300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:43.835300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:43.835300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:43.835300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:43.835300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:43.835300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:43.835300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:43.835300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:43.835300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:43.835300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:43.836169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:43.836169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:43.836169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:43.836169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:43.836169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:43.836169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:43.836169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:43.836169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:43.836169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:43.836169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:43.836169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:43.836169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:43.836169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:43.836169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:43.836169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:43.836169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:43.837583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:43.837583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:43.837583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:43.837583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:43.837583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:43.837583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:43.837583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:43.837583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:43.837583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:43.837583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:43.837583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:43.837583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:43.843660 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 195/402] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:57:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:57:43.845428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989a530-8071-4df0-844c-6629b7fd3213 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:43.878824 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3ffa9-0287-427f-9f57-fb8261ce432d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:43.879912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3ffa9-0287-427f-9f57-fb8261ce432d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:43.880483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3ffa9-0287-427f-9f57-fb8261ce432d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:43.880960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3ffa9-0287-427f-9f57-fb8261ce432d None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:43.882537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3ffa9-0287-427f-9f57-fb8261ce432d None admin] RBAC: Authorizing `identity:get_project(project_id=ef582d6737c842c69928f69bab3e3cf3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:43.884320 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3ffa9-0287-427f-9f57-fb8261ce432d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:43.886621 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 208/403] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:43 2022] GET /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:43.894917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3ffa9-0287-427f-9f57-fb8261ce432d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:43.911401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:43.985916 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:44.017592 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989a530-8071-4df0-844c-6629b7fd3213 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:44.046018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3ffa9-0287-427f-9f57-fb8261ce432d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:44.062218 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aaa930-679d-4bd8-b712-3bb781b63c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:44.062864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aaa930-679d-4bd8-b712-3bb781b63c04 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:44.063211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aaa930-679d-4bd8-b712-3bb781b63c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:44.063570 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aaa930-679d-4bd8-b712-3bb781b63c04 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:44.064372 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aaa930-679d-4bd8-b712-3bb781b63c04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:44.064778 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aaa930-679d-4bd8-b712-3bb781b63c04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:44.066335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aaa930-679d-4bd8-b712-3bb781b63c04 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:44.079703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 196/404] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:57:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:44.079703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7047ad-a888-4743-9a10-e0a7dc2cd056 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:44.079703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7047ad-a888-4743-9a10-e0a7dc2cd056 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:44.079703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7047ad-a888-4743-9a10-e0a7dc2cd056 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:44.079703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 197/405] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:44.080813 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7047ad-a888-4743-9a10-e0a7dc2cd056 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:44.099467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96e225a-9dac-4530-98ee-52f87c74e5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:44.100345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e225a-9dac-4530-98ee-52f87c74e5ee None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:44.100754 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e225a-9dac-4530-98ee-52f87c74e5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:44.101066 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e225a-9dac-4530-98ee-52f87c74e5ee None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3/groups/36f39ddbfde94ebfa23871c68389822b/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:44.103161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e225a-9dac-4530-98ee-52f87c74e5ee None admin] RBAC: Authorizing `identity:create_grant(project_id=ef582d6737c842c69928f69bab3e3cf3, group_id=36f39ddbfde94ebfa23871c68389822b, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:44.104758 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96e225a-9dac-4530-98ee-52f87c74e5ee None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:44.124280 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 209/406] 10.222.0.85 () {58 vars in 1442 bytes} [Tue Aug 2 09:57:43 2022] PUT /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3/groups/36f39ddbfde94ebfa23871c68389822b/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:57:44.126376 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27509624-3db5-4703-bb91-e6774681e9fe None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:44.127372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27509624-3db5-4703-bb91-e6774681e9fe None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:44.127851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27509624-3db5-4703-bb91-e6774681e9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:44.173224 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-27509624-3db5-4703-bb91-e6774681e9fe None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:44.174800 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-27509624-3db5-4703-bb91-e6774681e9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:44.261539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:44.278391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7047ad-a888-4743-9a10-e0a7dc2cd056 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:44.326681 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 210/407] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:44.334948 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45f737-edc1-44cc-a887-c2d849889eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:44.335934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45f737-edc1-44cc-a887-c2d849889eff None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:44.336420 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45f737-edc1-44cc-a887-c2d849889eff None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:44.336954 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e45f737-edc1-44cc-a887-c2d849889eff None admin] PATH_INFO: `/v3/groups/36f39ddbfde94ebfa23871c68389822b` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:44.338371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45f737-edc1-44cc-a887-c2d849889eff None admin] RBAC: Authorizing `identity:get_group(group_id=36f39ddbfde94ebfa23871c68389822b)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:44.340005 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e45f737-edc1-44cc-a887-c2d849889eff None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:44.342170 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 198/408] 10.222.0.85 () {56 vars in 1180 bytes} [Tue Aug 2 09:57:44 2022] GET /identity/v3/groups/36f39ddbfde94ebfa23871c68389822b => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:44.347317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27509624-3db5-4703-bb91-e6774681e9fe None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:44.357677 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45f737-edc1-44cc-a887-c2d849889eff None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:44.428952 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:44.484017 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e45f737-edc1-44cc-a887-c2d849889eff None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:44.548728 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc339d-8455-4275-95e6-cc0361293fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:44.549946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc339d-8455-4275-95e6-cc0361293fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:44.550382 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc339d-8455-4275-95e6-cc0361293fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:44.550807 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc339d-8455-4275-95e6-cc0361293fb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:44.555074 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27509624-3db5-4703-bb91-e6774681e9fe None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:44.564547 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc339d-8455-4275-95e6-cc0361293fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:44.570967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-83bc339d-8455-4275-95e6-cc0361293fb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:57:44.570967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:44.570967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:44.570967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:44.570967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:44.570967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:44.570967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:44.570967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:44.570967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:44.570967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:44.570967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:44.570967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:44.570967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:44.570967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:44.570967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:44.570967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:44.572060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:44.572060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:44.572060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:44.572060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:44.572060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:44.572060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:44.572060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:44.572060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:44.572060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:44.572060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:44.572060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:44.572060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:44.572060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:44.572060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:44.572060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:44.572060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:44.572969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:44.572969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:44.572969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:44.572969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:44.572969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:44.572969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:44.572969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:44.572969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:44.572969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:44.572969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:44.572969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:57:44.572969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:44.575607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 199/409] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:57:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:44.580960 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc339d-8455-4275-95e6-cc0361293fb5 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:44.609768 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:44.650136 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295fe96-70ed-4802-bab5-a50d537fb6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:44.651069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295fe96-70ed-4802-bab5-a50d537fb6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:44.652193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295fe96-70ed-4802-bab5-a50d537fb6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:44.653306 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295fe96-70ed-4802-bab5-a50d537fb6b4 None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:44.654786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295fe96-70ed-4802-bab5-a50d537fb6b4 None admin] RBAC: Authorizing `identity:get_project(project_id=ef582d6737c842c69928f69bab3e3cf3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:44.658791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295fe96-70ed-4802-bab5-a50d537fb6b4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:44.664217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 211/410] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:44 2022] GET /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3 => generated 302 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:44.667767 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295fe96-70ed-4802-bab5-a50d537fb6b4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:44.731374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc339d-8455-4275-95e6-cc0361293fb5 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:44.822855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295fe96-70ed-4802-bab5-a50d537fb6b4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:44.835208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:44.836920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35f93e-5b8e-4a82-bedd-028e629c56ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:44.838091 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35f93e-5b8e-4a82-bedd-028e629c56ff None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:44.838699 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35f93e-5b8e-4a82-bedd-028e629c56ff None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:44.839298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35f93e-5b8e-4a82-bedd-028e629c56ff None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:44.840644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35f93e-5b8e-4a82-bedd-028e629c56ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:44.841371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35f93e-5b8e-4a82-bedd-028e629c56ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:44.849017 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35f93e-5b8e-4a82-bedd-028e629c56ff None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:44.870158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 200/411] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:44.873436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35f93e-5b8e-4a82-bedd-028e629c56ff None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:44.875685 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f7018-e60b-4609-a776-cb2325d6ce82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:44.876368 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f7018-e60b-4609-a776-cb2325d6ce82 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:44.876687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f7018-e60b-4609-a776-cb2325d6ce82 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:44.876964 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f7018-e60b-4609-a776-cb2325d6ce82 None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3/groups/36f39ddbfde94ebfa23871c68389822b/roles/cbb81f88446a46f38469b450c5f24624` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:44.879249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f7018-e60b-4609-a776-cb2325d6ce82 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef582d6737c842c69928f69bab3e3cf3, group_id=36f39ddbfde94ebfa23871c68389822b, role_id=cbb81f88446a46f38469b450c5f24624)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:44.881632 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f7018-e60b-4609-a776-cb2325d6ce82 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:44.918699 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 212/412] 10.222.0.85 () {58 vars in 1442 bytes} [Tue Aug 2 09:57:44 2022] PUT /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3/groups/36f39ddbfde94ebfa23871c68389822b/roles/cbb81f88446a46f38469b450c5f24624 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:57:44.921093 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed3735-f6cd-4999-9165-a8c7b3677a15 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:44.921600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed3735-f6cd-4999-9165-a8c7b3677a15 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:44.922085 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed3735-f6cd-4999-9165-a8c7b3677a15 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:44.923634 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 213/413] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:57:44.930603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177524c-0ce3-4e1d-a969-2011e6796959 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:44.930893 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177524c-0ce3-4e1d-a969-2011e6796959 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:44.931171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177524c-0ce3-4e1d-a969-2011e6796959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:44.950112 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b177524c-0ce3-4e1d-a969-2011e6796959 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:44.951450 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b177524c-0ce3-4e1d-a969-2011e6796959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:44.991491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:45.033255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35f93e-5b8e-4a82-bedd-028e629c56ff None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:45.069429 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 214/414] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:45.089035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008b59c-557f-415e-a59d-b9ef5f19a00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:45.089659 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008b59c-557f-415e-a59d-b9ef5f19a00e None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:45.089953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008b59c-557f-415e-a59d-b9ef5f19a00e None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:45.090284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008b59c-557f-415e-a59d-b9ef5f19a00e None admin] PATH_INFO: `/v3/groups/ec8c1bd6f62d41988248ccb1e0505669` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:45.091508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008b59c-557f-415e-a59d-b9ef5f19a00e None admin] RBAC: Authorizing `identity:get_group(group_id=ec8c1bd6f62d41988248ccb1e0505669)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:45.094805 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008b59c-557f-415e-a59d-b9ef5f19a00e None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:45.096513 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 201/415] 10.222.0.85 () {56 vars in 1180 bytes} [Tue Aug 2 09:57:44 2022] GET /identity/v3/groups/ec8c1bd6f62d41988248ccb1e0505669 => generated 229 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:45.103670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177524c-0ce3-4e1d-a969-2011e6796959 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:45.117181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008b59c-557f-415e-a59d-b9ef5f19a00e None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:45.242574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:45.245739 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177524c-0ce3-4e1d-a969-2011e6796959 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:45.274066 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008b59c-557f-415e-a59d-b9ef5f19a00e None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:45.293614 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92ad62-014a-46f6-b74d-0d03a7c68fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:45.298211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92ad62-014a-46f6-b74d-0d03a7c68fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:45.298211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92ad62-014a-46f6-b74d-0d03a7c68fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:45.298211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92ad62-014a-46f6-b74d-0d03a7c68fd3 None admin] PATH_INFO: `/v3/projects/c3d1fabb05ac40668bd828447419da5a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:45.298211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92ad62-014a-46f6-b74d-0d03a7c68fd3 None admin] RBAC: Authorizing `identity:get_project(project_id=c3d1fabb05ac40668bd828447419da5a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:45.298211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92ad62-014a-46f6-b74d-0d03a7c68fd3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:45.304872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 215/416] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:45 2022] GET /identity/v3/projects/c3d1fabb05ac40668bd828447419da5a => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:45.306232 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92ad62-014a-46f6-b74d-0d03a7c68fd3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:45.350227 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933ae8a-94d6-4560-bd4f-93253b170fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:45.350902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933ae8a-94d6-4560-bd4f-93253b170fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:45.351190 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933ae8a-94d6-4560-bd4f-93253b170fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:45.351472 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933ae8a-94d6-4560-bd4f-93253b170fa9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:45.372753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933ae8a-94d6-4560-bd4f-93253b170fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:45.379383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-3933ae8a-94d6-4560-bd4f-93253b170fa9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:45.379383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:45.379383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:45.379383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:45.379383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:45.379383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:45.379383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:45.379383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:45.379383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:45.379383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:45.379383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:45.379383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:45.379383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:45.379383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:45.379383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:45.379383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:45.380278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:45.380278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:45.380278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:45.380278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:45.380278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:45.380278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:45.380278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:45.380278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:45.380278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:45.380278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:45.380278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:45.380278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:45.380278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:45.380278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:45.380278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:45.380278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:45.381157 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:45.381157 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:45.381157 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:45.381157 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:45.381157 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:45.381157 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:45.381157 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:45.381157 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:45.381157 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:45.381157 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:45.381157 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:45.381157 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:45.381157 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 202/417] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:45.388717 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933ae8a-94d6-4560-bd4f-93253b170fa9 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:45.429147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:45.498691 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92ad62-014a-46f6-b74d-0d03a7c68fd3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:45.521915 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933ae8a-94d6-4560-bd4f-93253b170fa9 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:45.560438 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7d0e6-c44f-4e60-b92f-9570eb876aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:45.561104 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7d0e6-c44f-4e60-b92f-9570eb876aef None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:45.561440 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7d0e6-c44f-4e60-b92f-9570eb876aef None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:45.561718 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7d0e6-c44f-4e60-b92f-9570eb876aef None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:45.562505 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7d0e6-c44f-4e60-b92f-9570eb876aef None admin] RBAC: Adding query filter params (name=member) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:45.562820 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7d0e6-c44f-4e60-b92f-9570eb876aef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:45.564226 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7d0e6-c44f-4e60-b92f-9570eb876aef None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:45.575144 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 203/418] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:45.581677 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7d0e6-c44f-4e60-b92f-9570eb876aef None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:45.593690 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3231c71-a495-4389-bcf0-3612c4548c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:45.594429 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3231c71-a495-4389-bcf0-3612c4548c2d None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:45.594716 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3231c71-a495-4389-bcf0-3612c4548c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:45.594993 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3231c71-a495-4389-bcf0-3612c4548c2d None admin] PATH_INFO: `/v3/projects/c3d1fabb05ac40668bd828447419da5a/groups/ec8c1bd6f62d41988248ccb1e0505669/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:45.597554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3231c71-a495-4389-bcf0-3612c4548c2d None admin] RBAC: Authorizing `identity:create_grant(project_id=c3d1fabb05ac40668bd828447419da5a, group_id=ec8c1bd6f62d41988248ccb1e0505669, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:45.599600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3231c71-a495-4389-bcf0-3612c4548c2d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:45.627500 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 216/419] 10.222.0.85 () {58 vars in 1442 bytes} [Tue Aug 2 09:57:45 2022] PUT /identity/v3/projects/c3d1fabb05ac40668bd828447419da5a/groups/ec8c1bd6f62d41988248ccb1e0505669/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:57:45.711545 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:45.748534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7d0e6-c44f-4e60-b92f-9570eb876aef None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:45.789241 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07de1f8-d69a-4f75-8cae-55901d19a853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:45.790311 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07de1f8-d69a-4f75-8cae-55901d19a853 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:45.790804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07de1f8-d69a-4f75-8cae-55901d19a853 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:45.791366 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07de1f8-d69a-4f75-8cae-55901d19a853 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:45.858435 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4f72f-2343-4663-91bb-15286ae24dfa None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:45.858735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4f72f-2343-4663-91bb-15286ae24dfa None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:45.858999 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4f72f-2343-4663-91bb-15286ae24dfa None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:45.860691 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 217/420] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:57:45.869227 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411cb54-5847-4097-bea9-92870d0f57cd None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:45.869523 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411cb54-5847-4097-bea9-92870d0f57cd None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:45.869809 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411cb54-5847-4097-bea9-92870d0f57cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:45.872366 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07de1f8-d69a-4f75-8cae-55901d19a853 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:45.873873 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07de1f8-d69a-4f75-8cae-55901d19a853 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:45.902306 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2411cb54-5847-4097-bea9-92870d0f57cd None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:45.903444 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2411cb54-5847-4097-bea9-92870d0f57cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:45.960848 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:45.979248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:46.023272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 204/421] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:46.029198 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07de1f8-d69a-4f75-8cae-55901d19a853 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:46.146799 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07de1f8-d69a-4f75-8cae-55901d19a853 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:46.147013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 218/422] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:46.181255 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411cb54-5847-4097-bea9-92870d0f57cd None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:46.186325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e676d9-2f0f-425f-a1d1-e25dd5ee72f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:46.187090 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e676d9-2f0f-425f-a1d1-e25dd5ee72f8 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:46.187477 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e676d9-2f0f-425f-a1d1-e25dd5ee72f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:46.187857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e676d9-2f0f-425f-a1d1-e25dd5ee72f8 None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:46.189184 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e676d9-2f0f-425f-a1d1-e25dd5ee72f8 None admin] RBAC: Authorizing `identity:get_project(project_id=20f771efd436479ebbfe994b525b28dc)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:46.192488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e676d9-2f0f-425f-a1d1-e25dd5ee72f8 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:46.195146 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 205/423] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:46 2022] GET /identity/v3/projects/20f771efd436479ebbfe994b525b28dc => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:46.201222 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e676d9-2f0f-425f-a1d1-e25dd5ee72f8 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:46.252163 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:46.325984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e676d9-2f0f-425f-a1d1-e25dd5ee72f8 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:46.366745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da913c-5e66-4023-8105-7b92a0276672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:46.367715 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da913c-5e66-4023-8105-7b92a0276672 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:46.368096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da913c-5e66-4023-8105-7b92a0276672 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:46.368486 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da913c-5e66-4023-8105-7b92a0276672 None admin] PATH_INFO: `/v3/groups/36f39ddbfde94ebfa23871c68389822b` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:46.370139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da913c-5e66-4023-8105-7b92a0276672 None admin] RBAC: Authorizing `identity:get_group(group_id=36f39ddbfde94ebfa23871c68389822b)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:46.371787 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da913c-5e66-4023-8105-7b92a0276672 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:46.374003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 206/424] 10.222.0.85 () {56 vars in 1180 bytes} [Tue Aug 2 09:57:46 2022] GET /identity/v3/groups/36f39ddbfde94ebfa23871c68389822b => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:46.381137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da913c-5e66-4023-8105-7b92a0276672 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:46.500796 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da913c-5e66-4023-8105-7b92a0276672 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:46.513975 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:46.518251 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411cb54-5847-4097-bea9-92870d0f57cd None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:46.544388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c15e1-65ad-47b3-bb84-7337d2cfad32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:46.545047 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c15e1-65ad-47b3-bb84-7337d2cfad32 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:46.545619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c15e1-65ad-47b3-bb84-7337d2cfad32 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:46.545900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c15e1-65ad-47b3-bb84-7337d2cfad32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:46.546709 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c15e1-65ad-47b3-bb84-7337d2cfad32 None admin] RBAC: Adding query filter params (group.id=36f39ddbfde94ebfa23871c68389822b, role.id=a2d6e3ab7e054be982bc78ce3c0a9748, scope.project.id=20f771efd436479ebbfe994b525b28dc) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:46.547167 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c15e1-65ad-47b3-bb84-7337d2cfad32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:46.548682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316c15e1-65ad-47b3-bb84-7337d2cfad32 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:46.558344 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 207/425] 10.222.0.85 () {56 vars in 1376 bytes} [Tue Aug 2 09:57:46 2022] GET /identity/v3/role_assignments?group.id=36f39ddbfde94ebfa23871c68389822b&scope.project.id=20f771efd436479ebbfe994b525b28dc&role.id=a2d6e3ab7e054be982bc78ce3c0a9748 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:46.559702 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee72a6-e346-4816-a127-ab85cf7711b8 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:46.559992 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee72a6-e346-4816-a127-ab85cf7711b8 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:46.560270 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee72a6-e346-4816-a127-ab85cf7711b8 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:46.572156 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 208/426] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:46 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:46.576019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0935208-a393-4a06-9ded-60778ee9f40c None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:46.576678 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0935208-a393-4a06-9ded-60778ee9f40c None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:46.577152 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0935208-a393-4a06-9ded-60778ee9f40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:46.602697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d1d8b-1b06-4b20-a6a3-72442dddfe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:46.603758 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d1d8b-1b06-4b20-a6a3-72442dddfe09 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:46.604321 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d1d8b-1b06-4b20-a6a3-72442dddfe09 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:46.604819 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d1d8b-1b06-4b20-a6a3-72442dddfe09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:46.614885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-b0935208-a393-4a06-9ded-60778ee9f40c None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:46.617740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b0935208-a393-4a06-9ded-60778ee9f40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:46.632561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d1d8b-1b06-4b20-a6a3-72442dddfe09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:46.638561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-827d1d8b-1b06-4b20-a6a3-72442dddfe09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:46.638561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:46.638561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:46.638561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:46.638561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:46.638561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:46.638561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:46.638561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:46.638561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:46.638561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:46.638561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:46.638561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:46.638561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:46.638561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:46.638561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:46.638561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:46.639749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:46.639749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:46.639749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:46.639749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:46.639749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:46.639749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:46.639749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:46.639749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:46.639749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:46.639749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:46.639749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:46.639749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:46.639749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:46.639749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:46.639749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:46.639749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:46.640553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:46.640553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:46.640553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:46.640553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:46.640553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:46.640553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:46.640553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:46.640553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:46.640553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:46.640553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:46.640553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:46.640553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:46.648294 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 219/427] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:57:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 467 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:57:46.654914 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d1d8b-1b06-4b20-a6a3-72442dddfe09 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:46.690794 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:46.751410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 209/428] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:46.775838 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0935208-a393-4a06-9ded-60778ee9f40c None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:46.819534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d1d8b-1b06-4b20-a6a3-72442dddfe09 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:46.866595 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46487d2-78eb-4b8f-adb9-f3e9bc7b34dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:46.867393 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46487d2-78eb-4b8f-adb9-f3e9bc7b34dc None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:46.867679 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46487d2-78eb-4b8f-adb9-f3e9bc7b34dc None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:46.867954 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46487d2-78eb-4b8f-adb9-f3e9bc7b34dc None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:46.868832 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46487d2-78eb-4b8f-adb9-f3e9bc7b34dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:46.869145 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46487d2-78eb-4b8f-adb9-f3e9bc7b34dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:46.870529 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46487d2-78eb-4b8f-adb9-f3e9bc7b34dc None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:46.881542 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 220/429] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:57:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:46.886984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46487d2-78eb-4b8f-adb9-f3e9bc7b34dc None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:46.906761 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0935208-a393-4a06-9ded-60778ee9f40c None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:46.913048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:46.955256 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ead07-f673-4e9e-b6a8-3db6b077197a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:46.955918 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ead07-f673-4e9e-b6a8-3db6b077197a None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:46.956201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ead07-f673-4e9e-b6a8-3db6b077197a None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:46.956497 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ead07-f673-4e9e-b6a8-3db6b077197a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:46.968656 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ead07-f673-4e9e-b6a8-3db6b077197a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:46.975331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-be0ead07-f673-4e9e-b6a8-3db6b077197a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:46.975331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:46.975331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:46.975331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:46.975331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:46.975331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:46.975331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:46.975331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:46.975331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:46.975331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:46.975331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:46.975331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:46.975331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:46.975331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:46.975331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:46.975331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:46.976209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:46.976209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:46.976209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:46.976209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:46.976209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:46.976209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:46.976209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:46.976209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:46.976209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:46.976209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:46.976209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:46.976209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:46.976209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:46.976209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:46.976209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:46.976209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:46.977783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:46.977783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:46.977783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:46.977783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:46.977783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:46.977783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:46.977783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:46.977783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:46.977783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:46.977783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:46.977783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 09:57:46.977783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:46.977783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 210/430] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:57:46.982533 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ead07-f673-4e9e-b6a8-3db6b077197a None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:46.998361 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46487d2-78eb-4b8f-adb9-f3e9bc7b34dc None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:46.999936 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:47.036940 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e4ff6-f23d-4ec0-ab15-127d960d6057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:47.037586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e4ff6-f23d-4ec0-ab15-127d960d6057 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:47.037878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e4ff6-f23d-4ec0-ab15-127d960d6057 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:47.038257 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e4ff6-f23d-4ec0-ab15-127d960d6057 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:47.103467 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ead07-f673-4e9e-b6a8-3db6b077197a None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:47.116023 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e4ff6-f23d-4ec0-ab15-127d960d6057 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:47.117646 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e4ff6-f23d-4ec0-ab15-127d960d6057 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:47.146954 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432797a-544e-45f8-88cd-d0372e7a2531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:47.147638 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432797a-544e-45f8-88cd-d0372e7a2531 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:47.147924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432797a-544e-45f8-88cd-d0372e7a2531 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:47.148196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432797a-544e-45f8-88cd-d0372e7a2531 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:47.148978 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432797a-544e-45f8-88cd-d0372e7a2531 None admin] RBAC: Adding query filter params (name=member) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:47.149340 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432797a-544e-45f8-88cd-d0372e7a2531 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:47.150791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432797a-544e-45f8-88cd-d0372e7a2531 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:47.159705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 211/431] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:57:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:47.166864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432797a-544e-45f8-88cd-d0372e7a2531 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:47.198004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:47.224839 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:47.236894 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 221/432] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 09:57:47.239659 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e4ff6-f23d-4ec0-ab15-127d960d6057 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:47.285475 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432797a-544e-45f8-88cd-d0372e7a2531 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:47.331652 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ec31a-17df-42e4-ad3d-074f05c5e905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:47.332936 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ec31a-17df-42e4-ad3d-074f05c5e905 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:47.333378 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ec31a-17df-42e4-ad3d-074f05c5e905 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:47.333663 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ec31a-17df-42e4-ad3d-074f05c5e905 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:47.371911 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e4ff6-f23d-4ec0-ab15-127d960d6057 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:47.418248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ec31a-17df-42e4-ad3d-074f05c5e905 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:47.419932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ec31a-17df-42e4-ad3d-074f05c5e905 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:47.420085 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1dee8-ffd9-436c-8b69-1da3d30c2064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:47.420888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1dee8-ffd9-436c-8b69-1da3d30c2064 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:47.421124 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1dee8-ffd9-436c-8b69-1da3d30c2064 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:47.421404 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1dee8-ffd9-436c-8b69-1da3d30c2064 None admin] PATH_INFO: `/v3/projects/20f771efd436479ebbfe994b525b28dc` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:47.422796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1dee8-ffd9-436c-8b69-1da3d30c2064 None admin] RBAC: Authorizing `identity:get_project(project_id=20f771efd436479ebbfe994b525b28dc)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:47.424241 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1dee8-ffd9-436c-8b69-1da3d30c2064 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:47.427697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 222/433] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:47 2022] GET /identity/v3/projects/20f771efd436479ebbfe994b525b28dc => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:47.434132 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1dee8-ffd9-436c-8b69-1da3d30c2064 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:47.461334 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:47.496242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:47.551565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 212/434] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:47.556923 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ec31a-17df-42e4-ad3d-074f05c5e905 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:47.567566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1dee8-ffd9-436c-8b69-1da3d30c2064 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:47.611312 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fa36d-837d-4064-a926-4b7d32042161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:47.612498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fa36d-837d-4064-a926-4b7d32042161 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:47.612954 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fa36d-837d-4064-a926-4b7d32042161 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:47.614067 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fa36d-837d-4064-a926-4b7d32042161 None admin] PATH_INFO: `/v3/groups/36f39ddbfde94ebfa23871c68389822b` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:47.616081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fa36d-837d-4064-a926-4b7d32042161 None admin] RBAC: Authorizing `identity:get_group(group_id=36f39ddbfde94ebfa23871c68389822b)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:47.618163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fa36d-837d-4064-a926-4b7d32042161 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:47.620210 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 223/435] 10.222.0.85 () {56 vars in 1180 bytes} [Tue Aug 2 09:57:47 2022] GET /identity/v3/groups/36f39ddbfde94ebfa23871c68389822b => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:47.622246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62833ce0-4ee6-49c0-87a5-7977fde4b06b None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:47.622668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62833ce0-4ee6-49c0-87a5-7977fde4b06b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:47.623327 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62833ce0-4ee6-49c0-87a5-7977fde4b06b None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:47.625321 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 224/436] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:47.626318 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62833ce0-4ee6-49c0-87a5-7977fde4b06b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:47.667586 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ec31a-17df-42e4-ad3d-074f05c5e905 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:47.696516 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:47.706555 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12e8cd-af29-4351-bcd8-08a03ae643a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:47.707251 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12e8cd-af29-4351-bcd8-08a03ae643a1 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:47.707538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12e8cd-af29-4351-bcd8-08a03ae643a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:47.707813 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12e8cd-af29-4351-bcd8-08a03ae643a1 None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:47.709022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12e8cd-af29-4351-bcd8-08a03ae643a1 None admin] RBAC: Authorizing `identity:get_project(project_id=ef582d6737c842c69928f69bab3e3cf3)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:47.710520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12e8cd-af29-4351-bcd8-08a03ae643a1 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:47.712341 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 213/437] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:47 2022] GET /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:47.713352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317cd27-20d1-4f0d-b082-e39e39ffa3c3 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:47.713638 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317cd27-20d1-4f0d-b082-e39e39ffa3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:47.713915 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317cd27-20d1-4f0d-b082-e39e39ffa3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:47.732650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-e317cd27-20d1-4f0d-b082-e39e39ffa3c3 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:47.733903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e317cd27-20d1-4f0d-b082-e39e39ffa3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:47.751651 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62833ce0-4ee6-49c0-87a5-7977fde4b06b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:47.769561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:47.791375 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129149f-881a-4f6b-a907-9ed26ab41a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:47.791992 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129149f-881a-4f6b-a907-9ed26ab41a57 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:47.792276 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129149f-881a-4f6b-a907-9ed26ab41a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:47.792591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129149f-881a-4f6b-a907-9ed26ab41a57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:47.793398 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129149f-881a-4f6b-a907-9ed26ab41a57 None admin] RBAC: Adding query filter params (group.id=36f39ddbfde94ebfa23871c68389822b, role.id=cbb81f88446a46f38469b450c5f24624, scope.project.id=20f771efd436479ebbfe994b525b28dc) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:47.793712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129149f-881a-4f6b-a907-9ed26ab41a57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:47.795147 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129149f-881a-4f6b-a907-9ed26ab41a57 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:47.812572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 225/438] 10.222.0.85 () {56 vars in 1376 bytes} [Tue Aug 2 09:57:47 2022] GET /identity/v3/role_assignments?group.id=36f39ddbfde94ebfa23871c68389822b&scope.project.id=20f771efd436479ebbfe994b525b28dc&role.id=cbb81f88446a46f38469b450c5f24624 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:47.812572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129149f-881a-4f6b-a907-9ed26ab41a57 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:47.823821 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 214/439] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:47.849827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317cd27-20d1-4f0d-b082-e39e39ffa3c3 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:47.937838 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129149f-881a-4f6b-a907-9ed26ab41a57 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:47.986788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317cd27-20d1-4f0d-b082-e39e39ffa3c3 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:47.991084 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd761eed-e9aa-436e-9523-ac8ebe91cd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:47.991738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd761eed-e9aa-436e-9523-ac8ebe91cd57 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:47.992020 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd761eed-e9aa-436e-9523-ac8ebe91cd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:47.992301 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd761eed-e9aa-436e-9523-ac8ebe91cd57 None admin] PATH_INFO: `/v3/groups/36f39ddbfde94ebfa23871c68389822b` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:47.993521 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd761eed-e9aa-436e-9523-ac8ebe91cd57 None admin] RBAC: Authorizing `identity:get_group(group_id=36f39ddbfde94ebfa23871c68389822b)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:47.994966 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd761eed-e9aa-436e-9523-ac8ebe91cd57 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:47.996626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 226/440] 10.222.0.85 () {56 vars in 1180 bytes} [Tue Aug 2 09:57:47 2022] GET /identity/v3/groups/36f39ddbfde94ebfa23871c68389822b => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:47.997967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ef1a9-c73c-41b2-946d-91e238829de5 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:47.998255 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ef1a9-c73c-41b2-946d-91e238829de5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:47.998532 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ef1a9-c73c-41b2-946d-91e238829de5 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:48.000486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 227/441] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:48.004604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ef1a9-c73c-41b2-946d-91e238829de5 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:48.015386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:48.035325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941ad571-c811-40e9-9e90-642f3f979e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:48.035994 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ad571-c811-40e9-9e90-642f3f979e02 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:48.036278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ad571-c811-40e9-9e90-642f3f979e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:48.036588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941ad571-c811-40e9-9e90-642f3f979e02 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:48.048201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941ad571-c811-40e9-9e90-642f3f979e02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:48.053520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-941ad571-c811-40e9-9e90-642f3f979e02 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:48.053520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:48.053520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:48.053520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:48.053520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:48.053520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:48.053520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:48.053520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:48.053520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:48.053520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:48.053520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:48.053520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:48.053520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:48.053520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:48.053520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:48.053520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:48.054488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:48.054488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:48.054488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:48.054488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:48.054488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:48.054488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:48.054488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:48.054488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:48.054488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:48.054488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:48.054488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:48.054488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:48.054488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:48.054488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:48.054488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:48.054488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:48.055305 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:48.055305 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:48.055305 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:48.055305 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:48.055305 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:48.055305 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:48.055305 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:48.055305 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:48.055305 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:48.055305 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:48.055305 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:48.055305 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:48.055305 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 215/442] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:57:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:48.060421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dafcf-9063-4c99-837c-30523ccef099 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:48.060421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dafcf-9063-4c99-837c-30523ccef099 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:48.060421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dafcf-9063-4c99-837c-30523ccef099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:48.072613 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:48.075872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-5b0dafcf-9063-4c99-837c-30523ccef099 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:48.077284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-5b0dafcf-9063-4c99-837c-30523ccef099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:48.136127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ef1a9-c73c-41b2-946d-91e238829de5 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:48.161068 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 216/443] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:48.161928 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dafcf-9063-4c99-837c-30523ccef099 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:48.181967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68a6c0-8e13-4925-8c94-99694db075ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:48.182654 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68a6c0-8e13-4925-8c94-99694db075ef None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:48.182942 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68a6c0-8e13-4925-8c94-99694db075ef None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:48.183213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68a6c0-8e13-4925-8c94-99694db075ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:48.184017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68a6c0-8e13-4925-8c94-99694db075ef None admin] RBAC: Adding query filter params (group.id=36f39ddbfde94ebfa23871c68389822b, role.id=a2d6e3ab7e054be982bc78ce3c0a9748, scope.project.id=ef582d6737c842c69928f69bab3e3cf3) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:48.184327 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68a6c0-8e13-4925-8c94-99694db075ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:48.186444 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68a6c0-8e13-4925-8c94-99694db075ef None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:48.193816 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 228/444] 10.222.0.85 () {56 vars in 1376 bytes} [Tue Aug 2 09:57:48 2022] GET /identity/v3/role_assignments?group.id=36f39ddbfde94ebfa23871c68389822b&scope.project.id=ef582d6737c842c69928f69bab3e3cf3&role.id=a2d6e3ab7e054be982bc78ce3c0a9748 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:48.194638 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68a6c0-8e13-4925-8c94-99694db075ef None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:48.284144 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dafcf-9063-4c99-837c-30523ccef099 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:48.301603 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:48.325896 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cbd71-235b-477e-8479-a11dd44dbd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:48.326436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cbd71-235b-477e-8479-a11dd44dbd1e None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:48.326718 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cbd71-235b-477e-8479-a11dd44dbd1e None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:48.326915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68a6c0-8e13-4925-8c94-99694db075ef None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:48.327026 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cbd71-235b-477e-8479-a11dd44dbd1e None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:48.327713 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cbd71-235b-477e-8479-a11dd44dbd1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:48.328021 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cbd71-235b-477e-8479-a11dd44dbd1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:48.329465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cbd71-235b-477e-8479-a11dd44dbd1e None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:48.344048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 217/445] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:57:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:48.345102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:48.345292 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cbd71-235b-477e-8479-a11dd44dbd1e None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:48.370372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562ea11-0105-43c3-b80a-84c208153132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:48.371248 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562ea11-0105-43c3-b80a-84c208153132 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:48.371838 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562ea11-0105-43c3-b80a-84c208153132 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:48.372287 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562ea11-0105-43c3-b80a-84c208153132 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:48.386920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562ea11-0105-43c3-b80a-84c208153132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:48.392337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-f562ea11-0105-43c3-b80a-84c208153132 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:57:48.392337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:48.392337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:48.392337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:48.392337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:48.392337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:48.392337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:48.392337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:48.392337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:48.392337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:48.392337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:48.392337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:48.392337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:48.392337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:48.392337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:48.392337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:48.393238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:48.393238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:48.393238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:48.393238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:48.393238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:48.393238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:48.393238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:48.393238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:48.393238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:48.393238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:48.393238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:48.393238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:48.393238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:48.393238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:48.393238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:48.393238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:48.394038 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:48.394038 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:48.394038 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:48.394038 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:48.394038 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:48.394038 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:48.394038 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:48.394038 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:48.394038 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:48.394038 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:48.394038 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:57:48.394038 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:48.394038 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 229/446] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:57:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:48.400777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562ea11-0105-43c3-b80a-84c208153132 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:48.466064 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cbd71-235b-477e-8479-a11dd44dbd1e None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:48.506449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e64970-9f84-46e4-89b8-c06907d1885c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:48.507104 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e64970-9f84-46e4-89b8-c06907d1885c None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:48.507380 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e64970-9f84-46e4-89b8-c06907d1885c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:48.507650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e64970-9f84-46e4-89b8-c06907d1885c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:48.526204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562ea11-0105-43c3-b80a-84c208153132 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:48.561517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:48.568633 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04298f0-74a5-46f1-bcfb-71f53d8097d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:48.569262 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04298f0-74a5-46f1-bcfb-71f53d8097d6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:48.569544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04298f0-74a5-46f1-bcfb-71f53d8097d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:48.569819 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04298f0-74a5-46f1-bcfb-71f53d8097d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:48.570542 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04298f0-74a5-46f1-bcfb-71f53d8097d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:48.570849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04298f0-74a5-46f1-bcfb-71f53d8097d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:48.572357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04298f0-74a5-46f1-bcfb-71f53d8097d6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:48.580584 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 230/447] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:48.585191 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e64970-9f84-46e4-89b8-c06907d1885c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:48.586651 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e64970-9f84-46e4-89b8-c06907d1885c None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:48.586755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04298f0-74a5-46f1-bcfb-71f53d8097d6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:48.622125 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:48.686816 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 218/448] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:48.688960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04298f0-74a5-46f1-bcfb-71f53d8097d6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:48.692713 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e64970-9f84-46e4-89b8-c06907d1885c None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:48.724825 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89a973-ee42-4fa2-b00f-28e737fb71b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:48.725441 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89a973-ee42-4fa2-b00f-28e737fb71b0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:48.725741 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89a973-ee42-4fa2-b00f-28e737fb71b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:48.725970 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89a973-ee42-4fa2-b00f-28e737fb71b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:48.768065 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:48.791723 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e64970-9f84-46e4-89b8-c06907d1885c None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:48.792891 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89a973-ee42-4fa2-b00f-28e737fb71b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:48.794353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89a973-ee42-4fa2-b00f-28e737fb71b0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:48.827466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a1273-4309-4e0f-bb16-c09f378b4c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:48.828095 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a1273-4309-4e0f-bb16-c09f378b4c41 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:48.828375 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a1273-4309-4e0f-bb16-c09f378b4c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:48.828682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6a1273-4309-4e0f-bb16-c09f378b4c41 None admin] PATH_INFO: `/v3/projects/ef582d6737c842c69928f69bab3e3cf3` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:48.828808 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:48.829838 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a1273-4309-4e0f-bb16-c09f378b4c41 None admin] RBAC: Authorizing `identity:get_project(project_id=ef582d6737c842c69928f69bab3e3cf3)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:48.831328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6a1273-4309-4e0f-bb16-c09f378b4c41 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:48.833139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 219/449] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:48 2022] GET /identity/v3/projects/ef582d6737c842c69928f69bab3e3cf3 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:48.838257 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a1273-4309-4e0f-bb16-c09f378b4c41 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:48.900817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 231/450] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 09:57:48.906124 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89a973-ee42-4fa2-b00f-28e737fb71b0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:48.937854 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6a1273-4309-4e0f-bb16-c09f378b4c41 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:48.973410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4c565-35d0-4181-a38c-fb6bb8402cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:48.974049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4c565-35d0-4181-a38c-fb6bb8402cbb None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:48.974338 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4c565-35d0-4181-a38c-fb6bb8402cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:48.974611 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4c565-35d0-4181-a38c-fb6bb8402cbb None admin] PATH_INFO: `/v3/groups/36f39ddbfde94ebfa23871c68389822b` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:48.975769 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4c565-35d0-4181-a38c-fb6bb8402cbb None admin] RBAC: Authorizing `identity:get_group(group_id=36f39ddbfde94ebfa23871c68389822b)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:48.977247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4c565-35d0-4181-a38c-fb6bb8402cbb None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:48.978831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 220/451] 10.222.0.85 () {56 vars in 1180 bytes} [Tue Aug 2 09:57:48 2022] GET /identity/v3/groups/36f39ddbfde94ebfa23871c68389822b => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:48.984590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4c565-35d0-4181-a38c-fb6bb8402cbb None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:48.998374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:49.004311 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89a973-ee42-4fa2-b00f-28e737fb71b0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:49.039446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1d002-df4c-4d1d-b857-52cc3b5a73a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:49.040078 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1d002-df4c-4d1d-b857-52cc3b5a73a2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:49.040362 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1d002-df4c-4d1d-b857-52cc3b5a73a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:49.040666 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1d002-df4c-4d1d-b857-52cc3b5a73a2 None admin] PATH_INFO: `/v3/projects/c3d1fabb05ac40668bd828447419da5a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:49.041824 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1d002-df4c-4d1d-b857-52cc3b5a73a2 None admin] RBAC: Authorizing `identity:get_project(project_id=c3d1fabb05ac40668bd828447419da5a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:49.043268 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e1d002-df4c-4d1d-b857-52cc3b5a73a2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:49.044951 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 232/452] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:57:48 2022] GET /identity/v3/projects/c3d1fabb05ac40668bd828447419da5a => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:49.050492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1d002-df4c-4d1d-b857-52cc3b5a73a2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:49.053149 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:49.085964 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4c565-35d0-4181-a38c-fb6bb8402cbb None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:49.120945 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e2ee8-261e-41ef-91ae-fd7e26458fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:49.121560 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e2ee8-261e-41ef-91ae-fd7e26458fbf None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:49.121840 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e2ee8-261e-41ef-91ae-fd7e26458fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:49.122112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e2ee8-261e-41ef-91ae-fd7e26458fbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:49.122903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e2ee8-261e-41ef-91ae-fd7e26458fbf None admin] RBAC: Adding query filter params (group.id=36f39ddbfde94ebfa23871c68389822b, role.id=cbb81f88446a46f38469b450c5f24624, scope.project.id=ef582d6737c842c69928f69bab3e3cf3) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:49.123214 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e2ee8-261e-41ef-91ae-fd7e26458fbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:49.124677 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e2ee8-261e-41ef-91ae-fd7e26458fbf None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:49.131742 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 221/453] 10.222.0.85 () {56 vars in 1376 bytes} [Tue Aug 2 09:57:48 2022] GET /identity/v3/role_assignments?group.id=36f39ddbfde94ebfa23871c68389822b&scope.project.id=ef582d6737c842c69928f69bab3e3cf3&role.id=cbb81f88446a46f38469b450c5f24624 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:49.154265 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1d002-df4c-4d1d-b857-52cc3b5a73a2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:49.196205 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba50513-7254-4b36-b8a3-251fd8cdf1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:49.196938 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba50513-7254-4b36-b8a3-251fd8cdf1ad None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:49.197219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba50513-7254-4b36-b8a3-251fd8cdf1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:49.197489 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba50513-7254-4b36-b8a3-251fd8cdf1ad None admin] PATH_INFO: `/v3/groups/ec8c1bd6f62d41988248ccb1e0505669` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:49.198703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba50513-7254-4b36-b8a3-251fd8cdf1ad None admin] RBAC: Authorizing `identity:get_group(group_id=ec8c1bd6f62d41988248ccb1e0505669)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:49.200167 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba50513-7254-4b36-b8a3-251fd8cdf1ad None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:49.201836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 233/454] 10.222.0.85 () {56 vars in 1180 bytes} [Tue Aug 2 09:57:49 2022] GET /identity/v3/groups/ec8c1bd6f62d41988248ccb1e0505669 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:49.208152 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e2ee8-261e-41ef-91ae-fd7e26458fbf None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:49.290707 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:49.317298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e2ee8-261e-41ef-91ae-fd7e26458fbf None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:49.353612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd4aed0-dfa8-4a64-84a1-a595e42b7e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:49.354171 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4aed0-dfa8-4a64-84a1-a595e42b7e8c None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:49.354451 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4aed0-dfa8-4a64-84a1-a595e42b7e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:49.354725 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4aed0-dfa8-4a64-84a1-a595e42b7e8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:49.355526 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4aed0-dfa8-4a64-84a1-a595e42b7e8c None admin] RBAC: Adding query filter params (group.id=ec8c1bd6f62d41988248ccb1e0505669, role.id=c15ca78eb3c9472f94e15e2d28c7f403, scope.project.id=c3d1fabb05ac40668bd828447419da5a) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:49.355839 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4aed0-dfa8-4a64-84a1-a595e42b7e8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:49.357313 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd4aed0-dfa8-4a64-84a1-a595e42b7e8c None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:49.364002 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 222/455] 10.222.0.85 () {56 vars in 1376 bytes} [Tue Aug 2 09:57:49 2022] GET /identity/v3/role_assignments?group.id=ec8c1bd6f62d41988248ccb1e0505669&scope.project.id=c3d1fabb05ac40668bd828447419da5a&role.id=c15ca78eb3c9472f94e15e2d28c7f403 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:52.032969 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ee72f-84c5-40f1-bc3b-b5d64f1bf3a9 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:52.033478 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ee72f-84c5-40f1-bc3b-b5d64f1bf3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:52.033591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ee72f-84c5-40f1-bc3b-b5d64f1bf3a9 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:52.036228 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 234/456] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:52.041803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511e449-78cd-4112-a7ac-092332f00951 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:52.042314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511e449-78cd-4112-a7ac-092332f00951 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:52.042387 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511e449-78cd-4112-a7ac-092332f00951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:52.062479 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-5511e449-78cd-4112-a7ac-092332f00951 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:52.063676 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-5511e449-78cd-4112-a7ac-092332f00951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:52.076205 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c467a-30c3-4344-acd4-0b0f8db7ec59 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:52.076528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c467a-30c3-4344-acd4-0b0f8db7ec59 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:52.076813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c467a-30c3-4344-acd4-0b0f8db7ec59 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:52.078407 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 235/457] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:52.083008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7bbb5-be72-4c42-ad6e-f2607e3b3a5b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:52.083298 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7bbb5-be72-4c42-ad6e-f2607e3b3a5b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:52.083581 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b7bbb5-be72-4c42-ad6e-f2607e3b3a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:52.117684 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d7b7bbb5-be72-4c42-ad6e-f2607e3b3a5b None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:52.118887 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d7b7bbb5-be72-4c42-ad6e-f2607e3b3a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:52.168591 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 223/458] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:52.169875 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0f16a-6118-4708-a72e-299eb599359f None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:52.170164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0f16a-6118-4708-a72e-299eb599359f None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:52.170443 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0f16a-6118-4708-a72e-299eb599359f None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:52.171924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 224/459] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:52.177111 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a5d19-20ca-4e37-b248-040344d1bf62 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:52.177404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a5d19-20ca-4e37-b248-040344d1bf62 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:52.177690 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8a5d19-20ca-4e37-b248-040344d1bf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:52.207247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-5a8a5d19-20ca-4e37-b248-040344d1bf62 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:52.208448 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-5a8a5d19-20ca-4e37-b248-040344d1bf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:52.214620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 236/460] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:52.215581 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7bbb5-be72-4c42-ad6e-f2607e3b3a5b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:52.228808 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:52.297560 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:52.304335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 225/461] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:52.312488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a5d19-20ca-4e37-b248-040344d1bf62 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:52.349798 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b7bbb5-be72-4c42-ad6e-f2607e3b3a5b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:52.386521 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404294e-cbd7-4865-8334-c7bcea114660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:52.387169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404294e-cbd7-4865-8334-c7bcea114660 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:52.387768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404294e-cbd7-4865-8334-c7bcea114660 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:52.388052 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404294e-cbd7-4865-8334-c7bcea114660 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:52.400989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404294e-cbd7-4865-8334-c7bcea114660 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:52.402600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404294e-cbd7-4865-8334-c7bcea114660 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:52.418854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a404294e-cbd7-4865-8334-c7bcea114660 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:52.418854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:52.418854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:52.418854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:52.418854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:52.418854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:52.418854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:52.418854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:52.418854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:52.418854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:52.418854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:52.418854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:52.418854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:57:52.418854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:57:52.418854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:57:52.419915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:57:52.419915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:52.419915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:52.419915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:52.419915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:52.419915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:52.419915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:52.419915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:52.419915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:52.419915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:52.419915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:52.419915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:52.419915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:52.419915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:52.419915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:52.419915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:52.419915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:52.420966 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:57:52.420966 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:57:52.420966 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:52.420966 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:52.422495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 237/462] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:52.423578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404294e-cbd7-4865-8334-c7bcea114660 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:52.423993 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8a5d19-20ca-4e37-b248-040344d1bf62 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:52.461953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5acc3-3ce5-4576-a399-4ae927878418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:52.462776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5acc3-3ce5-4576-a399-4ae927878418 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:52.463157 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5acc3-3ce5-4576-a399-4ae927878418 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:52.463535 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5acc3-3ce5-4576-a399-4ae927878418 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:52.474801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5acc3-3ce5-4576-a399-4ae927878418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:52.476385 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5acc3-3ce5-4576-a399-4ae927878418 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:52.491281 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:52.494240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-9fb5acc3-3ce5-4576-a399-4ae927878418 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:52.494240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:52.494240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:52.494240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:52.494240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:52.494240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:52.494240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:52.494240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:52.494240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:52.494240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:52.494240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:52.494240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:52.494240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:57:52.494240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:57:52.494240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:57:52.495155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:57:52.495155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:52.495155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:52.495155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:52.495155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:52.495155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:52.495155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:52.495155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:52.495155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:52.495155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:52.495155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:52.495155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:52.495155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:52.495155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:52.495155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:52.495155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:52.495155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:52.497130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:57:52.497130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:57:52.497130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:52.497130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:52.497130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 226/463] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:52.497130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5acc3-3ce5-4576-a399-4ae927878418 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:52.544984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404294e-cbd7-4865-8334-c7bcea114660 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:52.554004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:52.579183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd40198d-a940-4110-969a-63bf5ea8d305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:52.579815 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40198d-a940-4110-969a-63bf5ea8d305 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:52.580089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40198d-a940-4110-969a-63bf5ea8d305 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:52.580909 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd40198d-a940-4110-969a-63bf5ea8d305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:52.592068 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40198d-a940-4110-969a-63bf5ea8d305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:52.593553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd40198d-a940-4110-969a-63bf5ea8d305 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:52.605705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5acc3-3ce5-4576-a399-4ae927878418 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:52.610110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-dd40198d-a940-4110-969a-63bf5ea8d305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:52.610110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:52.610110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:52.610110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:52.610110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:52.610110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:52.610110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:52.610110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:52.610110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:52.610110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:52.610110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:52.610110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:52.610110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:57:52.610110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:57:52.610110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:57:52.610981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:57:52.610981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:52.610981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:52.610981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:52.610981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:52.610981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:52.610981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:52.610981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:52.610981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:52.610981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:52.610981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:52.610981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:52.610981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:52.610981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:52.610981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:52.610981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:52.610981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:52.617272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:57:52.617272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:57:52.617272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:52.617272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:52.617272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 238/464] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:52.617272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54869f4e-1dde-470f-93e8-8376d5ad72df None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:52.617272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54869f4e-1dde-470f-93e8-8376d5ad72df None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:52.617272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54869f4e-1dde-470f-93e8-8376d5ad72df None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:52.617272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 239/465] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:52.617749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54869f4e-1dde-470f-93e8-8376d5ad72df None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:52.647261 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521663db-e4e5-4caf-8e59-ae7d298bbf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:52.647993 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521663db-e4e5-4caf-8e59-ae7d298bbf13 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:52.648276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521663db-e4e5-4caf-8e59-ae7d298bbf13 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:52.648572 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521663db-e4e5-4caf-8e59-ae7d298bbf13 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:52.649264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521663db-e4e5-4caf-8e59-ae7d298bbf13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:52.649570 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521663db-e4e5-4caf-8e59-ae7d298bbf13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:52.651158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521663db-e4e5-4caf-8e59-ae7d298bbf13 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:52.665081 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 227/466] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:52.665920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521663db-e4e5-4caf-8e59-ae7d298bbf13 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:52.731172 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54869f4e-1dde-470f-93e8-8376d5ad72df None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:52.733962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:52.772597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38248592-8295-4f88-863e-92a3fce4549a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:52.772959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521663db-e4e5-4caf-8e59-ae7d298bbf13 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:52.773210 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38248592-8295-4f88-863e-92a3fce4549a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:52.773487 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38248592-8295-4f88-863e-92a3fce4549a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:52.773754 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38248592-8295-4f88-863e-92a3fce4549a None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:52.774550 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38248592-8295-4f88-863e-92a3fce4549a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:52.774856 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38248592-8295-4f88-863e-92a3fce4549a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:52.776375 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38248592-8295-4f88-863e-92a3fce4549a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:52.787890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:52.795045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 240/467] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:52.795045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb2559-8982-4bc5-bbbe-5eff73a1e832 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:52.795045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb2559-8982-4bc5-bbbe-5eff73a1e832 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:52.795045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb2559-8982-4bc5-bbbe-5eff73a1e832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:52.810748 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-fefb2559-8982-4bc5-bbbe-5eff73a1e832 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:52.811860 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fefb2559-8982-4bc5-bbbe-5eff73a1e832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:52.821108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4e918-1fb5-4bc4-b883-445bd7f21425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:52.822024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4e918-1fb5-4bc4-b883-445bd7f21425 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:52.822454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4e918-1fb5-4bc4-b883-445bd7f21425 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:52.822881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4e918-1fb5-4bc4-b883-445bd7f21425 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:52.823949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4e918-1fb5-4bc4-b883-445bd7f21425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:52.824428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4e918-1fb5-4bc4-b883-445bd7f21425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:52.826644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4e918-1fb5-4bc4-b883-445bd7f21425 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:52.846922 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 228/468] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:52.846922 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4e918-1fb5-4bc4-b883-445bd7f21425 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:52.892529 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 241/469] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:52.892529 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb2559-8982-4bc5-bbbe-5eff73a1e832 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:52.967441 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4e918-1fb5-4bc4-b883-445bd7f21425 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:52.995949 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:53.003608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bffc08-e4a0-4060-b617-8f935b6352d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:53.004130 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb2559-8982-4bc5-bbbe-5eff73a1e832 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:53.004237 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bffc08-e4a0-4060-b617-8f935b6352d7 None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:53.004540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bffc08-e4a0-4060-b617-8f935b6352d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:53.004821 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bffc08-e4a0-4060-b617-8f935b6352d7 None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:53.005512 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bffc08-e4a0-4060-b617-8f935b6352d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:53.007273 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bffc08-e4a0-4060-b617-8f935b6352d7 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:53.029516 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 229/470] 10.222.0.85 () {60 vars in 1132 bytes} [Tue Aug 2 09:57:52 2022] POST /identity/v3/users => generated 246 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:57:53.030594 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bffc08-e4a0-4060-b617-8f935b6352d7 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:53.055871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f976a-a954-41c9-8da5-c7047f7360a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:53.056613 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f976a-a954-41c9-8da5-c7047f7360a3 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:53.056817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f976a-a954-41c9-8da5-c7047f7360a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:53.057163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f976a-a954-41c9-8da5-c7047f7360a3 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:53.057985 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f976a-a954-41c9-8da5-c7047f7360a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:53.059712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f976a-a954-41c9-8da5-c7047f7360a3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:53.074594 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:53.096691 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 242/471] 10.222.0.85 () {60 vars in 1132 bytes} [Tue Aug 2 09:57:52 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:57:53.098319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f976a-a954-41c9-8da5-c7047f7360a3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:53.241564 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bffc08-e4a0-4060-b617-8f935b6352d7 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:53.287796 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39527ba1-3f0e-47bd-b616-1263c50ca162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:53.288427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39527ba1-3f0e-47bd-b616-1263c50ca162 None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:53.288739 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39527ba1-3f0e-47bd-b616-1263c50ca162 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:53.289565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39527ba1-3f0e-47bd-b616-1263c50ca162 None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:53.289745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39527ba1-3f0e-47bd-b616-1263c50ca162 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:53.291389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39527ba1-3f0e-47bd-b616-1263c50ca162 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:53.317712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f976a-a954-41c9-8da5-c7047f7360a3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:53.322264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 230/472] 10.222.0.85 () {60 vars in 1132 bytes} [Tue Aug 2 09:57:53 2022] POST /identity/v3/users => generated 248 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:57:53.323705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19adb5-1a8c-453d-b021-205e22b39d24 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:53.324005 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19adb5-1a8c-453d-b021-205e22b39d24 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:53.324325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19adb5-1a8c-453d-b021-205e22b39d24 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:53.325812 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 231/473] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:53.332139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506439b-dcd5-4803-a966-8b05b529e37f None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:53.332440 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506439b-dcd5-4803-a966-8b05b529e37f None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:53.332879 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506439b-dcd5-4803-a966-8b05b529e37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:53.353357 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-2506439b-dcd5-4803-a966-8b05b529e37f None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:53.354680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2506439b-dcd5-4803-a966-8b05b529e37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:53.360292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823dcbe-9c8f-4eea-92bf-223cece994eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:53.361001 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823dcbe-9c8f-4eea-92bf-223cece994eb None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:53.361281 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823dcbe-9c8f-4eea-92bf-223cece994eb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:53.362136 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823dcbe-9c8f-4eea-92bf-223cece994eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:53.375160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823dcbe-9c8f-4eea-92bf-223cece994eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:53.376780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823dcbe-9c8f-4eea-92bf-223cece994eb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:53.394594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-4823dcbe-9c8f-4eea-92bf-223cece994eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:53.394594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:53.394594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:53.394594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:53.394594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:53.394594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:53.394594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:53.394594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:53.394594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:53.394594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:53.394594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:53.394594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:53.394594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:57:53.394594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:57:53.394594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:57:53.395509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:57:53.395509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:53.395509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:53.395509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:53.395509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:53.395509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:53.395509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:53.395509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:53.395509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:53.395509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:53.395509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:53.395509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:53.395509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:53.395509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:53.395509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:53.395509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:53.395509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:53.396334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:57:53.396334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:57:53.396334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:53.396334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:53.396334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 243/474] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:53.402325 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823dcbe-9c8f-4eea-92bf-223cece994eb None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:53.405691 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:53.440632 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 232/475] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:53.462705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506439b-dcd5-4803-a966-8b05b529e37f None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:53.481688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:53.529231 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823dcbe-9c8f-4eea-92bf-223cece994eb None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:53.574854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8569125-64b4-47ba-8fdd-59e4fb9b051b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:53.575477 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8569125-64b4-47ba-8fdd-59e4fb9b051b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:53.575757 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8569125-64b4-47ba-8fdd-59e4fb9b051b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:53.576088 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8569125-64b4-47ba-8fdd-59e4fb9b051b None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:53.576773 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8569125-64b4-47ba-8fdd-59e4fb9b051b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:53.577079 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8569125-64b4-47ba-8fdd-59e4fb9b051b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:53.578452 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8569125-64b4-47ba-8fdd-59e4fb9b051b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:53.592312 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 244/476] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:53.594835 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506439b-dcd5-4803-a966-8b05b529e37f None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:53.598187 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8569125-64b4-47ba-8fdd-59e4fb9b051b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:53.636875 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d96711-09f9-48ff-8a1d-017e3ce21fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:53.638093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d96711-09f9-48ff-8a1d-017e3ce21fed None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:53.638603 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d96711-09f9-48ff-8a1d-017e3ce21fed None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:53.639094 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d96711-09f9-48ff-8a1d-017e3ce21fed None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:53.640029 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d96711-09f9-48ff-8a1d-017e3ce21fed None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:53.641833 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d96711-09f9-48ff-8a1d-017e3ce21fed None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:53.651997 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.sql.core [None req-d6d96711-09f9-48ff-8a1d-017e3ce21fed None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 09:57:53.651997 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 02 09:57:53.651997 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [parameters: {'id': 'cf3342f0dfb14498b278e424e75d0a22', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 02 09:57:53.651997 dv-cinder-850318-6-smb devstack@keystone.service[80329]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80329) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 09:57:53.671617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-d6d96711-09f9-48ff-8a1d-017e3ce21fed None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 02 09:57:53.671617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:53.671617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 09:57:53.671617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 09:57:53.671617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 09:57:53.671617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 09:57:53.671617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 09:57:53.671617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 09:57:53.671617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 09:57:53.671617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application conn.query(q) Aug 02 09:57:53.671617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 09:57:53.671617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 09:57:53.671617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 09:57:53.671617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application result.read() Aug 02 09:57:53.671617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 09:57:53.672661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 09:57:53.672661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 09:57:53.672661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 09:57:53.672661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 09:57:53.672661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 09:57:53.672661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 09:57:53.672661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 09:57:53.672661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 09:57:53.672661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:53.672661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 09:57:53.672661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:53.672661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:53.672661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 09:57:53.672661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 09:57:53.672661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 02 09:57:53.672661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return ref.to_dict() Aug 02 09:57:53.672661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 09:57:53.672661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application next(self.gen) Aug 02 09:57:53.679148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 09:57:53.679148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application yield resource Aug 02 09:57:53.679148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 09:57:53.679148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application next(self.gen) Aug 02 09:57:53.679148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 09:57:53.679148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 09:57:53.679148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 09:57:53.679148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 09:57:53.679148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 09:57:53.679148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise self.value Aug 02 09:57:53.679148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 09:57:53.679148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 09:57:53.679148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 09:57:53.679148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application session.commit() Aug 02 09:57:53.679148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 09:57:53.679148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 09:57:53.679148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 09:57:53.680033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 09:57:53.680033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 09:57:53.680033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self.session.flush() Aug 02 09:57:53.680033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 09:57:53.680033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 09:57:53.680033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 09:57:53.680033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 09:57:53.680033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 09:57:53.680033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application compat.raise_( Aug 02 09:57:53.680033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 09:57:53.680033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception Aug 02 09:57:53.680033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 09:57:53.680033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 09:57:53.680033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 09:57:53.680033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 09:57:53.680033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 09:57:53.680033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 09:57:53.680949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 09:57:53.680949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 09:57:53.680949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 02 09:57:53.680949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 02 09:57:53.680949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 09:57:53.680949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 09:57:53.680949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 09:57:53.680949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 09:57:53.680949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 09:57:53.680949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 09:57:53.680949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 09:57:53.680949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 09:57:53.680949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 09:57:53.680949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 09:57:53.680949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 09:57:53.680949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception Aug 02 09:57:53.682806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 09:57:53.682806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 09:57:53.682806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 09:57:53.682806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 09:57:53.682806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 09:57:53.682806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 09:57:53.682806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 09:57:53.682806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application conn.query(q) Aug 02 09:57:53.682806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 09:57:53.682806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 09:57:53.682806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 09:57:53.682806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application result.read() Aug 02 09:57:53.682806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 09:57:53.682806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 09:57:53.682806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 09:57:53.682806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 09:57:53.684953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 09:57:53.684953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 09:57:53.684953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 09:57:53.684953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 09:57:53.684953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 09:57:53.684953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 02 09:57:53.684953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [parameters: {'id': 'cf3342f0dfb14498b278e424e75d0a22', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 02 09:57:53.684953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 09:57:53.684953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:53.684953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:57:53.684953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:53.684953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:53.684953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:53.684953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:53.684953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:53.684953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:53.686937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:53.686937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:53.686937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:53.686937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:53.686937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:53.686937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:53.686937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 02 09:57:53.686937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 02 09:57:53.686937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:53.686937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:53.686937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 02 09:57:53.686937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 02 09:57:53.686937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 09:57:53.686937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 09:57:53.686937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 02 09:57:53.686937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:53.689349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 233/477] 10.222.0.85 () {60 vars in 1131 bytes} [Tue Aug 2 09:57:53 2022] POST /identity/v3/roles => generated 144 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:57:53.689487 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:53.691326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d96711-09f9-48ff-8a1d-017e3ce21fed None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:53.726234 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8569125-64b4-47ba-8fdd-59e4fb9b051b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:53.772314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d383f89-47e8-4aff-99d2-5bdb4059d53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:53.773150 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d383f89-47e8-4aff-99d2-5bdb4059d53b None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:53.773463 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d383f89-47e8-4aff-99d2-5bdb4059d53b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:53.773781 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d383f89-47e8-4aff-99d2-5bdb4059d53b None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:53.774428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d383f89-47e8-4aff-99d2-5bdb4059d53b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:53.775923 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d383f89-47e8-4aff-99d2-5bdb4059d53b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:53.800059 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:53.805253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 245/478] 10.222.0.85 () {60 vars in 1132 bytes} [Tue Aug 2 09:57:53 2022] POST /identity/v3/users => generated 249 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:57:53.828293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d96711-09f9-48ff-8a1d-017e3ce21fed None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:53.868856 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3482c0-6f92-41f7-a2d0-c08a4939e70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:53.869645 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3482c0-6f92-41f7-a2d0-c08a4939e70e None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:53.869900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3482c0-6f92-41f7-a2d0-c08a4939e70e None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:53.870177 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3482c0-6f92-41f7-a2d0-c08a4939e70e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:53.883708 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3482c0-6f92-41f7-a2d0-c08a4939e70e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:53.889246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-4b3482c0-6f92-41f7-a2d0-c08a4939e70e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:53.889246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:53.889246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:53.889246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:53.889246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:53.889246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:53.889246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:53.889246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:53.889246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:53.889246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:53.889246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:53.889246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:53.889246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:53.889246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:53.889246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:53.889246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:53.890248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:53.890248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:53.890248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:53.890248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:53.890248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:53.890248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:53.890248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:53.890248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:53.890248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:53.890248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:53.890248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:53.890248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:53.890248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:53.890248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:53.890248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:53.890248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:53.891050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:53.891050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:53.891050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:53.891050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:53.891050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:53.891050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:53.891050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:53.891050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:53.891050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:53.891050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:53.891050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 09:57:53.891050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:53.895810 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 234/479] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:57:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:57:53.901628 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d383f89-47e8-4aff-99d2-5bdb4059d53b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:54.050122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d383f89-47e8-4aff-99d2-5bdb4059d53b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:54.068796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:54.089058 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a50410-c01e-4014-a1bc-25cf7b2912d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:54.089594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a50410-c01e-4014-a1bc-25cf7b2912d6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:54.089876 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a50410-c01e-4014-a1bc-25cf7b2912d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:54.090153 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a50410-c01e-4014-a1bc-25cf7b2912d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:54.090881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a50410-c01e-4014-a1bc-25cf7b2912d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:54.091186 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a50410-c01e-4014-a1bc-25cf7b2912d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:54.092588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a50410-c01e-4014-a1bc-25cf7b2912d6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:54.101832 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 246/480] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:57:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:55.635137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c0a8b-2d65-407c-82ae-a395e4f832b8 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:55.636139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c0a8b-2d65-407c-82ae-a395e4f832b8 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:55.636902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c0a8b-2d65-407c-82ae-a395e4f832b8 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:55.638470 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 235/481] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:55.650525 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52125d2d-2250-4fc8-a382-22e03aee31a7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:55.651904 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52125d2d-2250-4fc8-a382-22e03aee31a7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:55.652671 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52125d2d-2250-4fc8-a382-22e03aee31a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:55.686684 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-52125d2d-2250-4fc8-a382-22e03aee31a7 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:55.688245 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-52125d2d-2250-4fc8-a382-22e03aee31a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:55.728339 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69486845-fa1c-4bd0-9b0b-3d76ef01e7eb None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:55.728693 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69486845-fa1c-4bd0-9b0b-3d76ef01e7eb None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:55.728907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69486845-fa1c-4bd0-9b0b-3d76ef01e7eb None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:55.730454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 236/482] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:55.735378 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4da1f-6017-49c1-9507-f256350f602c None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:55.735696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4da1f-6017-49c1-9507-f256350f602c None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:55.736516 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4da1f-6017-49c1-9507-f256350f602c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:55.773492 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-b3d4da1f-6017-49c1-9507-f256350f602c None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:55.774712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b3d4da1f-6017-49c1-9507-f256350f602c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:55.783811 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 247/483] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:55.840597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52125d2d-2250-4fc8-a382-22e03aee31a7 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:55.873798 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 237/484] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:57:55.898392 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4da1f-6017-49c1-9507-f256350f602c None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:55.980823 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:55.994450 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52125d2d-2250-4fc8-a382-22e03aee31a7 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:56.015574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4da1f-6017-49c1-9507-f256350f602c None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:56.022266 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:56.063491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3f689-9795-4a5d-847a-a8e3a1e7b178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:56.066891 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3f689-9795-4a5d-847a-a8e3a1e7b178 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:56.067339 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3f689-9795-4a5d-847a-a8e3a1e7b178 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:56.067756 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3f689-9795-4a5d-847a-a8e3a1e7b178 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:56.092480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3f689-9795-4a5d-847a-a8e3a1e7b178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:56.095088 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8225f5-d6a4-49f7-9c7c-8569c5d8855e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:56.097110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8225f5-d6a4-49f7-9c7c-8569c5d8855e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:56.097538 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8225f5-d6a4-49f7-9c7c-8569c5d8855e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:56.097950 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8225f5-d6a4-49f7-9c7c-8569c5d8855e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:56.101649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-95f3f689-9795-4a5d-847a-a8e3a1e7b178 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:57:56.101649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:56.101649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:56.101649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:56.101649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:56.101649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:56.101649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:56.101649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:56.101649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:56.101649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:56.101649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:56.101649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:56.101649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:56.101649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:56.101649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:56.101649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:56.102698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:56.102698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:56.102698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:56.102698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:56.102698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:56.102698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:56.102698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:56.102698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:56.102698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:56.102698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:56.102698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:56.102698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:56.102698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:56.102698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:56.102698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:56.102698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:56.103504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:56.103504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:56.103504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:56.103504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:56.103504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:56.103504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:56.103504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:56.103504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:56.103504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:56.103504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:56.103504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:57:56.103504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:56.110372 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 238/485] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:57:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:56.118147 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8225f5-d6a4-49f7-9c7c-8569c5d8855e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:56.124972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3f689-9795-4a5d-847a-a8e3a1e7b178 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:56.132805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-ce8225f5-d6a4-49f7-9c7c-8569c5d8855e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:57:56.132805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:56.132805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:56.132805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:56.132805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:56.132805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:56.132805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:56.132805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:56.132805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:56.132805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:56.132805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:56.132805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:56.132805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:56.132805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:56.132805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:56.132805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:56.133708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:56.133708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:56.133708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:56.133708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:56.133708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:56.133708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:56.133708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:56.133708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:56.133708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:56.133708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:56.133708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:56.133708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:56.133708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:56.133708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:56.133708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:56.133708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:56.134534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:56.134534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:56.134534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:56.134534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:56.134534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:56.134534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:56.134534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:56.134534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:56.134534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:56.134534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:56.134534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:57:56.134534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:56.139762 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 248/486] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:57:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:57:56.146266 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8225f5-d6a4-49f7-9c7c-8569c5d8855e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:56.297972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8225f5-d6a4-49f7-9c7c-8569c5d8855e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:56.312006 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3f689-9795-4a5d-847a-a8e3a1e7b178 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:56.342593 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e25a8-c97e-427f-a186-97ba68212545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:56.343720 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e25a8-c97e-427f-a186-97ba68212545 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:56.344282 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e25a8-c97e-427f-a186-97ba68212545 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:56.344607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e25a8-c97e-427f-a186-97ba68212545 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:56.345629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e25a8-c97e-427f-a186-97ba68212545 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:56.345942 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e25a8-c97e-427f-a186-97ba68212545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:56.347029 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:56.347444 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60e25a8-c97e-427f-a186-97ba68212545 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:56.359563 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 249/487] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 09:57:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:56.362120 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce04c60-32f3-4f10-bc14-d1312c1b94e0 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:56.362559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce04c60-32f3-4f10-bc14-d1312c1b94e0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:56.362977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce04c60-32f3-4f10-bc14-d1312c1b94e0 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:56.368432 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b3908-55cf-45d1-951c-d30632ce0361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:56.368432 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b3908-55cf-45d1-951c-d30632ce0361 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:56.368432 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b3908-55cf-45d1-951c-d30632ce0361 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:56.368432 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b3908-55cf-45d1-951c-d30632ce0361 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:56.368801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b3908-55cf-45d1-951c-d30632ce0361 None admin] RBAC: Adding query filter params (name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:56.368801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b3908-55cf-45d1-951c-d30632ce0361 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:56.369002 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b3908-55cf-45d1-951c-d30632ce0361 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:56.369103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 250/488] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:56.370538 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021df76e-723f-4c8a-9298-e9f5cd21b7f3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:56.371041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021df76e-723f-4c8a-9298-e9f5cd21b7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:56.371455 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021df76e-723f-4c8a-9298-e9f5cd21b7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:56.383688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 239/489] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 09:57:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:57:56.383688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b3908-55cf-45d1-951c-d30632ce0361 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:56.396398 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-021df76e-723f-4c8a-9298-e9f5cd21b7f3 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:56.397835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-021df76e-723f-4c8a-9298-e9f5cd21b7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:56.428515 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:56.481909 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 251/490] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:56.483206 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021df76e-723f-4c8a-9298-e9f5cd21b7f3 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:56.500566 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b3908-55cf-45d1-951c-d30632ce0361 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:56.540279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f167a-8fa6-42ed-b51f-1f6707a9d313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:56.541216 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f167a-8fa6-42ed-b51f-1f6707a9d313 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:56.541499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f167a-8fa6-42ed-b51f-1f6707a9d313 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:56.541782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f167a-8fa6-42ed-b51f-1f6707a9d313 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:56.555590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f167a-8fa6-42ed-b51f-1f6707a9d313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:56.557021 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f167a-8fa6-42ed-b51f-1f6707a9d313 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:56.572559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-621f167a-8fa6-42ed-b51f-1f6707a9d313 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:56.572559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:56.572559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:56.572559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:56.572559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:56.572559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:56.572559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:56.572559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:56.572559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:56.572559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:56.572559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:56.572559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:56.572559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:57:56.572559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:57:56.572559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:57:56.574335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:57:56.574335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:56.574335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:56.574335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:56.574335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:56.574335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:56.574335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:56.574335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:56.574335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:56.574335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:56.574335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:56.574335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:56.574335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:56.574335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:56.574335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:56.574335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:56.574335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:56.575903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:57:56.575903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:57:56.575903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:56.575903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:56.575903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 240/491] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:56.575903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bc710-8c96-4424-b419-7f41bebcadc6 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:56.575903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bc710-8c96-4424-b419-7f41bebcadc6 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:56.575903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bc710-8c96-4424-b419-7f41bebcadc6 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:56.582843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 241/492] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:56.582843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bc710-8c96-4424-b419-7f41bebcadc6 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:56.614464 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021df76e-723f-4c8a-9298-e9f5cd21b7f3 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:56.632564 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:56.654726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d278d86-53c0-4ce6-a999-3b8b807a1ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:56.655371 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d278d86-53c0-4ce6-a999-3b8b807a1ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:56.655683 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d278d86-53c0-4ce6-a999-3b8b807a1ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:56.655930 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d278d86-53c0-4ce6-a999-3b8b807a1ad2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:56.667114 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d278d86-53c0-4ce6-a999-3b8b807a1ad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:56.668589 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d278d86-53c0-4ce6-a999-3b8b807a1ad2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:56.684402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-3d278d86-53c0-4ce6-a999-3b8b807a1ad2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:56.684402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:56.684402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:56.684402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:56.684402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:56.684402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:56.684402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:56.684402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:56.684402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:56.684402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:56.684402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:56.684402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:56.684402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:57:56.684402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:57:56.684402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:57:56.685310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:57:56.685310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:56.685310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:56.685310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:56.685310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:56.685310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:56.685310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:56.685310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:56.685310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:56.685310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:56.685310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:56.685310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:56.685310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:56.685310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:56.685310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:56.685310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:56.685310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:56.686139 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:57:56.686139 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:57:56.686139 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:56.686139 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:56.686139 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 252/493] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:56.686408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d278d86-53c0-4ce6-a999-3b8b807a1ad2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:56.700320 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bc710-8c96-4424-b419-7f41bebcadc6 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:56.703340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:56.735944 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5593f50d-de57-471d-8d50-ef761e646342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:56.736835 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593f50d-de57-471d-8d50-ef761e646342 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:56.737117 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593f50d-de57-471d-8d50-ef761e646342 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:56.737393 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593f50d-de57-471d-8d50-ef761e646342 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:56.747873 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5593f50d-de57-471d-8d50-ef761e646342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:56.753977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-5593f50d-de57-471d-8d50-ef761e646342 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:57:56.753977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:56.753977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:56.753977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:56.753977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:56.753977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:56.753977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:56.753977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:56.753977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:56.753977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:56.753977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:56.753977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:56.753977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:56.753977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:56.753977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:56.753977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:56.754886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:56.754886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:56.754886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:56.754886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:56.754886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:56.754886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:56.754886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:56.754886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:56.754886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:56.754886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:56.754886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:56.754886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:56.754886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:56.754886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:56.754886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:56.754886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:56.755770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:56.755770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:56.755770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:56.755770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:56.755770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:56.755770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:56.755770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:56.755770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:56.755770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:56.755770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:56.755770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:57:56.755770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:56.759902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 242/494] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:57:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:56.761005 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a31205-9b04-4e67-9ef9-9f500d8d1ce1 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:56.761290 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a31205-9b04-4e67-9ef9-9f500d8d1ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:56.761815 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a31205-9b04-4e67-9ef9-9f500d8d1ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:56.779707 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-61a31205-9b04-4e67-9ef9-9f500d8d1ce1 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:56.780939 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-61a31205-9b04-4e67-9ef9-9f500d8d1ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:56.801930 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d278d86-53c0-4ce6-a999-3b8b807a1ad2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:56.842460 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd8ba2-7dc3-4e68-8394-4522d95c341e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:56.843021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd8ba2-7dc3-4e68-8394-4522d95c341e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:56.843316 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd8ba2-7dc3-4e68-8394-4522d95c341e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:56.843569 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd8ba2-7dc3-4e68-8394-4522d95c341e None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:56.844268 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd8ba2-7dc3-4e68-8394-4522d95c341e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:56.844615 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd8ba2-7dc3-4e68-8394-4522d95c341e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:56.846896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd8ba2-7dc3-4e68-8394-4522d95c341e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:56.860489 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 243/495] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:56.860489 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a31205-9b04-4e67-9ef9-9f500d8d1ce1 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:56.872611 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 253/496] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:56.873563 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd8ba2-7dc3-4e68-8394-4522d95c341e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:56.896032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:56.954200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:56.965508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a31205-9b04-4e67-9ef9-9f500d8d1ce1 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:56.981091 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd8ba2-7dc3-4e68-8394-4522d95c341e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:56.999751 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b2856-9311-49a7-a809-47010c57856c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:57.000365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b2856-9311-49a7-a809-47010c57856c None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:57.000712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b2856-9311-49a7-a809-47010c57856c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:57.000992 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b2856-9311-49a7-a809-47010c57856c None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:57.002745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b2856-9311-49a7-a809-47010c57856c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:57.003052 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b2856-9311-49a7-a809-47010c57856c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:57.004427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b2856-9311-49a7-a809-47010c57856c None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:57.015682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 244/497] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:57.016272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b2856-9311-49a7-a809-47010c57856c None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:57.018909 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1290e2-a7e9-4979-9acc-9171d92986a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:57.019520 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1290e2-a7e9-4979-9acc-9171d92986a9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:57.019805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1290e2-a7e9-4979-9acc-9171d92986a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:57.020525 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1290e2-a7e9-4979-9acc-9171d92986a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:57.020827 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1290e2-a7e9-4979-9acc-9171d92986a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:57.021129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1290e2-a7e9-4979-9acc-9171d92986a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:57.022501 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1290e2-a7e9-4979-9acc-9171d92986a9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:57.030640 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 254/498] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 09:57:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:57.031806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93543a-519f-4e7d-b2b3-6cadfd099944 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:57.032090 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93543a-519f-4e7d-b2b3-6cadfd099944 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:57.032364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93543a-519f-4e7d-b2b3-6cadfd099944 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:57.036504 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 255/499] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:57:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:57:57.036504 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93543a-519f-4e7d-b2b3-6cadfd099944 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:57.113420 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:57.123136 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b2856-9311-49a7-a809-47010c57856c None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:57.139233 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93543a-519f-4e7d-b2b3-6cadfd099944 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:57.157688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d737efe-20ab-42a4-9178-3b038d19e952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:57.158497 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d737efe-20ab-42a4-9178-3b038d19e952 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:57.158780 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d737efe-20ab-42a4-9178-3b038d19e952 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:57.159055 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d737efe-20ab-42a4-9178-3b038d19e952 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:57.166437 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d737efe-20ab-42a4-9178-3b038d19e952 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:57.167886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d737efe-20ab-42a4-9178-3b038d19e952 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:57.173785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c2db6-0628-4665-bf8a-fa9392bcac80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:57.174413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c2db6-0628-4665-bf8a-fa9392bcac80 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:57.174697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c2db6-0628-4665-bf8a-fa9392bcac80 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:57.174968 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c2db6-0628-4665-bf8a-fa9392bcac80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:57.177551 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:57.181480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-2d737efe-20ab-42a4-9178-3b038d19e952 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:57:57.181480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:57.181480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:57.181480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:57.181480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:57.181480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:57.181480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:57.181480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:57.181480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:57.181480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:57.181480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:57.181480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:57.181480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:57:57.181480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:57:57.181480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:57:57.181480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:57:57.182412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:57.182412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:57.182412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:57:57.182412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:57:57.182412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:57:57.182412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:57:57.182412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:57.182412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:57.182412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:57.182412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:57.182412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:57.182412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:57.182412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:57.182412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:57.182412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:57.182412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:57.182412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:57.182412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:57.183309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:57.183309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:57.183309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:57:57.183309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:57:57.183309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:57:57.183309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:57:57.183309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:57:57.183309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:57:57.183309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:57:57.183309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:57.186170 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c2db6-0628-4665-bf8a-fa9392bcac80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:57:57.187496 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 245/500] 10.222.0.85 () {56 vars in 1093 bytes} [Tue Aug 2 09:57:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:57.188321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d737efe-20ab-42a4-9178-3b038d19e952 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:57.191878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-c30c2db6-0628-4665-bf8a-fa9392bcac80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:57:57.191878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:57.191878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:57.191878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:57.191878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:57.191878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:57.191878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:57.191878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:57.191878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:57.191878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:57.191878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:57.191878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:57.191878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:57:57.191878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:57:57.191878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:57:57.191878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:57:57.192782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:57:57.192782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:57:57.192782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:57:57.192782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:57:57.192782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:57.192782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:57.192782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:57.192782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:57.192782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:57.192782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:57.192782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:57.192782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:57.192782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:57.192782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:57.192782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:57.192782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:57.195217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:57.195217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:57.195217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:57.195217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:57.195217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:57:57.195217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:57:57.195217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:57:57.195217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:57:57.195217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:57:57.195217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:57:57.195217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:57:57.195217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:57.195217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 256/501] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:57:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:57.195217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c2db6-0628-4665-bf8a-fa9392bcac80 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:57.291161 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d737efe-20ab-42a4-9178-3b038d19e952 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:57.299619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c2db6-0628-4665-bf8a-fa9392bcac80 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:57.324914 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43b627-2154-4040-a9fd-2fea01c7f360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:57.325543 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43b627-2154-4040-a9fd-2fea01c7f360 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:57.325820 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43b627-2154-4040-a9fd-2fea01c7f360 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:57.326100 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43b627-2154-4040-a9fd-2fea01c7f360 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:57.334019 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13552e-f341-4983-8f46-24cac3222fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:57.334159 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43b627-2154-4040-a9fd-2fea01c7f360 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:57.334655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13552e-f341-4983-8f46-24cac3222fee None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:57.334938 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13552e-f341-4983-8f46-24cac3222fee None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:57.335213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13552e-f341-4983-8f46-24cac3222fee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:57.335476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43b627-2154-4040-a9fd-2fea01c7f360 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:57.345921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13552e-f341-4983-8f46-24cac3222fee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:57.347373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d13552e-f341-4983-8f46-24cac3222fee None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:57.347517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-0b43b627-2154-4040-a9fd-2fea01c7f360 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 09:57:57.347517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:57.347517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:57.347517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:57.347517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:57.347517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:57.347517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:57.347517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:57.347517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:57.347517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:57.347517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:57.347517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:57.347517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:57:57.347517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:57:57.347517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:57:57.347517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:57:57.348360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:57.348360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:57.348360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:57:57.348360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:57:57.348360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:57:57.348360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:57:57.348360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:57.348360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:57.348360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:57.348360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:57.348360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:57.348360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:57.348360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:57.348360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:57.348360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:57.348360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:57.348360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:57.348360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:57.349268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:57.349268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:57.349268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:57:57.349268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:57:57.349268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:57:57.349268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:57:57.349268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:57:57.349268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:57:57.349268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 09:57:57.349268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:57.349268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 246/502] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:57.349819 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e3698-ce92-447c-8820-3fcebcbbbb0b None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:57.350116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e3698-ce92-447c-8820-3fcebcbbbb0b None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:57.350293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e3698-ce92-447c-8820-3fcebcbbbb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:57.366696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-0d13552e-f341-4983-8f46-24cac3222fee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:57.366696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:57.366696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:57.366696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:57.366696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:57.366696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:57.366696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:57.366696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:57.366696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:57.366696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:57.366696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:57.366696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:57.366696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:57:57.366696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:57:57.366696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:57:57.367572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:57:57.367572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:57.367572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:57.367572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:57.367572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:57.367572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:57.367572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:57.367572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:57.367572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:57.367572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:57.367572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:57.367572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:57.367572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:57.367572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:57.367572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:57.367572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:57.367572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:57.368422 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:57:57.368422 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:57:57.368422 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:57.368422 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:57.369235 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-900e3698-ce92-447c-8820-3fcebcbbbb0b None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:57:57.369378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 257/503] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:57.369378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13552e-f341-4983-8f46-24cac3222fee None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:57.369631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-900e3698-ce92-447c-8820-3fcebcbbbb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:57:57.377261 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:57.420754 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:57.437634 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 247/504] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:57:57.438464 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e3698-ce92-447c-8820-3fcebcbbbb0b None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:57.480548 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13552e-f341-4983-8f46-24cac3222fee None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:57.514430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f97ed-a04a-4200-aed5-991e53001cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:57.515040 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f97ed-a04a-4200-aed5-991e53001cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:57.515322 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f97ed-a04a-4200-aed5-991e53001cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:57.515600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f97ed-a04a-4200-aed5-991e53001cc2 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:57.516389 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f97ed-a04a-4200-aed5-991e53001cc2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:57.516934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f97ed-a04a-4200-aed5-991e53001cc2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:57.518706 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f97ed-a04a-4200-aed5-991e53001cc2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:57.538316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e3698-ce92-447c-8820-3fcebcbbbb0b None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:57.556746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 258/505] 10.222.0.85 () {56 vars in 1133 bytes} [Tue Aug 2 09:57:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:57.557595 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f97ed-a04a-4200-aed5-991e53001cc2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:57.574095 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af78a13-b928-4793-b121-afb5fdfeb0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:57.574715 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af78a13-b928-4793-b121-afb5fdfeb0de None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:57.575003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af78a13-b928-4793-b121-afb5fdfeb0de None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:57.575280 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af78a13-b928-4793-b121-afb5fdfeb0de None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:57.575999 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af78a13-b928-4793-b121-afb5fdfeb0de None admin] RBAC: Adding query filter params (name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:57.576309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af78a13-b928-4793-b121-afb5fdfeb0de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:57.577718 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af78a13-b928-4793-b121-afb5fdfeb0de None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:57.585689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 248/506] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 09:57:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:57.586481 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af78a13-b928-4793-b121-afb5fdfeb0de None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:57.589753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:57.664454 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f97ed-a04a-4200-aed5-991e53001cc2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:57.671624 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:57.686899 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af78a13-b928-4793-b121-afb5fdfeb0de None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:57.698728 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a7c76-b0c7-4c35-b54c-8ead0361194a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:57.699343 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a7c76-b0c7-4c35-b54c-8ead0361194a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:57.699630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a7c76-b0c7-4c35-b54c-8ead0361194a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:57.699905 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a7c76-b0c7-4c35-b54c-8ead0361194a None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:57.700737 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a7c76-b0c7-4c35-b54c-8ead0361194a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:57.701044 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a7c76-b0c7-4c35-b54c-8ead0361194a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:57.702491 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a7c76-b0c7-4c35-b54c-8ead0361194a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:57.720674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 259/507] 10.222.0.85 () {56 vars in 1137 bytes} [Tue Aug 2 09:57:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:57.721472 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11702b-d324-4d12-b225-50c7a51d81e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:57.722006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a7c76-b0c7-4c35-b54c-8ead0361194a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:57.722188 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11702b-d324-4d12-b225-50c7a51d81e4 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:57.722475 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11702b-d324-4d12-b225-50c7a51d81e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:57.722753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11702b-d324-4d12-b225-50c7a51d81e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:57.723508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11702b-d324-4d12-b225-50c7a51d81e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:57.723822 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11702b-d324-4d12-b225-50c7a51d81e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:57.725377 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11702b-d324-4d12-b225-50c7a51d81e4 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:57.737676 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 249/508] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:57.738563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11702b-d324-4d12-b225-50c7a51d81e4 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:57.800171 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:57.824129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a7c76-b0c7-4c35-b54c-8ead0361194a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:57.839202 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11702b-d324-4d12-b225-50c7a51d81e4 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:57.860786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36535abf-929d-440f-9754-f803f299b902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:57.861420 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36535abf-929d-440f-9754-f803f299b902 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:57.861702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36535abf-929d-440f-9754-f803f299b902 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:57.861983 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36535abf-929d-440f-9754-f803f299b902 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:57.872931 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36535abf-929d-440f-9754-f803f299b902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:57.874390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36535abf-929d-440f-9754-f803f299b902 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:57.874600 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d290e09-f6f3-43f4-a5c1-44ea42824541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:57.875264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d290e09-f6f3-43f4-a5c1-44ea42824541 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:57.875550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d290e09-f6f3-43f4-a5c1-44ea42824541 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:57.875831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d290e09-f6f3-43f4-a5c1-44ea42824541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:57.890041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-36535abf-929d-440f-9754-f803f299b902 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:57.890041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:57.890041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:57.890041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:57.890041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:57.890041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:57.890041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:57.890041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:57.890041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:57.890041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:57.890041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:57.890041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:57.890041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:57:57.890041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:57:57.890041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:57:57.890998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:57:57.890998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:57.890998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:57.890998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:57.890998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:57.890998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:57.890998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:57.890998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:57.890998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:57.890998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:57.890998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:57.890998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:57.890998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:57.890998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:57.890998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:57.890998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:57.890998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:57.892939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:57:57.892939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:57:57.892939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:57.892939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:57.892939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 260/509] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:57.893219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36535abf-929d-440f-9754-f803f299b902 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:57.911088 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:57.948007 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d290e09-f6f3-43f4-a5c1-44ea42824541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:57.949507 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d290e09-f6f3-43f4-a5c1-44ea42824541 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:57.997265 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36535abf-929d-440f-9754-f803f299b902 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:58.010686 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:58.030338 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1747c0-ed8d-4589-9a5d-f3d1b81110a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:58.030972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1747c0-ed8d-4589-9a5d-f3d1b81110a5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:58.031253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1747c0-ed8d-4589-9a5d-f3d1b81110a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:58.031529 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1747c0-ed8d-4589-9a5d-f3d1b81110a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:58.042654 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1747c0-ed8d-4589-9a5d-f3d1b81110a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:58.044088 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1747c0-ed8d-4589-9a5d-f3d1b81110a5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:58.049518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 250/510] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:58.050137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d290e09-f6f3-43f4-a5c1-44ea42824541 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:58.062602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-9f1747c0-ed8d-4589-9a5d-f3d1b81110a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:58.062602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:58.062602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:58.062602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:58.062602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:58.062602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:58.062602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:58.062602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:58.062602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:58.062602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:58.062602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:58.062602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:58.062602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:57:58.062602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:57:58.062602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:57:58.064003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:57:58.064003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:58.064003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:58.064003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:58.064003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:58.064003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:58.064003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:58.064003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:58.064003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:58.064003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:58.064003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:58.064003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:58.064003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:58.064003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:58.064003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:58.064003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:58.064003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:58.065527 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:57:58.065527 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:57:58.065527 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:58.065527 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:58.065527 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 261/511] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:58.065527 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1747c0-ed8d-4589-9a5d-f3d1b81110a5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:58.132559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:58.160374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d290e09-f6f3-43f4-a5c1-44ea42824541 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:58.167288 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1747c0-ed8d-4589-9a5d-f3d1b81110a5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:58.194231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0bbe3-81f4-45ac-9ea9-39453993382e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:58.194838 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0bbe3-81f4-45ac-9ea9-39453993382e None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:58.195125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0bbe3-81f4-45ac-9ea9-39453993382e None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:58.195397 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0bbe3-81f4-45ac-9ea9-39453993382e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:58.200593 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1275929-6e39-422c-86b9-21ec65097239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:58.201193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1275929-6e39-422c-86b9-21ec65097239 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:58.201476 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1275929-6e39-422c-86b9-21ec65097239 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:58.201753 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1275929-6e39-422c-86b9-21ec65097239 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:58.209381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1275929-6e39-422c-86b9-21ec65097239 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:58.210848 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1275929-6e39-422c-86b9-21ec65097239 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:58.223979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e1275929-6e39-422c-86b9-21ec65097239 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 09:57:58.223979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:58.223979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:58.223979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:58.223979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:58.223979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:58.223979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:58.223979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:58.223979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:58.223979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:58.223979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:58.223979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:58.223979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:57:58.223979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:57:58.223979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:57:58.223979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:57:58.225071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:58.225071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:58.225071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:57:58.225071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:57:58.225071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:57:58.225071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:57:58.225071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:58.225071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:58.225071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:58.225071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:58.225071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:58.225071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:58.225071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:58.225071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:58.225071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:58.225071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:58.225071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:58.225071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:58.226418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:58.226418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:58.226418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:57:58.226418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:57:58.226418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:57:58.226418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:57:58.226418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:57:58.226418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:57:58.226418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 09:57:58.226418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:58.226418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 262/512] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:57:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:58.226418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1275929-6e39-422c-86b9-21ec65097239 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:58.227570 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:58.267517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0bbe3-81f4-45ac-9ea9-39453993382e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:58.269028 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0bbe3-81f4-45ac-9ea9-39453993382e None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:58.329217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1275929-6e39-422c-86b9-21ec65097239 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:58.356107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:58.365410 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc844ee4-eab8-4bf3-8776-bcd77b3e6e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:58.366020 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc844ee4-eab8-4bf3-8776-bcd77b3e6e2c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:58.366304 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc844ee4-eab8-4bf3-8776-bcd77b3e6e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:58.366578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc844ee4-eab8-4bf3-8776-bcd77b3e6e2c None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:58.367267 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc844ee4-eab8-4bf3-8776-bcd77b3e6e2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:58.367571 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc844ee4-eab8-4bf3-8776-bcd77b3e6e2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:58.368892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 251/513] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:58.369078 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc844ee4-eab8-4bf3-8776-bcd77b3e6e2c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:58.369577 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0bbe3-81f4-45ac-9ea9-39453993382e None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:58.381651 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 263/514] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:58.382463 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc844ee4-eab8-4bf3-8776-bcd77b3e6e2c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:58.432255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:58.471388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0bbe3-81f4-45ac-9ea9-39453993382e None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:58.481976 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc844ee4-eab8-4bf3-8776-bcd77b3e6e2c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:58.505851 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcee37b-1c2e-43c9-bb6f-f1fe5bb9630f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:58.506466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcee37b-1c2e-43c9-bb6f-f1fe5bb9630f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:58.506746 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcee37b-1c2e-43c9-bb6f-f1fe5bb9630f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:58.507022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcee37b-1c2e-43c9-bb6f-f1fe5bb9630f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:58.516215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cc9b4-4510-46f7-b7a3-f239c4c17ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:58.517472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cc9b4-4510-46f7-b7a3-f239c4c17ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:58.517735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcee37b-1c2e-43c9-bb6f-f1fe5bb9630f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:58.517828 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cc9b4-4510-46f7-b7a3-f239c4c17ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:58.518047 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7cc9b4-4510-46f7-b7a3-f239c4c17ff2 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:58.518734 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cc9b4-4510-46f7-b7a3-f239c4c17ff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:58.519035 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cc9b4-4510-46f7-b7a3-f239c4c17ff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:58.519190 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcee37b-1c2e-43c9-bb6f-f1fe5bb9630f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:58.520377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7cc9b4-4510-46f7-b7a3-f239c4c17ff2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:58.531253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 264/515] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:58.532030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cc9b4-4510-46f7-b7a3-f239c4c17ff2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:58.533710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-7dcee37b-1c2e-43c9-bb6f-f1fe5bb9630f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:58.533710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:58.533710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:58.533710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:58.533710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:58.533710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:58.533710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:58.533710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:58.533710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:58.533710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:58.533710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:58.533710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:58.533710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:57:58.533710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:57:58.533710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:57:58.534540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:57:58.534540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:58.534540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:58.534540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:58.534540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:58.534540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:58.534540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:58.534540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:58.534540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:58.534540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:58.534540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:58.534540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:58.534540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:58.534540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:58.534540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:58.534540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:58.534540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:58.535408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:57:58.535408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:57:58.535408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:58.535408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:58.535408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 252/516] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:58.536350 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcee37b-1c2e-43c9-bb6f-f1fe5bb9630f None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:58.585675 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:58.636525 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7cc9b4-4510-46f7-b7a3-f239c4c17ff2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:58.636697 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcee37b-1c2e-43c9-bb6f-f1fe5bb9630f None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:58.652714 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:58.670768 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b236e5-04fe-42fa-894a-9ba61e24f412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:58.671121 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c57f7-0922-49c4-9bf8-7057082152f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:58.671585 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b236e5-04fe-42fa-894a-9ba61e24f412 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:58.671688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b236e5-04fe-42fa-894a-9ba61e24f412 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:58.671768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c57f7-0922-49c4-9bf8-7057082152f9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:58.671934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b236e5-04fe-42fa-894a-9ba61e24f412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:58.672044 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c57f7-0922-49c4-9bf8-7057082152f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:58.672245 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c57f7-0922-49c4-9bf8-7057082152f9 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:58.673702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c57f7-0922-49c4-9bf8-7057082152f9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:58.674003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c57f7-0922-49c4-9bf8-7057082152f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:58.675424 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c57f7-0922-49c4-9bf8-7057082152f9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:58.683961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b236e5-04fe-42fa-894a-9ba61e24f412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:58.685442 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b236e5-04fe-42fa-894a-9ba61e24f412 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:58.692266 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 265/517] 10.222.0.85 () {56 vars in 1137 bytes} [Tue Aug 2 09:57:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:58.693076 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c57f7-0922-49c4-9bf8-7057082152f9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:58.699829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-67b236e5-04fe-42fa-894a-9ba61e24f412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:58.699829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:58.699829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:58.699829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:58.699829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:58.699829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:58.699829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:58.699829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:58.699829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:58.699829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:58.699829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:58.699829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:58.699829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:57:58.699829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:57:58.699829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:57:58.700864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:57:58.700864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:58.700864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:58.700864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:58.700864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:58.700864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:58.700864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:58.700864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:58.700864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:58.700864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:58.700864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:58.700864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:58.700864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:58.700864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:58.700864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:58.700864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:58.700864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:58.706341 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:57:58.706341 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:57:58.706341 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:58.706341 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:58.706341 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 253/518] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:58.706341 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b236e5-04fe-42fa-894a-9ba61e24f412 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:58.796109 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c57f7-0922-49c4-9bf8-7057082152f9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:58.800626 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b236e5-04fe-42fa-894a-9ba61e24f412 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:58.803371 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:58.831047 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dbee4-cfb4-44f0-9b59-15d937b4447b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:58.831659 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dbee4-cfb4-44f0-9b59-15d937b4447b None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:58.831941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dbee4-cfb4-44f0-9b59-15d937b4447b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:58.832214 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dbee4-cfb4-44f0-9b59-15d937b4447b None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:58.832932 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86dbee4-cfb4-44f0-9b59-15d937b4447b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:58.834352 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86dbee4-cfb4-44f0-9b59-15d937b4447b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:58.835887 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d9682-3023-46ea-92cd-80ae75e1e5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:58.836574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d9682-3023-46ea-92cd-80ae75e1e5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:58.836863 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d9682-3023-46ea-92cd-80ae75e1e5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:58.837142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d9682-3023-46ea-92cd-80ae75e1e5b4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:58.845450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d9682-3023-46ea-92cd-80ae75e1e5b4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:58.846943 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d9682-3023-46ea-92cd-80ae75e1e5b4 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:58.858737 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 266/519] 10.222.0.85 () {60 vars in 1132 bytes} [Tue Aug 2 09:57:58 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:57:58.859550 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dbee4-cfb4-44f0-9b59-15d937b4447b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:58.859667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-ff7d9682-3023-46ea-92cd-80ae75e1e5b4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 09:57:58.859667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:58.859667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:58.859667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:58.859667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:58.859667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:58.859667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:58.859667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:58.859667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:58.859667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:58.859667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:58.859667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:58.859667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:57:58.859667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:57:58.859667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:57:58.859667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:57:58.860588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:58.860588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:58.860588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:57:58.860588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:57:58.860588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:57:58.860588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:57:58.860588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:58.860588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:58.860588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:58.860588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:58.860588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:58.860588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:58.860588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:58.860588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:58.860588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:58.860588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:58.860588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:58.860588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:58.861636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:58.861636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:58.861636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:57:58.861636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:57:58.861636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:57:58.861636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:57:58.861636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:57:58.861636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:57:58.861636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 09:57:58.861636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:58.861636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 254/520] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:57:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:58.862180 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d9682-3023-46ea-92cd-80ae75e1e5b4 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:58.903690 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:58.984725 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d9682-3023-46ea-92cd-80ae75e1e5b4 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:58.989535 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dbee4-cfb4-44f0-9b59-15d937b4447b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:59.029724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7115fd7-3585-4dc2-83d1-d1c67ce82420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:59.030350 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7115fd7-3585-4dc2-83d1-d1c67ce82420 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:59.030593 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e63a1-5006-49a9-b73d-d57961cf0719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:59.030743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7115fd7-3585-4dc2-83d1-d1c67ce82420 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:59.030895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7115fd7-3585-4dc2-83d1-d1c67ce82420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:59.031211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e63a1-5006-49a9-b73d-d57961cf0719 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:59.031503 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e63a1-5006-49a9-b73d-d57961cf0719 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:59.031780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e63a1-5006-49a9-b73d-d57961cf0719 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:59.033040 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e63a1-5006-49a9-b73d-d57961cf0719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:59.033349 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e63a1-5006-49a9-b73d-d57961cf0719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:59.034924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e63a1-5006-49a9-b73d-d57961cf0719 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:59.048132 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 267/521] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:59.049302 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e63a1-5006-49a9-b73d-d57961cf0719 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:59.078345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:59.114410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7115fd7-3585-4dc2-83d1-d1c67ce82420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:59.115875 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7115fd7-3585-4dc2-83d1-d1c67ce82420 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:59.145656 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:59.169962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e63a1-5006-49a9-b73d-d57961cf0719 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:59.206161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0d3b9-1ae8-4930-9c5b-0bbbc3665a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:59.206776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0d3b9-1ae8-4930-9c5b-0bbbc3665a4e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:59.207054 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0d3b9-1ae8-4930-9c5b-0bbbc3665a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:59.207324 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0d3b9-1ae8-4930-9c5b-0bbbc3665a4e None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:59.208023 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0d3b9-1ae8-4930-9c5b-0bbbc3665a4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:59.208321 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0d3b9-1ae8-4930-9c5b-0bbbc3665a4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:59.210217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0d3b9-1ae8-4930-9c5b-0bbbc3665a4e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:59.222673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 268/522] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:59.223388 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0d3b9-1ae8-4930-9c5b-0bbbc3665a4e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:59.232255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 255/523] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:59.232255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7115fd7-3585-4dc2-83d1-d1c67ce82420 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:59.318767 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:59.340058 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7115fd7-3585-4dc2-83d1-d1c67ce82420 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:59.340237 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0d3b9-1ae8-4930-9c5b-0bbbc3665a4e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:59.371303 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:59.379505 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e336a-6f15-4697-9ca4-cd530261dbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:59.380140 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e336a-6f15-4697-9ca4-cd530261dbd9 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:59.380419 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e336a-6f15-4697-9ca4-cd530261dbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:59.380715 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e336a-6f15-4697-9ca4-cd530261dbd9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:59.381000 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8544de-e584-416d-b770-df12ad4ccfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:59.381814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8544de-e584-416d-b770-df12ad4ccfb0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:59.382099 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8544de-e584-416d-b770-df12ad4ccfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:59.382502 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8544de-e584-416d-b770-df12ad4ccfb0 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:59.383409 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8544de-e584-416d-b770-df12ad4ccfb0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:59.383723 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8544de-e584-416d-b770-df12ad4ccfb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:59.385246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8544de-e584-416d-b770-df12ad4ccfb0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:59.387618 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e336a-6f15-4697-9ca4-cd530261dbd9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:59.389078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e336a-6f15-4697-9ca4-cd530261dbd9 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:59.401657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-868e336a-6f15-4697-9ca4-cd530261dbd9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:57:59.401657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:59.401657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:59.401657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:59.401657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:59.401657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:59.401657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:59.401657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:59.401657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:59.401657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:59.401657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:59.401657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:59.401657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:57:59.401657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:57:59.401657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:57:59.402644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:57:59.402644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:59.402644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:59.402644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:59.402644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:59.402644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:59.402644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:59.402644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:59.402644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:59.402644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:59.402644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:59.402644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:59.402644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:59.402644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:59.402644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:59.402644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:59.402644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:59.403476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:57:59.403476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:57:59.403476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:57:59.403476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:57:59.403476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:57:59.403476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:57:59.403476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:57:59.403476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:59.403476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 256/524] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:57:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:59.403968 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e336a-6f15-4697-9ca4-cd530261dbd9 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:59.410735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 269/525] 10.222.0.85 () {56 vars in 1139 bytes} [Tue Aug 2 09:57:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:59.415839 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8544de-e584-416d-b770-df12ad4ccfb0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:59.513743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e336a-6f15-4697-9ca4-cd530261dbd9 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:59.519198 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8544de-e584-416d-b770-df12ad4ccfb0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:59.552308 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3665f53-b398-4cfc-9ebf-bb51d2712011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:59.553238 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3665f53-b398-4cfc-9ebf-bb51d2712011 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:59.553522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3665f53-b398-4cfc-9ebf-bb51d2712011 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:59.553884 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3665f53-b398-4cfc-9ebf-bb51d2712011 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:59.556690 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2e9f0-5a24-438f-894d-c4b4d997cd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:59.557330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2e9f0-5a24-438f-894d-c4b4d997cd89 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:59.557613 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2e9f0-5a24-438f-894d-c4b4d997cd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:59.557890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2e9f0-5a24-438f-894d-c4b4d997cd89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:59.561720 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3665f53-b398-4cfc-9ebf-bb51d2712011 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:59.563679 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3665f53-b398-4cfc-9ebf-bb51d2712011 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:59.566698 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:59.569783 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2e9f0-5a24-438f-894d-c4b4d997cd89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:59.571872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2e9f0-5a24-438f-894d-c4b4d997cd89 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:59.577449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-b3665f53-b398-4cfc-9ebf-bb51d2712011 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:57:59.577449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:59.577449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:59.577449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:59.577449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:59.577449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:59.577449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:59.577449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:59.577449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:59.577449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:59.577449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:59.577449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:59.577449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:57:59.577449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:57:59.577449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:57:59.578349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:57:59.578349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:59.578349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:59.578349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:59.578349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:59.578349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:59.578349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:59.578349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:59.578349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:59.578349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:59.578349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:59.578349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:59.578349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:59.578349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:59.578349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:59.578349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:59.578349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:59.580590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:57:59.580590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:57:59.580590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:57:59.580590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:57:59.580590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:57:59.580590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:57:59.580590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:57:59.580590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:57:59.580590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 257/526] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:57:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:59.581436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3665f53-b398-4cfc-9ebf-bb51d2712011 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:59.592242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-f2e2e9f0-5a24-438f-894d-c4b4d997cd89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:59.592242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:57:59.592242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:57:59.592242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:57:59.592242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:57:59.592242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:57:59.592242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:57:59.592242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:57:59.592242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:57:59.592242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:57:59.592242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:57:59.592242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:57:59.592242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:57:59.592242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:57:59.592242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:57:59.593174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:57:59.593174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:57:59.593174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:57:59.593174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:57:59.593174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:57:59.593174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:57:59.593174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:57:59.593174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:57:59.593174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:57:59.593174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:57:59.593174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:57:59.593174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:57:59.593174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:57:59.593174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:57:59.593174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:57:59.593174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:57:59.593174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:57:59.594045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:57:59.594045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:57:59.594045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:57:59.594045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:57:59.596792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 270/527] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:57:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:57:59.597956 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2e9f0-5a24-438f-894d-c4b4d997cd89 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:59.640922 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:59.699563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3665f53-b398-4cfc-9ebf-bb51d2712011 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:59.708791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2e9f0-5a24-438f-894d-c4b4d997cd89 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:59.736257 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270a748-7984-4dc3-bd3e-b1b43c305234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:59.737010 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270a748-7984-4dc3-bd3e-b1b43c305234 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:59.737185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270a748-7984-4dc3-bd3e-b1b43c305234 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:59.737449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270a748-7984-4dc3-bd3e-b1b43c305234 None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:59.738279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270a748-7984-4dc3-bd3e-b1b43c305234 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:59.738565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270a748-7984-4dc3-bd3e-b1b43c305234 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:59.739989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270a748-7984-4dc3-bd3e-b1b43c305234 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:59.745073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c895ec9-e2b0-482b-a944-dd5405a88149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:59.745687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c895ec9-e2b0-482b-a944-dd5405a88149 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:59.745970 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c895ec9-e2b0-482b-a944-dd5405a88149 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:59.746246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c895ec9-e2b0-482b-a944-dd5405a88149 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:59.758692 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 258/528] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:57:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:59.761622 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270a748-7984-4dc3-bd3e-b1b43c305234 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:59.810784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:59.822948 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c895ec9-e2b0-482b-a944-dd5405a88149 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:59.824337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c895ec9-e2b0-482b-a944-dd5405a88149 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:59.864445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270a748-7984-4dc3-bd3e-b1b43c305234 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:57:59.874707 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:57:59.903744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9904142-dc60-44ef-a7a4-9942cd205997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:57:59.904364 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9904142-dc60-44ef-a7a4-9942cd205997 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:57:59.904676 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9904142-dc60-44ef-a7a4-9942cd205997 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:57:59.904953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9904142-dc60-44ef-a7a4-9942cd205997 None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:57:59.905707 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9904142-dc60-44ef-a7a4-9942cd205997 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:57:59.906017 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9904142-dc60-44ef-a7a4-9942cd205997 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:57:59.908373 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9904142-dc60-44ef-a7a4-9942cd205997 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:57:59.921160 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 259/529] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:57:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:57:59.921780 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9904142-dc60-44ef-a7a4-9942cd205997 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:57:59.944372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 271/530] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:57:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:57:59.944372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c895ec9-e2b0-482b-a944-dd5405a88149 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:00.030868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9904142-dc60-44ef-a7a4-9942cd205997 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:00.046815 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:00.058746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c895ec9-e2b0-482b-a944-dd5405a88149 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:00.066011 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbb84f-cf6e-4b5c-b574-c51ee8116736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:00.066629 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbb84f-cf6e-4b5c-b574-c51ee8116736 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:00.066915 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbb84f-cf6e-4b5c-b574-c51ee8116736 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:00.067193 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbb84f-cf6e-4b5c-b574-c51ee8116736 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:00.067886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbb84f-cf6e-4b5c-b574-c51ee8116736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:00.068195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbb84f-cf6e-4b5c-b574-c51ee8116736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:00.069618 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbb84f-cf6e-4b5c-b574-c51ee8116736 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:00.086739 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 260/531] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:00.086739 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbb84f-cf6e-4b5c-b574-c51ee8116736 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:00.095789 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62393f8-ee76-4bb4-a6bc-9c851ccdc46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:00.096404 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62393f8-ee76-4bb4-a6bc-9c851ccdc46a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:00.096718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62393f8-ee76-4bb4-a6bc-9c851ccdc46a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:00.096991 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62393f8-ee76-4bb4-a6bc-9c851ccdc46a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:00.097797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62393f8-ee76-4bb4-a6bc-9c851ccdc46a None admin] RBAC: Adding query filter params (role.id=e30f587367384737a72bbcc2e35d62ad, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=310867deefd34a598cfef2f3e4245ace) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:00.098112 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62393f8-ee76-4bb4-a6bc-9c851ccdc46a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:00.099555 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62393f8-ee76-4bb4-a6bc-9c851ccdc46a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:00.105603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 272/532] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:57:59 2022] GET /identity/v3/role_assignments?user.id=310867deefd34a598cfef2f3e4245ace&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=e30f587367384737a72bbcc2e35d62ad => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:00.106620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62393f8-ee76-4bb4-a6bc-9c851ccdc46a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:00.128441 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:00.218473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbb84f-cf6e-4b5c-b574-c51ee8116736 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:00.239373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62393f8-ee76-4bb4-a6bc-9c851ccdc46a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:00.274500 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54307f08-2fc5-48d8-bae5-f81a33fa6512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:00.275496 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54307f08-2fc5-48d8-bae5-f81a33fa6512 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:00.276043 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54307f08-2fc5-48d8-bae5-f81a33fa6512 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:00.276595 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54307f08-2fc5-48d8-bae5-f81a33fa6512 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:00.277670 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54307f08-2fc5-48d8-bae5-f81a33fa6512 None admin] RBAC: Adding query filter params (role.id=e30f587367384737a72bbcc2e35d62ad, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=0af63c36df2c4ceaa2df4d3ac59542bc) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:00.278196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54307f08-2fc5-48d8-bae5-f81a33fa6512 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:00.280026 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54307f08-2fc5-48d8-bae5-f81a33fa6512 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:00.283242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2d80e-127f-4c0a-87c8-5bdb3b3b45ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:00.283916 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2d80e-127f-4c0a-87c8-5bdb3b3b45ab None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:00.284202 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2d80e-127f-4c0a-87c8-5bdb3b3b45ab None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:00.284513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2d80e-127f-4c0a-87c8-5bdb3b3b45ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:00.289303 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 261/533] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:58:00 2022] GET /identity/v3/role_assignments?user.id=0af63c36df2c4ceaa2df4d3ac59542bc&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=e30f587367384737a72bbcc2e35d62ad => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:00.290466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54307f08-2fc5-48d8-bae5-f81a33fa6512 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:00.303163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2d80e-127f-4c0a-87c8-5bdb3b3b45ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:00.304667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2d80e-127f-4c0a-87c8-5bdb3b3b45ab None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:00.324031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5be2d80e-127f-4c0a-87c8-5bdb3b3b45ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:00.324031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:00.324031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:00.324031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:00.324031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:00.324031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:00.324031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:00.324031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:00.324031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:00.324031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:00.324031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:00.324031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:00.324031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:00.324031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:00.324031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:00.325008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:00.325008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:00.325008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:00.325008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:00.325008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:00.325008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:00.325008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:00.325008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:00.325008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:00.325008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:00.325008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:00.325008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:00.325008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:00.325008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:00.325008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:00.325008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:00.325008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:00.325856 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:00.325856 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:00.325856 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:00.325856 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:00.330837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 273/534] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:00.332410 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2d80e-127f-4c0a-87c8-5bdb3b3b45ab None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:00.366964 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:00.464662 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2d80e-127f-4c0a-87c8-5bdb3b3b45ab None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:00.501013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e05829-d5e9-4869-8ca8-fcec3d7f1673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:00.501013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e05829-d5e9-4869-8ca8-fcec3d7f1673 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:00.501013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e05829-d5e9-4869-8ca8-fcec3d7f1673 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:00.501013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e05829-d5e9-4869-8ca8-fcec3d7f1673 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:00.501381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e05829-d5e9-4869-8ca8-fcec3d7f1673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:00.501381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e05829-d5e9-4869-8ca8-fcec3d7f1673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:00.501605 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e05829-d5e9-4869-8ca8-fcec3d7f1673 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:00.522560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 274/535] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:00.530284 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e05829-d5e9-4869-8ca8-fcec3d7f1673 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:00.540697 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:00.549744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54307f08-2fc5-48d8-bae5-f81a33fa6512 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:00.585917 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446aa30-78ac-46cc-aa1e-1dfc92f7d452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:00.586846 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446aa30-78ac-46cc-aa1e-1dfc92f7d452 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:00.587328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446aa30-78ac-46cc-aa1e-1dfc92f7d452 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:00.587818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446aa30-78ac-46cc-aa1e-1dfc92f7d452 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:00.595116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446aa30-78ac-46cc-aa1e-1dfc92f7d452 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:00.596911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446aa30-78ac-46cc-aa1e-1dfc92f7d452 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:00.608849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-8446aa30-78ac-46cc-aa1e-1dfc92f7d452 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:00.608849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:00.608849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:00.608849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:00.608849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:00.608849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:00.608849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:00.608849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:00.608849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:00.608849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:00.608849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:00.608849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:00.608849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:00.608849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:00.608849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:00.609727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:00.609727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:00.609727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:00.609727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:00.609727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:00.609727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:00.609727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:00.609727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:00.609727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:00.609727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:00.609727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:00.609727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:00.609727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:00.609727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:00.609727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:00.609727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:00.609727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:00.610628 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:00.610628 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:00.610628 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:00.610628 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:00.610628 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:00.610628 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:00.610628 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:00.610628 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:00.613067 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 262/536] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:00.618735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446aa30-78ac-46cc-aa1e-1dfc92f7d452 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:00.684124 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:00.733346 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446aa30-78ac-46cc-aa1e-1dfc92f7d452 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:00.749628 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e05829-d5e9-4869-8ca8-fcec3d7f1673 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:00.770800 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653c64e-44f9-4265-ad6c-b9839f1eb67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:00.771872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653c64e-44f9-4265-ad6c-b9839f1eb67b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:00.772350 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653c64e-44f9-4265-ad6c-b9839f1eb67b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:00.772987 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653c64e-44f9-4265-ad6c-b9839f1eb67b None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:00.773931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653c64e-44f9-4265-ad6c-b9839f1eb67b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:00.774431 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653c64e-44f9-4265-ad6c-b9839f1eb67b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:00.776061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653c64e-44f9-4265-ad6c-b9839f1eb67b None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:00.789805 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 263/537] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:00.795003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653c64e-44f9-4265-ad6c-b9839f1eb67b None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:00.810964 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:00.827311 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d8b16-ab90-4c45-993e-db9bbb3d1535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:00.827962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d8b16-ab90-4c45-993e-db9bbb3d1535 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:00.828252 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d8b16-ab90-4c45-993e-db9bbb3d1535 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:00.828615 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d8b16-ab90-4c45-993e-db9bbb3d1535 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:00.844731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d8b16-ab90-4c45-993e-db9bbb3d1535 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:00.846401 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4d8b16-ab90-4c45-993e-db9bbb3d1535 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:00.862601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-4c4d8b16-ab90-4c45-993e-db9bbb3d1535 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:00.862601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:00.862601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:00.862601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:00.862601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:00.862601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:00.862601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:00.862601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:00.862601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:00.862601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:00.862601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:00.862601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:00.862601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:00.862601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:00.862601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:00.863544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:00.863544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:00.863544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:00.863544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:00.863544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:00.863544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:00.863544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:00.863544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:00.863544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:00.863544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:00.863544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:00.863544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:00.863544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:00.863544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:00.863544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:00.863544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:00.863544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:00.864392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:00.864392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:00.864392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:00.864392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:00.864392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:00.864392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:00.864392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:00.864392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:00.878547 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 275/538] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:00.883509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d8b16-ab90-4c45-993e-db9bbb3d1535 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:00.939172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653c64e-44f9-4265-ad6c-b9839f1eb67b None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:00.978593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e99fa-90ac-4f39-86c3-81b25c24e959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:00.979859 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e99fa-90ac-4f39-86c3-81b25c24e959 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:00.980778 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e99fa-90ac-4f39-86c3-81b25c24e959 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:00.981252 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e99fa-90ac-4f39-86c3-81b25c24e959 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:00.982235 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e99fa-90ac-4f39-86c3-81b25c24e959 None admin] RBAC: Adding query filter params (role.id=e30f587367384737a72bbcc2e35d62ad, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=8e4e240f7958425a99a2cc1110e40c13) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:00.982763 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e99fa-90ac-4f39-86c3-81b25c24e959 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:00.984380 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e99fa-90ac-4f39-86c3-81b25c24e959 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:00.992280 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 264/539] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:58:00 2022] GET /identity/v3/role_assignments?user.id=8e4e240f7958425a99a2cc1110e40c13&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=e30f587367384737a72bbcc2e35d62ad => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:01.052779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d8b16-ab90-4c45-993e-db9bbb3d1535 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:01.087615 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:01.100254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e6b23-1413-440c-8ec7-3ee1927e01dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:01.100927 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e6b23-1413-440c-8ec7-3ee1927e01dc None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:01.104988 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e6b23-1413-440c-8ec7-3ee1927e01dc None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:01.105283 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e6b23-1413-440c-8ec7-3ee1927e01dc None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:01.106103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e6b23-1413-440c-8ec7-3ee1927e01dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:01.106421 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e6b23-1413-440c-8ec7-3ee1927e01dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:01.107987 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e6b23-1413-440c-8ec7-3ee1927e01dc None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:01.128131 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 276/540] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:01.134262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e99fa-90ac-4f39-86c3-81b25c24e959 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:01.154612 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c1c32-e552-48a0-8a3f-35ee34bc7f31 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:01.154987 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c1c32-e552-48a0-8a3f-35ee34bc7f31 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:01.155413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c1c32-e552-48a0-8a3f-35ee34bc7f31 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:01.157453 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 277/541] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:01.163414 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0696b-fb94-4e0d-b171-f00e97ca9be8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:01.163702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0696b-fb94-4e0d-b171-f00e97ca9be8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:01.163986 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0696b-fb94-4e0d-b171-f00e97ca9be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:01.185490 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-02a0696b-fb94-4e0d-b171-f00e97ca9be8 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:01.186738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-02a0696b-fb94-4e0d-b171-f00e97ca9be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:01.267689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:01.279444 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 278/542] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:58:01.305162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e99fa-90ac-4f39-86c3-81b25c24e959 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:01.319898 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0696b-fb94-4e0d-b171-f00e97ca9be8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:01.366781 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da75cf4-0569-47bd-8d8a-176ba297a67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:01.367404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da75cf4-0569-47bd-8d8a-176ba297a67b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:01.367689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da75cf4-0569-47bd-8d8a-176ba297a67b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:01.367967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da75cf4-0569-47bd-8d8a-176ba297a67b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:01.368792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da75cf4-0569-47bd-8d8a-176ba297a67b None admin] RBAC: Adding query filter params (role.id=e30f587367384737a72bbcc2e35d62ad, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=828eb58cdce44ca8827f1ce2be7c19d7) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:01.369107 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da75cf4-0569-47bd-8d8a-176ba297a67b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:01.370553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da75cf4-0569-47bd-8d8a-176ba297a67b None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:01.388783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 265/543] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:58:01 2022] GET /identity/v3/role_assignments?user.id=828eb58cdce44ca8827f1ce2be7c19d7&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=e30f587367384737a72bbcc2e35d62ad => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:01.491650 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0696b-fb94-4e0d-b171-f00e97ca9be8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:01.519780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:01.542985 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754b4bd-3979-4937-97b4-bd1513fbc4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:01.543644 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754b4bd-3979-4937-97b4-bd1513fbc4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:01.543927 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754b4bd-3979-4937-97b4-bd1513fbc4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:01.544201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754b4bd-3979-4937-97b4-bd1513fbc4d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:01.563244 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754b4bd-3979-4937-97b4-bd1513fbc4d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:01.568597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-0754b4bd-3979-4937-97b4-bd1513fbc4d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:01.568597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:01.568597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:01.568597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:01.568597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:01.568597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:01.568597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:01.568597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:01.568597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:01.568597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:01.568597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:01.568597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:01.568597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:01.568597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:01.568597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:01.568597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:01.569479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:01.569479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:01.569479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:01.569479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:01.569479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:01.569479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:01.569479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:01.569479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:01.569479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:01.569479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:01.569479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:01.569479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:01.569479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:01.569479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:01.569479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:01.569479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:01.570269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:01.570269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:01.570269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:01.570269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:01.570269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:01.570269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:01.570269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:01.570269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:01.570269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:01.570269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:01.570269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:01.570269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:01.573147 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 279/544] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:58:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:01.579836 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da75cf4-0569-47bd-8d8a-176ba297a67b None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:01.710859 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da75cf4-0569-47bd-8d8a-176ba297a67b None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:01.747129 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919d713-9321-4265-942a-0a15d0e008c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:01.747747 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919d713-9321-4265-942a-0a15d0e008c7 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:01.748035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919d713-9321-4265-942a-0a15d0e008c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:01.748311 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919d713-9321-4265-942a-0a15d0e008c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:01.749062 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919d713-9321-4265-942a-0a15d0e008c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:01.749369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919d713-9321-4265-942a-0a15d0e008c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:01.751133 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919d713-9321-4265-942a-0a15d0e008c7 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:01.763987 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 266/545] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 09:58:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:01.769530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754b4bd-3979-4937-97b4-bd1513fbc4d7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:01.898740 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754b4bd-3979-4937-97b4-bd1513fbc4d7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:01.935386 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc551a18-301d-4dfb-bc78-f99bb2fce940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:01.936366 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc551a18-301d-4dfb-bc78-f99bb2fce940 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:01.936921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc551a18-301d-4dfb-bc78-f99bb2fce940 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:01.937414 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc551a18-301d-4dfb-bc78-f99bb2fce940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:01.948611 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc551a18-301d-4dfb-bc78-f99bb2fce940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:01.950327 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc551a18-301d-4dfb-bc78-f99bb2fce940 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:01.965512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-bc551a18-301d-4dfb-bc78-f99bb2fce940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:01.965512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:01.965512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:01.965512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:01.965512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:01.965512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:01.965512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:01.965512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:01.965512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:01.965512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:01.965512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:01.965512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:01.965512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:01.965512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:01.965512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:01.966358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:01.966358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:01.966358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:01.966358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:01.966358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:01.966358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:01.966358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:01.966358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:01.966358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:01.966358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:01.966358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:01.966358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:01.966358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:01.966358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:01.966358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:01.966358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:01.966358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:01.967201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:01.967201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:01.967201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:01.967201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:01.969869 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 280/546] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:01.977539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919d713-9321-4265-942a-0a15d0e008c7 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:01.983231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:02.141182 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919d713-9321-4265-942a-0a15d0e008c7 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:02.183924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeca5fe-4023-4c25-b693-5a7579dbf831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:02.184579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeca5fe-4023-4c25-b693-5a7579dbf831 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:02.184868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeca5fe-4023-4c25-b693-5a7579dbf831 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:02.185146 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeca5fe-4023-4c25-b693-5a7579dbf831 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:02.185857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeca5fe-4023-4c25-b693-5a7579dbf831 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:02.186165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeca5fe-4023-4c25-b693-5a7579dbf831 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:02.187539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeca5fe-4023-4c25-b693-5a7579dbf831 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:02.205729 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 267/547] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:02.211225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc551a18-301d-4dfb-bc78-f99bb2fce940 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:02.268292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:02.378631 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc551a18-301d-4dfb-bc78-f99bb2fce940 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:02.431506 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e816e-dc6c-4c34-8c64-ab43e5e75c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:02.432156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e816e-dc6c-4c34-8c64-ab43e5e75c88 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:02.432439 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e816e-dc6c-4c34-8c64-ab43e5e75c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:02.432737 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e816e-dc6c-4c34-8c64-ab43e5e75c88 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:02.442478 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e816e-dc6c-4c34-8c64-ab43e5e75c88 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:02.443946 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e816e-dc6c-4c34-8c64-ab43e5e75c88 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:02.460866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-977e816e-dc6c-4c34-8c64-ab43e5e75c88 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:58:02.460866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:02.460866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:02.460866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:02.460866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:02.460866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:02.460866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:02.460866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:02.460866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:02.460866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:02.460866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:02.460866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:02.460866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:02.460866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:02.460866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:02.460866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:02.461879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:02.461879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:02.461879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:02.461879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:02.461879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:02.461879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:02.461879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:02.461879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:02.461879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:02.461879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:02.461879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:02.461879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:02.461879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:02.461879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:02.461879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:02.461879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:02.461879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:02.461879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:02.463724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:02.463724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:02.463724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:02.463724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:02.463724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:02.463724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:02.463724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:02.463724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:02.463724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:58:02.463724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:02.463724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 281/548] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:58:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:02.467588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeca5fe-4023-4c25-b693-5a7579dbf831 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:02.533654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:02.576314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeca5fe-4023-4c25-b693-5a7579dbf831 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:02.618212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf95f2-63cc-4360-aa81-8a645fb8a439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:02.618842 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf95f2-63cc-4360-aa81-8a645fb8a439 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:02.619126 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf95f2-63cc-4360-aa81-8a645fb8a439 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:02.619403 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf95f2-63cc-4360-aa81-8a645fb8a439 None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:02.620213 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf95f2-63cc-4360-aa81-8a645fb8a439 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:02.620549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf95f2-63cc-4360-aa81-8a645fb8a439 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:02.621989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf95f2-63cc-4360-aa81-8a645fb8a439 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:02.671027 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 268/549] 10.222.0.85 () {56 vars in 1135 bytes} [Tue Aug 2 09:58:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:02.676712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e816e-dc6c-4c34-8c64-ab43e5e75c88 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:02.752544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bcf0d-a762-4b66-b01f-028df8506387 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:02.752886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bcf0d-a762-4b66-b01f-028df8506387 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:02.753114 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bcf0d-a762-4b66-b01f-028df8506387 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:02.754638 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 269/550] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:58:02.760295 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c598b-602c-4299-b27d-f6ac48d2c2f9 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:02.760860 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c598b-602c-4299-b27d-f6ac48d2c2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:02.761139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c598b-602c-4299-b27d-f6ac48d2c2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:02.784418 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-839c598b-602c-4299-b27d-f6ac48d2c2f9 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:02.785579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-839c598b-602c-4299-b27d-f6ac48d2c2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:02.818780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:02.832620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e816e-dc6c-4c34-8c64-ab43e5e75c88 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:02.861330 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 270/551] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:58:02.868994 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293ecba-3643-40b4-a153-f551831664c6 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:02.869301 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293ecba-3643-40b4-a153-f551831664c6 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:02.869583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e293ecba-3643-40b4-a153-f551831664c6 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:02.870898 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51674729-2dd1-461d-a712-7570bbb475c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:02.871027 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 271/552] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:02.872714 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51674729-2dd1-461d-a712-7570bbb475c5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:02.872714 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51674729-2dd1-461d-a712-7570bbb475c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:02.872714 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51674729-2dd1-461d-a712-7570bbb475c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:02.878116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14f513-a986-4ee2-a859-40ed27d6ad10 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:02.878520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14f513-a986-4ee2-a859-40ed27d6ad10 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:02.881388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14f513-a986-4ee2-a859-40ed27d6ad10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:02.909630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-6c14f513-a986-4ee2-a859-40ed27d6ad10 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:02.911125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-6c14f513-a986-4ee2-a859-40ed27d6ad10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:02.945329 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51674729-2dd1-461d-a712-7570bbb475c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:02.946920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51674729-2dd1-461d-a712-7570bbb475c5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:02.959015 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:02.982655 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 272/553] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:58:02.983503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14f513-a986-4ee2-a859-40ed27d6ad10 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:03.059838 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:03.077116 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 282/554] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:58:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:58:03.078538 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51674729-2dd1-461d-a712-7570bbb475c5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:03.130371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14f513-a986-4ee2-a859-40ed27d6ad10 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:03.166878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad2c82-78fa-40dd-9ad0-47059b523a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:03.167525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad2c82-78fa-40dd-9ad0-47059b523a85 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:03.167809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad2c82-78fa-40dd-9ad0-47059b523a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:03.168086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad2c82-78fa-40dd-9ad0-47059b523a85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:03.180080 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad2c82-78fa-40dd-9ad0-47059b523a85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:03.185121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-d8ad2c82-78fa-40dd-9ad0-47059b523a85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:03.185121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:03.185121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:03.185121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:03.185121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:03.185121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:03.185121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:03.185121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:03.185121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:03.185121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:03.185121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:03.185121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:03.185121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:03.185121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:03.185121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:03.185121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:03.186162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:03.186162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:03.186162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:03.186162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:03.186162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:03.186162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:03.186162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:03.186162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:03.186162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:03.186162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:03.186162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:03.186162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:03.186162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:03.186162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:03.186162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:03.186162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:03.187688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:03.187688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:03.187688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:03.187688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:03.187688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:03.187688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:03.187688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:03.187688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:03.187688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:03.187688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:03.187688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:03.187688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:03.187688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 273/555] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:58:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:03.187688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad2c82-78fa-40dd-9ad0-47059b523a85 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:03.216691 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51674729-2dd1-461d-a712-7570bbb475c5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:03.244182 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:03.255670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777aa73-b6eb-49df-b01b-026cc19d4d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:03.256327 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777aa73-b6eb-49df-b01b-026cc19d4d1a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:03.256652 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777aa73-b6eb-49df-b01b-026cc19d4d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:03.256930 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777aa73-b6eb-49df-b01b-026cc19d4d1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:03.268405 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777aa73-b6eb-49df-b01b-026cc19d4d1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:03.273574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a777aa73-b6eb-49df-b01b-026cc19d4d1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:03.273574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:03.273574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:03.273574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:03.273574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:03.273574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:03.273574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:03.273574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:03.273574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:03.273574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:03.273574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:03.273574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:03.273574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:03.273574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:03.273574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:03.273574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:03.276192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:03.276192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:03.276192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:03.276192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:03.276192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:03.276192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:03.276192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:03.276192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:03.276192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:03.276192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:03.276192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:03.276192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:03.276192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:03.276192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:03.276192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:03.276192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:03.278175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:03.278175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:03.278175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:03.278175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:03.278175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:03.278175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:03.278175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:03.278175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:03.278175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:03.278175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:03.278175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:03.278175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:03.278175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 283/556] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:58:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:03.278175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777aa73-b6eb-49df-b01b-026cc19d4d1a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:03.321131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad2c82-78fa-40dd-9ad0-47059b523a85 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:03.353725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:03.388805 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019de37-4b09-4453-b50a-bae78ed559a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:03.389743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019de37-4b09-4453-b50a-bae78ed559a7 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:03.390174 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019de37-4b09-4453-b50a-bae78ed559a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:03.391222 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8019de37-4b09-4453-b50a-bae78ed559a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:03.407790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019de37-4b09-4453-b50a-bae78ed559a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:03.410482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8019de37-4b09-4453-b50a-bae78ed559a7 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:03.420109 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777aa73-b6eb-49df-b01b-026cc19d4d1a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:03.433556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-8019de37-4b09-4453-b50a-bae78ed559a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:03.433556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:03.433556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:03.433556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:03.433556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:03.433556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:03.433556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:03.433556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:03.433556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:03.433556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:03.433556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:03.433556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:03.433556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:03.433556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:03.433556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:03.435158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:03.435158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:03.435158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:03.435158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:03.435158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:03.435158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:03.435158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:03.435158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:03.435158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:03.435158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:03.435158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:03.435158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:03.435158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:03.435158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:03.435158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:03.435158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:03.435158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:03.436259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:03.436259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:03.436259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:03.436259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:03.439094 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 274/557] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:03.440131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019de37-4b09-4453-b50a-bae78ed559a7 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:03.477082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c845d65-17dc-47ff-8480-efdc4d4c85d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:03.478417 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c845d65-17dc-47ff-8480-efdc4d4c85d8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:03.479171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c845d65-17dc-47ff-8480-efdc4d4c85d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:03.479664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c845d65-17dc-47ff-8480-efdc4d4c85d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:03.480642 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c845d65-17dc-47ff-8480-efdc4d4c85d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:03.481415 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c845d65-17dc-47ff-8480-efdc4d4c85d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:03.483987 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c845d65-17dc-47ff-8480-efdc4d4c85d8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:03.500704 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 284/558] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 09:58:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:03.501649 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c845d65-17dc-47ff-8480-efdc4d4c85d8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:03.547702 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:03.558378 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8019de37-4b09-4453-b50a-bae78ed559a7 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:03.601233 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55180254-c860-48a6-aa7c-b34e68582514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:03.602201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55180254-c860-48a6-aa7c-b34e68582514 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:03.602690 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55180254-c860-48a6-aa7c-b34e68582514 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:03.603185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55180254-c860-48a6-aa7c-b34e68582514 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:03.604112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55180254-c860-48a6-aa7c-b34e68582514 None admin] RBAC: Adding query filter params (name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:03.605043 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55180254-c860-48a6-aa7c-b34e68582514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:03.607020 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55180254-c860-48a6-aa7c-b34e68582514 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:03.618938 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 275/559] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 09:58:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:03.620564 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55180254-c860-48a6-aa7c-b34e68582514 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:03.631574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c845d65-17dc-47ff-8480-efdc4d4c85d8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:03.645994 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:03.670011 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436a2e1-5d5d-4cc8-9d67-999e30535ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:03.670690 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436a2e1-5d5d-4cc8-9d67-999e30535ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:03.670969 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436a2e1-5d5d-4cc8-9d67-999e30535ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:03.671245 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436a2e1-5d5d-4cc8-9d67-999e30535ac7 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:03.672649 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436a2e1-5d5d-4cc8-9d67-999e30535ac7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:03.672991 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436a2e1-5d5d-4cc8-9d67-999e30535ac7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:03.674452 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436a2e1-5d5d-4cc8-9d67-999e30535ac7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:03.692792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 285/560] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:03.694397 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436a2e1-5d5d-4cc8-9d67-999e30535ac7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:03.742813 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55180254-c860-48a6-aa7c-b34e68582514 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:03.777246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae7974-14ae-4ce8-9dc7-f4b7233db2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:03.777882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae7974-14ae-4ce8-9dc7-f4b7233db2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:03.778167 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae7974-14ae-4ce8-9dc7-f4b7233db2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:03.778445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae7974-14ae-4ce8-9dc7-f4b7233db2e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:03.789850 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae7974-14ae-4ce8-9dc7-f4b7233db2e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:03.791296 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae7974-14ae-4ce8-9dc7-f4b7233db2e0 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:03.794623 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436a2e1-5d5d-4cc8-9d67-999e30535ac7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:03.805832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-1dae7974-14ae-4ce8-9dc7-f4b7233db2e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:03.805832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:03.805832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:03.805832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:03.805832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:03.805832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:03.805832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:03.805832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:03.805832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:03.805832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:03.805832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:03.805832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:03.805832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:03.805832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:03.805832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:03.806712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:03.806712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:03.806712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:03.806712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:03.806712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:03.806712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:03.806712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:03.806712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:03.806712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:03.806712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:03.806712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:03.806712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:03.806712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:03.806712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:03.806712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:03.806712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:03.806712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:03.807591 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:03.807591 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:03.807591 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:03.807591 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:03.807591 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 276/561] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:03.808118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff8466-238e-43c1-b5d3-eef16711fd57 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:03.808387 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff8466-238e-43c1-b5d3-eef16711fd57 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:03.808693 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff8466-238e-43c1-b5d3-eef16711fd57 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:03.809925 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 277/562] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:03.810612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff8466-238e-43c1-b5d3-eef16711fd57 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:03.819853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:03.834057 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f60195-b3c8-48db-81c7-d4bad88f0855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:03.834696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60195-b3c8-48db-81c7-d4bad88f0855 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:03.834987 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60195-b3c8-48db-81c7-d4bad88f0855 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:03.835261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f60195-b3c8-48db-81c7-d4bad88f0855 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:03.845851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f60195-b3c8-48db-81c7-d4bad88f0855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:03.847293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f60195-b3c8-48db-81c7-d4bad88f0855 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:03.861821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-13f60195-b3c8-48db-81c7-d4bad88f0855 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:03.861821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:03.861821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:03.861821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:03.861821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:03.861821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:03.861821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:03.861821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:03.861821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:03.861821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:03.861821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:03.861821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:03.861821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:03.861821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:03.861821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:03.862667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:03.862667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:03.862667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:03.862667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:03.862667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:03.862667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:03.862667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:03.862667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:03.862667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:03.862667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:03.862667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:03.862667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:03.862667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:03.862667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:03.862667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:03.862667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:03.862667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:03.863554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:03.863554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:03.863554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:03.863554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:03.863554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 286/563] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:03.864072 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433844bc-14fe-473b-9438-f06f807f858e None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:03.864309 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433844bc-14fe-473b-9438-f06f807f858e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:03.864626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433844bc-14fe-473b-9438-f06f807f858e None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:03.868522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 287/564] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:03.868522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433844bc-14fe-473b-9438-f06f807f858e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:03.898143 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:03.919138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feff8466-238e-43c1-b5d3-eef16711fd57 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:03.952325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c02dd-1fe8-40bc-93d8-9143afca420e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:03.953963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c02dd-1fe8-40bc-93d8-9143afca420e None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:03.954257 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c02dd-1fe8-40bc-93d8-9143afca420e None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:03.954532 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c02dd-1fe8-40bc-93d8-9143afca420e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:03.961090 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c02dd-1fe8-40bc-93d8-9143afca420e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:03.962528 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c02dd-1fe8-40bc-93d8-9143afca420e None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:03.974298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-4e9c02dd-1fe8-40bc-93d8-9143afca420e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:03.974298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:03.974298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:03.974298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:03.974298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:03.974298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:03.974298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:03.974298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:03.974298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:03.974298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:03.974298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:03.974298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:03.974298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:03.974298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:03.974298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:03.975356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:03.975356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:03.975356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:03.975356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:03.975356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:03.975356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:03.975356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:03.975356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:03.975356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:03.975356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:03.975356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:03.975356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:03.975356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:03.975356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:03.975356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:03.975356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:03.975356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:03.976477 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:03.976477 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:03.976477 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:03.976477 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:03.976477 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:03.976477 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:03.976477 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:03.976477 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:03.976477 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 278/565] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:03.977088 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59428453-3b06-4b5d-aee8-2efbe5545731 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:03.977264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59428453-3b06-4b5d-aee8-2efbe5545731 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:03.977532 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59428453-3b06-4b5d-aee8-2efbe5545731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:03.978439 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433844bc-14fe-473b-9438-f06f807f858e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:03.995233 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-59428453-3b06-4b5d-aee8-2efbe5545731 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:03.996408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-59428453-3b06-4b5d-aee8-2efbe5545731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:04.013758 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9cd55-2759-4c51-b880-01928a474f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:04.014394 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9cd55-2759-4c51-b880-01928a474f91 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:04.014674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9cd55-2759-4c51-b880-01928a474f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:04.014950 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9cd55-2759-4c51-b880-01928a474f91 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:04.016015 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9cd55-2759-4c51-b880-01928a474f91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:04.016134 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9cd55-2759-4c51-b880-01928a474f91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:04.017426 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9cd55-2759-4c51-b880-01928a474f91 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:04.028543 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 288/566] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:04.029469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9cd55-2759-4c51-b880-01928a474f91 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:04.057571 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:04.066404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 279/567] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:58:04.067224 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d508b-c97f-4af9-a178-99ac6c5be76d None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:04.067509 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d508b-c97f-4af9-a178-99ac6c5be76d None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:04.067783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d508b-c97f-4af9-a178-99ac6c5be76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:04.085270 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-ed9d508b-c97f-4af9-a178-99ac6c5be76d None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:04.086465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ed9d508b-c97f-4af9-a178-99ac6c5be76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:04.118147 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:04.136160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9cd55-2759-4c51-b880-01928a474f91 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:04.155025 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 280/568] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:58:04.155861 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d508b-c97f-4af9-a178-99ac6c5be76d None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:04.180861 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a81d26-507c-4f80-b312-b086979d43da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:04.181481 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a81d26-507c-4f80-b312-b086979d43da None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:04.181762 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a81d26-507c-4f80-b312-b086979d43da None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:04.182035 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a81d26-507c-4f80-b312-b086979d43da None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:04.182733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a81d26-507c-4f80-b312-b086979d43da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:04.183041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a81d26-507c-4f80-b312-b086979d43da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:04.184429 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a81d26-507c-4f80-b312-b086979d43da None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:04.197490 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 289/569] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:04.198171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a81d26-507c-4f80-b312-b086979d43da None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:04.267431 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d508b-c97f-4af9-a178-99ac6c5be76d None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:04.296855 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:04.303300 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a81d26-507c-4f80-b312-b086979d43da None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:04.307368 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b23a6e-39c8-4dbb-946c-f8b0d2f80b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:04.307993 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b23a6e-39c8-4dbb-946c-f8b0d2f80b4f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:04.308280 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b23a6e-39c8-4dbb-946c-f8b0d2f80b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:04.308595 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b23a6e-39c8-4dbb-946c-f8b0d2f80b4f None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:04.309356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b23a6e-39c8-4dbb-946c-f8b0d2f80b4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:04.309667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b23a6e-39c8-4dbb-946c-f8b0d2f80b4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:04.311103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b23a6e-39c8-4dbb-946c-f8b0d2f80b4f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:04.323321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 281/570] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:04.324109 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b23a6e-39c8-4dbb-946c-f8b0d2f80b4f None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:04.339126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0225190-88f0-4df9-a1a0-32d5526fdea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:04.339761 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0225190-88f0-4df9-a1a0-32d5526fdea9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:04.340041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0225190-88f0-4df9-a1a0-32d5526fdea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:04.340313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0225190-88f0-4df9-a1a0-32d5526fdea9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:04.348422 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0225190-88f0-4df9-a1a0-32d5526fdea9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:04.349898 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0225190-88f0-4df9-a1a0-32d5526fdea9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:04.362582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a0225190-88f0-4df9-a1a0-32d5526fdea9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 09:58:04.362582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:04.362582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:04.362582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:04.362582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:04.362582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:04.362582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:04.362582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:04.362582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:04.362582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:04.362582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:04.362582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:04.362582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:04.362582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:04.362582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:04.362582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:04.363528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:04.363528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:04.363528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:04.363528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:04.363528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:04.363528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:04.363528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:04.363528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:04.363528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:04.363528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:04.363528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:04.363528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:04.363528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:04.363528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:04.363528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:04.363528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:04.363528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:04.363528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:04.364492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:04.364492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:04.364492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:04.364492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:04.364492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:04.364492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:04.364492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:04.364492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:04.364492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 09:58:04.364492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:04.364492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 290/571] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:58:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:04.364492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0225190-88f0-4df9-a1a0-32d5526fdea9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:04.372849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:04.428831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b23a6e-39c8-4dbb-946c-f8b0d2f80b4f None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:04.462774 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb3739-ce77-4097-93b4-e2d0bb5d46eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:04.463410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb3739-ce77-4097-93b4-e2d0bb5d46eb None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:04.463694 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb3739-ce77-4097-93b4-e2d0bb5d46eb None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:04.463975 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb3739-ce77-4097-93b4-e2d0bb5d46eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:04.470050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0225190-88f0-4df9-a1a0-32d5526fdea9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:04.474805 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb3739-ce77-4097-93b4-e2d0bb5d46eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:04.480325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-b4fb3739-ce77-4097-93b4-e2d0bb5d46eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:04.480325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:04.480325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:04.480325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:04.480325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:04.480325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:04.480325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:04.480325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:04.480325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:04.480325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:04.480325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:04.480325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:04.480325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:04.480325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:04.480325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:04.480325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:04.481337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:04.481337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:04.481337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:04.481337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:04.481337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:04.481337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:04.481337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:04.481337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:04.481337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:04.481337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:04.481337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:04.481337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:04.481337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:04.481337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:04.481337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:04.481337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:04.482147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:04.482147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:04.482147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:04.482147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:04.482147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:04.482147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:04.482147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:04.482147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:04.482147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:04.482147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:04.482147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:04.482147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:04.482147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 282/572] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:58:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:04.482908 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb3739-ce77-4097-93b4-e2d0bb5d46eb None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:04.507723 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637af35-6030-4125-bd77-ac91d9f02e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:04.508432 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637af35-6030-4125-bd77-ac91d9f02e01 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:04.508741 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637af35-6030-4125-bd77-ac91d9f02e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:04.509013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637af35-6030-4125-bd77-ac91d9f02e01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:04.520032 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637af35-6030-4125-bd77-ac91d9f02e01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:04.525314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-0637af35-6030-4125-bd77-ac91d9f02e01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:04.525314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:04.525314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:04.525314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:04.525314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:04.525314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:04.525314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:04.525314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:04.525314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:04.525314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:04.525314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:04.525314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:04.525314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:04.525314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:04.525314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:04.525314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:04.526289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:04.526289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:04.526289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:04.526289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:04.526289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:04.526289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:04.526289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:04.526289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:04.526289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:04.526289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:04.526289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:04.526289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:04.526289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:04.526289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:04.526289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:04.526289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:04.527122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:04.527122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:04.527122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:04.527122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:04.527122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:04.527122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:04.527122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:04.527122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:04.527122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:04.527122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:04.527122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:04.527122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:04.527122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 291/573] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:58:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:04.527806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637af35-6030-4125-bd77-ac91d9f02e01 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:04.533338 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:04.589016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb3739-ce77-4097-93b4-e2d0bb5d46eb None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:04.592555 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:04.623103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3252ab-6dc6-4209-ab9b-687b14f46dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:04.623661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3252ab-6dc6-4209-ab9b-687b14f46dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:04.623947 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3252ab-6dc6-4209-ab9b-687b14f46dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:04.624221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3252ab-6dc6-4209-ab9b-687b14f46dd9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:04.631470 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637af35-6030-4125-bd77-ac91d9f02e01 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:04.632952 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3252ab-6dc6-4209-ab9b-687b14f46dd9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:04.634402 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3252ab-6dc6-4209-ab9b-687b14f46dd9 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:04.646549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-da3252ab-6dc6-4209-ab9b-687b14f46dd9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:58:04.646549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:04.646549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:04.646549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:04.646549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:04.646549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:04.646549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:04.646549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:04.646549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:04.646549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:04.646549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:04.646549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:04.646549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:04.646549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:04.646549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:04.646549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:04.647527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:04.647527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:04.647527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:04.647527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:04.647527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:04.647527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:04.647527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:04.647527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:04.647527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:04.647527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:04.647527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:04.647527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:04.647527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:04.647527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:04.647527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:04.647527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:04.647527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:04.647527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:04.648476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:04.648476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:04.648476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:04.648476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:04.648476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:04.648476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:04.648476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:04.648476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:04.648476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:58:04.648476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:04.648476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 283/574] 10.222.0.85 () {56 vars in 1093 bytes} [Tue Aug 2 09:58:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:04.648476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3252ab-6dc6-4209-ab9b-687b14f46dd9 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:04.670817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47de74-a2fe-4c2f-987a-b1dec1c366c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:04.671456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47de74-a2fe-4c2f-987a-b1dec1c366c1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:04.671745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47de74-a2fe-4c2f-987a-b1dec1c366c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:04.672193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47de74-a2fe-4c2f-987a-b1dec1c366c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:04.673055 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47de74-a2fe-4c2f-987a-b1dec1c366c1 None admin] RBAC: Adding query filter params (role.id=e30f587367384737a72bbcc2e35d62ad, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=e9cfed2469a7419f8fcbe09d25cb896e) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:04.673368 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47de74-a2fe-4c2f-987a-b1dec1c366c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:04.674794 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47de74-a2fe-4c2f-987a-b1dec1c366c1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:04.680450 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 292/575] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:58:04 2022] GET /identity/v3/role_assignments?user.id=e9cfed2469a7419f8fcbe09d25cb896e&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=e30f587367384737a72bbcc2e35d62ad => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:04.681239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47de74-a2fe-4c2f-987a-b1dec1c366c1 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:04.762016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3252ab-6dc6-4209-ab9b-687b14f46dd9 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:04.770665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:04.797035 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47de74-a2fe-4c2f-987a-b1dec1c366c1 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:04.802892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624c3c3-974d-4238-b842-0bab296d139a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:04.803860 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624c3c3-974d-4238-b842-0bab296d139a None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:04.804336 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624c3c3-974d-4238-b842-0bab296d139a None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:04.804942 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624c3c3-974d-4238-b842-0bab296d139a None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:04.805759 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624c3c3-974d-4238-b842-0bab296d139a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:04.806066 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624c3c3-974d-4238-b842-0bab296d139a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:04.807923 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624c3c3-974d-4238-b842-0bab296d139a None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:04.826372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:04.831492 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 284/576] 10.222.0.85 () {56 vars in 1137 bytes} [Tue Aug 2 09:58:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:04.831492 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624c3c3-974d-4238-b842-0bab296d139a None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:04.840707 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064aa6d-1d81-4fb0-9421-96764118bed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:04.841159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064aa6d-1d81-4fb0-9421-96764118bed6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:04.841237 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064aa6d-1d81-4fb0-9421-96764118bed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:04.842028 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064aa6d-1d81-4fb0-9421-96764118bed6 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:04.842324 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064aa6d-1d81-4fb0-9421-96764118bed6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:04.843044 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064aa6d-1d81-4fb0-9421-96764118bed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:04.844498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064aa6d-1d81-4fb0-9421-96764118bed6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:04.853558 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 293/577] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 09:58:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:04.854271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064aa6d-1d81-4fb0-9421-96764118bed6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:04.952817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624c3c3-974d-4238-b842-0bab296d139a None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:04.958626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064aa6d-1d81-4fb0-9421-96764118bed6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:04.991733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569b5ac-f95a-43aa-9ec8-5085130c0d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:04.992352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569b5ac-f95a-43aa-9ec8-5085130c0d47 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:04.992670 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569b5ac-f95a-43aa-9ec8-5085130c0d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:04.992950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569b5ac-f95a-43aa-9ec8-5085130c0d47 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:04.993666 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569b5ac-f95a-43aa-9ec8-5085130c0d47 None admin] RBAC: Adding query filter params (name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:04.993827 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f2f6d-8c53-4beb-b6b5-f7b3101b4bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:04.994003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569b5ac-f95a-43aa-9ec8-5085130c0d47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:04.994410 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f2f6d-8c53-4beb-b6b5-f7b3101b4bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:04.994690 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f2f6d-8c53-4beb-b6b5-f7b3101b4bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:04.994963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f2f6d-8c53-4beb-b6b5-f7b3101b4bf7 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:04.995343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569b5ac-f95a-43aa-9ec8-5085130c0d47 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:04.995775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f2f6d-8c53-4beb-b6b5-f7b3101b4bf7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:04.996047 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f2f6d-8c53-4beb-b6b5-f7b3101b4bf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:04.997491 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f2f6d-8c53-4beb-b6b5-f7b3101b4bf7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:05.004821 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 285/578] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 09:58:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:05.005640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569b5ac-f95a-43aa-9ec8-5085130c0d47 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:05.022263 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 294/579] 10.222.0.85 () {56 vars in 1133 bytes} [Tue Aug 2 09:58:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:05.023443 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f2f6d-8c53-4beb-b6b5-f7b3101b4bf7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:05.043241 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:05.075494 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:05.123446 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569b5ac-f95a-43aa-9ec8-5085130c0d47 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:05.131401 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f2f6d-8c53-4beb-b6b5-f7b3101b4bf7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:05.163602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b1c6f-a8e8-49e9-bef6-9428b8877f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:05.164239 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b1c6f-a8e8-49e9-bef6-9428b8877f3f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:05.164557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b1c6f-a8e8-49e9-bef6-9428b8877f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:05.164894 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b1c6f-a8e8-49e9-bef6-9428b8877f3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:05.167797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47152e5-f20d-4e88-8cbf-da8be09205de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:05.168432 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47152e5-f20d-4e88-8cbf-da8be09205de None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:05.168741 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47152e5-f20d-4e88-8cbf-da8be09205de None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:05.169018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47152e5-f20d-4e88-8cbf-da8be09205de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:05.176667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b1c6f-a8e8-49e9-bef6-9428b8877f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:05.178356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b1c6f-a8e8-49e9-bef6-9428b8877f3f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:05.179803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47152e5-f20d-4e88-8cbf-da8be09205de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:05.181262 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47152e5-f20d-4e88-8cbf-da8be09205de None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:05.194205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-fc8b1c6f-a8e8-49e9-bef6-9428b8877f3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:05.194205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:05.194205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:05.194205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:05.194205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:05.194205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:05.194205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:05.194205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:05.194205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:05.194205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:05.194205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:05.194205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:05.194205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:05.194205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:05.194205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:05.195123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:05.195123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:05.195123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:05.195123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:05.195123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:05.195123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:05.195123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:05.195123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:05.195123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:05.195123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:05.195123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:05.195123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:05.195123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:05.195123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:05.195123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:05.195123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:05.195123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:05.201121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:05.201121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:05.201121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:05.201121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:05.201121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 286/580] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:05.201400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e47152e5-f20d-4e88-8cbf-da8be09205de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:05.201400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:05.201400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:05.201400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:05.201400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:05.201400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:05.201400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:05.201400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:05.201400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:05.201400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:05.201400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:05.201400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:05.201400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:05.201400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:05.201400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:05.202253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:05.202253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:05.202253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:05.202253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:05.202253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:05.202253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:05.202253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:05.202253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:05.202253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:05.202253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:05.202253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:05.202253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:05.202253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:05.202253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:05.202253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:05.202253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:05.202253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:05.203213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:05.203213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:05.203213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:05.203213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:05.203542 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b1c6f-a8e8-49e9-bef6-9428b8877f3f None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:05.203628 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 295/581] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:05.203628 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47152e5-f20d-4e88-8cbf-da8be09205de None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:05.286721 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:05.314521 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:05.317871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47152e5-f20d-4e88-8cbf-da8be09205de None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:05.321324 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b1c6f-a8e8-49e9-bef6-9428b8877f3f None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:05.355189 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da20233-8ef5-4875-8b15-23d4be206630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:05.355826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da20233-8ef5-4875-8b15-23d4be206630 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:05.356110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da20233-8ef5-4875-8b15-23d4be206630 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:05.356373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da20233-8ef5-4875-8b15-23d4be206630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:05.357769 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28306be9-0ecd-4aee-af79-e0afca6c0933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:05.358404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28306be9-0ecd-4aee-af79-e0afca6c0933 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:05.358682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28306be9-0ecd-4aee-af79-e0afca6c0933 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:05.359499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28306be9-0ecd-4aee-af79-e0afca6c0933 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:05.368442 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da20233-8ef5-4875-8b15-23d4be206630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:05.369906 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da20233-8ef5-4875-8b15-23d4be206630 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:05.370515 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28306be9-0ecd-4aee-af79-e0afca6c0933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:05.371931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28306be9-0ecd-4aee-af79-e0afca6c0933 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:05.385618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5da20233-8ef5-4875-8b15-23d4be206630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:05.385618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:05.385618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:05.385618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:05.385618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:05.385618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:05.385618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:05.385618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:05.385618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:05.385618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:05.385618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:05.385618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:05.385618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:05.385618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:05.385618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:05.386511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:05.386511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:05.386511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:05.386511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:05.386511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:05.386511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:05.386511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:05.386511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:05.386511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:05.386511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:05.386511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:05.386511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:05.386511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:05.386511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:05.386511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:05.386511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:05.386511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:05.387410 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:05.387410 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:05.387410 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:05.387410 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:05.387410 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 296/582] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:05.388104 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da20233-8ef5-4875-8b15-23d4be206630 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:05.388956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-28306be9-0ecd-4aee-af79-e0afca6c0933 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:05.388956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:05.388956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:05.388956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:05.388956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:05.388956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:05.388956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:05.388956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:05.388956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:05.388956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:05.388956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:05.388956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:05.388956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:05.388956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:05.388956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:05.389806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:05.389806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:05.389806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:05.389806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:05.389806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:05.389806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:05.389806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:05.389806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:05.389806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:05.389806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:05.389806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:05.389806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:05.389806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:05.389806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:05.389806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:05.389806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:05.389806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:05.391250 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:05.391250 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:05.391250 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:05.391250 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:05.393959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 287/583] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:05.394932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28306be9-0ecd-4aee-af79-e0afca6c0933 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:05.498407 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da20233-8ef5-4875-8b15-23d4be206630 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:05.509374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28306be9-0ecd-4aee-af79-e0afca6c0933 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:05.540743 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca0668-aa12-44d6-8301-c2f1a39ed19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:05.541368 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca0668-aa12-44d6-8301-c2f1a39ed19f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:05.541649 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca0668-aa12-44d6-8301-c2f1a39ed19f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:05.541928 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ca0668-aa12-44d6-8301-c2f1a39ed19f None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:05.542623 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca0668-aa12-44d6-8301-c2f1a39ed19f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:05.542960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca0668-aa12-44d6-8301-c2f1a39ed19f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:05.544332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ca0668-aa12-44d6-8301-c2f1a39ed19f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:05.554774 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:05.558922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 297/584] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:05.559749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca0668-aa12-44d6-8301-c2f1a39ed19f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:05.565802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f0cc9-f004-4c0f-89bf-076706757c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:05.566641 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f0cc9-f004-4c0f-89bf-076706757c97 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:05.566926 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f0cc9-f004-4c0f-89bf-076706757c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:05.567201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2f0cc9-f004-4c0f-89bf-076706757c97 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:05.567891 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f0cc9-f004-4c0f-89bf-076706757c97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:05.568195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f0cc9-f004-4c0f-89bf-076706757c97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:05.569591 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2f0cc9-f004-4c0f-89bf-076706757c97 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:05.578497 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:05.587972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 288/585] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:05.588683 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f0cc9-f004-4c0f-89bf-076706757c97 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:05.669323 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ca0668-aa12-44d6-8301-c2f1a39ed19f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:05.704208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da888e-4860-4ad2-8d0c-cba1628a6e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:05.704861 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da888e-4860-4ad2-8d0c-cba1628a6e03 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:05.705144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da888e-4860-4ad2-8d0c-cba1628a6e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:05.705419 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da888e-4860-4ad2-8d0c-cba1628a6e03 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:05.705633 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2f0cc9-f004-4c0f-89bf-076706757c97 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:05.706113 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da888e-4860-4ad2-8d0c-cba1628a6e03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:05.706418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da888e-4860-4ad2-8d0c-cba1628a6e03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:05.707789 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da888e-4860-4ad2-8d0c-cba1628a6e03 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:05.719654 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 298/586] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:05.720484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da888e-4860-4ad2-8d0c-cba1628a6e03 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:05.744052 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f2d15-c4fe-49d9-acce-74581cfce275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:05.744701 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f2d15-c4fe-49d9-acce-74581cfce275 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:05.745038 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f2d15-c4fe-49d9-acce-74581cfce275 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:05.745317 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f2d15-c4fe-49d9-acce-74581cfce275 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:05.746008 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f2d15-c4fe-49d9-acce-74581cfce275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:05.746308 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f2d15-c4fe-49d9-acce-74581cfce275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:05.747660 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f2d15-c4fe-49d9-acce-74581cfce275 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:05.761353 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 289/587] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:05.762418 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f2d15-c4fe-49d9-acce-74581cfce275 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:05.807428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:05.818968 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:05.844996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da888e-4860-4ad2-8d0c-cba1628a6e03 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:05.875529 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f2d15-c4fe-49d9-acce-74581cfce275 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:05.887460 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200011ef-3f8d-44f4-893a-22b1d50cd6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:05.888103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200011ef-3f8d-44f4-893a-22b1d50cd6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:05.888384 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200011ef-3f8d-44f4-893a-22b1d50cd6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:05.888699 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200011ef-3f8d-44f4-893a-22b1d50cd6e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:05.896578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200011ef-3f8d-44f4-893a-22b1d50cd6e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:05.898029 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200011ef-3f8d-44f4-893a-22b1d50cd6e2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:05.910881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-200011ef-3f8d-44f4-893a-22b1d50cd6e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:05.910881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:05.910881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:05.910881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:05.910881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:05.910881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:05.910881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:05.910881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:05.910881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:05.910881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:05.910881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:05.910881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:05.910881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:05.910881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:05.910881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:05.911763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:05.911763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:05.911763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:05.911763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:05.911763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:05.911763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:05.911763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:05.911763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:05.911763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:05.911763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:05.911763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:05.911763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:05.911763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:05.911763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:05.911763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:05.911763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:05.911763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:05.913260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:05.913260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:05.913260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:05.913260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:05.913260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:05.913260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:05.913260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:05.913260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:05.913260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 299/588] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:05.913260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200011ef-3f8d-44f4-893a-22b1d50cd6e2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:05.918724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee53a5-b786-4342-b30a-a3555efaf7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:05.919417 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee53a5-b786-4342-b30a-a3555efaf7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:05.919704 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee53a5-b786-4342-b30a-a3555efaf7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:05.919982 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee53a5-b786-4342-b30a-a3555efaf7f1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:05.930071 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee53a5-b786-4342-b30a-a3555efaf7f1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:05.931519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee53a5-b786-4342-b30a-a3555efaf7f1 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:05.943365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-0aee53a5-b786-4342-b30a-a3555efaf7f1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 09:58:05.943365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:05.943365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:05.943365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:05.943365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:05.943365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:05.943365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:05.943365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:05.943365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:05.943365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:05.943365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:05.943365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:05.943365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:05.943365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:05.943365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:05.943365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:05.944316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:05.944316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:05.944316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:05.944316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:05.944316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:05.944316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:05.944316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:05.944316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:05.944316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:05.944316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:05.944316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:05.944316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:05.944316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:05.944316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:05.944316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:05.944316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:05.944316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:05.944316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:05.945388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:05.945388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:05.945388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:05.945388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:05.945388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:05.945388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:05.945388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:05.945388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:05.945388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 09:58:05.945388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:05.945388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 290/589] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:58:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:05.945388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee53a5-b786-4342-b30a-a3555efaf7f1 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:06.030092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200011ef-3f8d-44f4-893a-22b1d50cd6e2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:06.044868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee53a5-b786-4342-b30a-a3555efaf7f1 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:06.055557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:06.062754 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:06.067943 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c9047-b052-4ea4-b039-e96100f58416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:06.069027 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c9047-b052-4ea4-b039-e96100f58416 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:06.069305 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c9047-b052-4ea4-b039-e96100f58416 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:06.069576 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c9047-b052-4ea4-b039-e96100f58416 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:06.076185 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c9047-b052-4ea4-b039-e96100f58416 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:06.077791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c9047-b052-4ea4-b039-e96100f58416 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:06.084205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee72da-f44e-4bc5-86a6-7cb3fa3bf1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:06.084919 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee72da-f44e-4bc5-86a6-7cb3fa3bf1a8 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:06.085206 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee72da-f44e-4bc5-86a6-7cb3fa3bf1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:06.085538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee72da-f44e-4bc5-86a6-7cb3fa3bf1a8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:06.088962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d27c9047-b052-4ea4-b039-e96100f58416 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:06.088962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:06.088962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:06.088962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:06.088962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:06.088962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:06.088962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:06.088962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:06.088962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:06.088962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:06.088962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:06.088962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:06.088962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:06.088962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:06.088962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:06.089814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:06.089814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:06.089814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:06.089814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:06.089814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:06.089814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:06.089814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:06.089814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:06.089814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:06.089814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:06.089814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:06.089814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:06.089814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:06.089814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:06.089814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:06.089814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:06.089814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:06.095833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:06.095833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:06.095833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:06.095833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:06.095833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:06.095833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:06.095833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:06.095833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:06.095833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 300/590] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:06.095833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c9047-b052-4ea4-b039-e96100f58416 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:06.097638 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee72da-f44e-4bc5-86a6-7cb3fa3bf1a8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:06.099136 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ee72da-f44e-4bc5-86a6-7cb3fa3bf1a8 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:06.111262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-f0ee72da-f44e-4bc5-86a6-7cb3fa3bf1a8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 09:58:06.111262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:06.111262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:06.111262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:06.111262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:06.111262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:06.111262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:06.111262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:06.111262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:06.111262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:06.111262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:06.111262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:06.111262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:06.111262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:06.111262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:06.111262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:06.112384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:06.112384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:06.112384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:06.112384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:06.112384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:06.112384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:06.112384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:06.112384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:06.112384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:06.112384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:06.112384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:06.112384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:06.112384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:06.112384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:06.112384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:06.112384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:06.112384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:06.112384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:06.113755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:06.113755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:06.113755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:06.113755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:06.113755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:06.113755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:06.113755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:06.113755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:06.113755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 09:58:06.113755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:06.113755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 291/591] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:58:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:06.113755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee72da-f44e-4bc5-86a6-7cb3fa3bf1a8 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:06.205742 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c9047-b052-4ea4-b039-e96100f58416 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:06.222126 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee72da-f44e-4bc5-86a6-7cb3fa3bf1a8 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:06.243044 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fec96-4653-4d84-b68e-90b48895405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:06.243660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fec96-4653-4d84-b68e-90b48895405a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:06.243938 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fec96-4653-4d84-b68e-90b48895405a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:06.244206 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fec96-4653-4d84-b68e-90b48895405a None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:06.245006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fec96-4653-4d84-b68e-90b48895405a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:06.245311 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fec96-4653-4d84-b68e-90b48895405a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:06.246739 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fec96-4653-4d84-b68e-90b48895405a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:06.265170 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f6d03-78a7-4bd9-9281-0c1c84cd0e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:06.265436 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 301/592] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:06.265563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f6d03-78a7-4bd9-9281-0c1c84cd0e89 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:06.265658 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fec96-4653-4d84-b68e-90b48895405a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:06.265729 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f6d03-78a7-4bd9-9281-0c1c84cd0e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:06.265729 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f6d03-78a7-4bd9-9281-0c1c84cd0e89 None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:06.265729 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f6d03-78a7-4bd9-9281-0c1c84cd0e89 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:06.265729 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f6d03-78a7-4bd9-9281-0c1c84cd0e89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:06.265729 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f6d03-78a7-4bd9-9281-0c1c84cd0e89 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:06.288621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 292/593] 10.222.0.85 () {56 vars in 1137 bytes} [Tue Aug 2 09:58:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:06.288621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f6d03-78a7-4bd9-9281-0c1c84cd0e89 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:06.324421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:06.334290 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:06.385759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fec96-4653-4d84-b68e-90b48895405a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:06.405344 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f6d03-78a7-4bd9-9281-0c1c84cd0e89 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:06.422246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef2b70-2524-4687-a3e3-357126d2a8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:06.422866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2b70-2524-4687-a3e3-357126d2a8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:06.423543 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2b70-2524-4687-a3e3-357126d2a8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:06.423821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef2b70-2524-4687-a3e3-357126d2a8b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:06.424725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef2b70-2524-4687-a3e3-357126d2a8b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:06.425037 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef2b70-2524-4687-a3e3-357126d2a8b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:06.426470 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef2b70-2524-4687-a3e3-357126d2a8b4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:06.444629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 302/594] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:06.444629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef2b70-2524-4687-a3e3-357126d2a8b4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:06.447085 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0274834-0a60-45dd-99af-657be422eb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:06.447713 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0274834-0a60-45dd-99af-657be422eb0f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:06.448080 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0274834-0a60-45dd-99af-657be422eb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:06.448364 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0274834-0a60-45dd-99af-657be422eb0f None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:06.449210 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0274834-0a60-45dd-99af-657be422eb0f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:06.449524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0274834-0a60-45dd-99af-657be422eb0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:06.450963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0274834-0a60-45dd-99af-657be422eb0f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:06.469039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 293/595] 10.222.0.85 () {56 vars in 1139 bytes} [Tue Aug 2 09:58:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:06.469870 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0274834-0a60-45dd-99af-657be422eb0f None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:06.559965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef2b70-2524-4687-a3e3-357126d2a8b4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:06.560153 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:06.573819 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:06.577563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0274834-0a60-45dd-99af-657be422eb0f None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:06.599502 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870009dd-f76b-4070-aff8-6f8aea1caddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:06.600174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870009dd-f76b-4070-aff8-6f8aea1caddb None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:06.600503 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870009dd-f76b-4070-aff8-6f8aea1caddb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:06.600805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870009dd-f76b-4070-aff8-6f8aea1caddb None admin] PATH_INFO: `/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/0af63c36df2c4ceaa2df4d3ac59542bc/roles/e30f587367384737a72bbcc2e35d62ad` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:06.613966 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445afd0-2ee2-4ee2-91f6-add50b898125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:06.614608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445afd0-2ee2-4ee2-91f6-add50b898125 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:06.614890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445afd0-2ee2-4ee2-91f6-add50b898125 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:06.615168 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445afd0-2ee2-4ee2-91f6-add50b898125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:06.617607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870009dd-f76b-4070-aff8-6f8aea1caddb None admin] RBAC: Authorizing `identity:create_grant(project_id=701d7ad0b7594984885e7bfe8a236937, user_id=0af63c36df2c4ceaa2df4d3ac59542bc, role_id=e30f587367384737a72bbcc2e35d62ad)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:06.619570 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870009dd-f76b-4070-aff8-6f8aea1caddb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:06.626936 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445afd0-2ee2-4ee2-91f6-add50b898125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:06.628568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445afd0-2ee2-4ee2-91f6-add50b898125 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:06.634482 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 303/596] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:58:06 2022] PUT /identity/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/0af63c36df2c4ceaa2df4d3ac59542bc/roles/e30f587367384737a72bbcc2e35d62ad => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:58:06.635530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870009dd-f76b-4070-aff8-6f8aea1caddb None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:06.646503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-d445afd0-2ee2-4ee2-91f6-add50b898125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:06.646503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:06.646503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:06.646503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:06.646503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:06.646503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:06.646503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:06.646503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:06.646503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:06.646503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:06.646503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:06.646503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:06.646503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:06.646503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:06.646503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:06.647657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:06.647657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:06.647657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:06.647657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:06.647657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:06.647657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:06.647657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:06.647657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:06.647657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:06.647657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:06.647657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:06.647657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:06.647657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:06.647657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:06.647657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:06.647657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:06.647657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:06.648805 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:06.648805 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:06.648805 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:06.648805 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:06.654858 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 294/597] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:06.655898 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445afd0-2ee2-4ee2-91f6-add50b898125 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:06.786367 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445afd0-2ee2-4ee2-91f6-add50b898125 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:06.787936 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870009dd-f76b-4070-aff8-6f8aea1caddb None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:06.828607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c9ba6-1731-4146-a086-a3531fe7a12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:06.829111 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c9ba6-1731-4146-a086-a3531fe7a12e None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:06.829398 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c9ba6-1731-4146-a086-a3531fe7a12e None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:06.829679 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c9ba6-1731-4146-a086-a3531fe7a12e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:06.830078 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f946f85-5dab-4784-add4-26e093c60241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:06.830871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f946f85-5dab-4784-add4-26e093c60241 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:06.831225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f946f85-5dab-4784-add4-26e093c60241 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:06.831510 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f946f85-5dab-4784-add4-26e093c60241 None admin] PATH_INFO: `/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/310867deefd34a598cfef2f3e4245ace/roles/e30f587367384737a72bbcc2e35d62ad` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:06.839961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:06.844727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c9ba6-1731-4146-a086-a3531fe7a12e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:06.846284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c9ba6-1731-4146-a086-a3531fe7a12e None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:06.847986 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f946f85-5dab-4784-add4-26e093c60241 None admin] RBAC: Authorizing `identity:create_grant(project_id=701d7ad0b7594984885e7bfe8a236937, user_id=310867deefd34a598cfef2f3e4245ace, role_id=e30f587367384737a72bbcc2e35d62ad)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:06.850095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f946f85-5dab-4784-add4-26e093c60241 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:06.863613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-e06c9ba6-1731-4146-a086-a3531fe7a12e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:06.863613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:06.863613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:06.863613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:06.863613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:06.863613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:06.863613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:06.863613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:06.863613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:06.863613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:06.863613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:06.863613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:06.863613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:06.863613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:06.863613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:06.864753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:06.864753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:06.864753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:06.864753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:06.864753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:06.864753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:06.864753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:06.864753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:06.864753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:06.864753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:06.864753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:06.864753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:06.864753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:06.864753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:06.864753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:06.864753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:06.864753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:06.865862 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:06.865862 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:06.865862 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:06.865862 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:06.865862 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 295/598] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:06.866579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c9ba6-1731-4146-a086-a3531fe7a12e None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:06.867539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 304/599] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:58:06 2022] PUT /identity/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/310867deefd34a598cfef2f3e4245ace/roles/e30f587367384737a72bbcc2e35d62ad => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:58:06.872505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461bddd-adf1-4694-8935-b075f8eae01e None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:06.872505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461bddd-adf1-4694-8935-b075f8eae01e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:06.872505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461bddd-adf1-4694-8935-b075f8eae01e None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:06.872505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 305/600] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:06.878735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461bddd-adf1-4694-8935-b075f8eae01e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:06.902786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:07.023235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8461bddd-adf1-4694-8935-b075f8eae01e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:07.032889 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c9ba6-1731-4146-a086-a3531fe7a12e None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:07.064645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c8035-3b49-4583-91f2-d9ad1d83cf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:07.065365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c8035-3b49-4583-91f2-d9ad1d83cf4b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:07.066414 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c8035-3b49-4583-91f2-d9ad1d83cf4b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:07.066414 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c8035-3b49-4583-91f2-d9ad1d83cf4b None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:07.066805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c8035-3b49-4583-91f2-d9ad1d83cf4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:07.067181 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c8035-3b49-4583-91f2-d9ad1d83cf4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:07.068669 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c8035-3b49-4583-91f2-d9ad1d83cf4b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:07.082304 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 306/601] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:07.086779 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc1363-13ee-4df0-bbf4-189f202cfb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:07.087246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abb668-5814-4499-8f41-f4213b365d1b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:07.087246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abb668-5814-4499-8f41-f4213b365d1b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:07.087426 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc1363-13ee-4df0-bbf4-189f202cfb5e None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:07.087426 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc1363-13ee-4df0-bbf4-189f202cfb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:07.087578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9abb668-5814-4499-8f41-f4213b365d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:07.087658 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc1363-13ee-4df0-bbf4-189f202cfb5e None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:07.087658 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc1363-13ee-4df0-bbf4-189f202cfb5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:07.087658 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc1363-13ee-4df0-bbf4-189f202cfb5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:07.087658 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc1363-13ee-4df0-bbf4-189f202cfb5e None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:07.100674 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 296/602] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:07.101580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc1363-13ee-4df0-bbf4-189f202cfb5e None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:07.109633 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e9abb668-5814-4499-8f41-f4213b365d1b None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:07.110976 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e9abb668-5814-4499-8f41-f4213b365d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:07.163852 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:07.194649 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 307/603] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:58:07.195432 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abb668-5814-4499-8f41-f4213b365d1b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:07.197737 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:07.230583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc1363-13ee-4df0-bbf4-189f202cfb5e None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:07.276390 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18f091-8c82-4b17-9914-cc3a2f0ecade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:07.277061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18f091-8c82-4b17-9914-cc3a2f0ecade None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:07.277341 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18f091-8c82-4b17-9914-cc3a2f0ecade None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:07.277613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18f091-8c82-4b17-9914-cc3a2f0ecade None admin] PATH_INFO: `/v3/projects/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:07.287139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18f091-8c82-4b17-9914-cc3a2f0ecade None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:07.288882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18f091-8c82-4b17-9914-cc3a2f0ecade None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:07.306762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-ca18f091-8c82-4b17-9914-cc3a2f0ecade None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:07.306762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:07.306762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:07.306762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:07.306762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:07.306762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:07.306762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:07.306762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:07.306762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:07.306762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:07.306762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:07.306762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:07.306762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:07.306762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:07.306762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:07.307892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:07.307892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:07.307892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:07.307892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:07.307892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:07.307892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:07.307892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:07.307892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:07.307892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:07.307892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:07.307892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:07.307892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:07.307892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:07.307892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:07.307892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:07.307892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:07.307892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:07.308996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:07.308996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:07.308996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:07.308996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:07.308996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:07.308996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:07.308996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:07.308996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:07.308996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 297/604] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:07.309486 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18f091-8c82-4b17-9914-cc3a2f0ecade None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:07.319584 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9abb668-5814-4499-8f41-f4213b365d1b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:07.358131 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb09177-8347-4996-89e1-7a22a355d806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:07.359242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb09177-8347-4996-89e1-7a22a355d806 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:07.359759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb09177-8347-4996-89e1-7a22a355d806 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:07.360237 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb09177-8347-4996-89e1-7a22a355d806 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:07.369472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb09177-8347-4996-89e1-7a22a355d806 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:07.371580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb09177-8347-4996-89e1-7a22a355d806 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:07.388545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-dbb09177-8347-4996-89e1-7a22a355d806 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:07.388545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:07.388545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:07.388545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:07.388545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:07.388545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:07.388545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:07.388545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:07.388545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:07.388545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:07.388545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:07.388545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:07.388545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:07.388545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:07.388545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:07.389674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:07.389674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:07.389674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:07.389674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:07.389674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:07.389674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:07.389674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:07.389674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:07.389674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:07.389674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:07.389674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:07.389674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:07.389674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:07.389674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:07.389674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:07.389674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:07.389674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:07.391616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:07.391616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:07.391616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:07.391616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:07.391616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:07.391616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:07.391616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:07.391616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:07.393823 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 308/605] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:07.395064 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb09177-8347-4996-89e1-7a22a355d806 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:07.439821 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18f091-8c82-4b17-9914-cc3a2f0ecade None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:07.463374 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:07.473438 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:07.489691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367059e6-e968-4a0d-a4a3-bd5453125855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:07.490876 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367059e6-e968-4a0d-a4a3-bd5453125855 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:07.491765 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367059e6-e968-4a0d-a4a3-bd5453125855 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:07.492304 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367059e6-e968-4a0d-a4a3-bd5453125855 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:07.507295 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367059e6-e968-4a0d-a4a3-bd5453125855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:07.510180 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb09177-8347-4996-89e1-7a22a355d806 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:07.515534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-367059e6-e968-4a0d-a4a3-bd5453125855 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:07.515534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:07.515534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:07.515534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:07.515534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:07.515534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:07.515534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:07.515534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:07.515534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:07.515534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:07.515534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:07.515534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:07.515534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:07.515534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:07.515534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:07.515534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:07.516637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:07.516637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:07.516637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:07.516637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:07.516637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:07.516637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:07.516637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:07.516637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:07.516637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:07.516637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:07.516637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:07.516637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:07.516637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:07.516637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:07.516637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:07.516637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:07.517743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:07.517743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:07.517743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:07.517743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:07.517743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:07.517743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:07.517743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:07.517743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:07.517743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:07.517743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:07.517743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:07.517743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:07.519722 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 298/606] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:58:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:07.521287 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367059e6-e968-4a0d-a4a3-bd5453125855 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:07.549652 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d2f14-6b15-4a46-8032-a8b6cb89030a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:07.550352 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d2f14-6b15-4a46-8032-a8b6cb89030a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:07.550704 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d2f14-6b15-4a46-8032-a8b6cb89030a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:07.551365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d2f14-6b15-4a46-8032-a8b6cb89030a None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:07.551890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d2f14-6b15-4a46-8032-a8b6cb89030a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:07.552300 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d2f14-6b15-4a46-8032-a8b6cb89030a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:07.553896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d2f14-6b15-4a46-8032-a8b6cb89030a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:07.568561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 309/607] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:07.569604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d2f14-6b15-4a46-8032-a8b6cb89030a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:07.659677 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367059e6-e968-4a0d-a4a3-bd5453125855 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:07.678944 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d2f14-6b15-4a46-8032-a8b6cb89030a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:07.704150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae3eee-227a-4e0a-bacd-6499e4834a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:07.705137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae3eee-227a-4e0a-bacd-6499e4834a07 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:07.705137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae3eee-227a-4e0a-bacd-6499e4834a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:07.705332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aae3eee-227a-4e0a-bacd-6499e4834a07 None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:07.706087 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae3eee-227a-4e0a-bacd-6499e4834a07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:07.706395 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae3eee-227a-4e0a-bacd-6499e4834a07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:07.707888 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aae3eee-227a-4e0a-bacd-6499e4834a07 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:07.708554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:07.722197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 299/608] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:07.723295 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae3eee-227a-4e0a-bacd-6499e4834a07 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:07.724587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686aee0a-fddd-4df4-864b-9c0e49583557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:07.725362 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686aee0a-fddd-4df4-864b-9c0e49583557 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:07.726081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686aee0a-fddd-4df4-864b-9c0e49583557 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:07.726519 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686aee0a-fddd-4df4-864b-9c0e49583557 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:07.728358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686aee0a-fddd-4df4-864b-9c0e49583557 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:07.728853 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686aee0a-fddd-4df4-864b-9c0e49583557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:07.730361 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686aee0a-fddd-4df4-864b-9c0e49583557 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:07.743827 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 310/609] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 09:58:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:07.744906 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686aee0a-fddd-4df4-864b-9c0e49583557 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:07.760974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:07.842694 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aae3eee-227a-4e0a-bacd-6499e4834a07 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:07.880699 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6be93-52c1-44b2-8380-efe26aaf6a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:07.881500 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6be93-52c1-44b2-8380-efe26aaf6a8a None admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:07.881791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6be93-52c1-44b2-8380-efe26aaf6a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:07.882391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b6be93-52c1-44b2-8380-efe26aaf6a8a None admin] PATH_INFO: `/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/828eb58cdce44ca8827f1ce2be7c19d7/roles/e30f587367384737a72bbcc2e35d62ad` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:07.889597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686aee0a-fddd-4df4-864b-9c0e49583557 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:07.901174 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6be93-52c1-44b2-8380-efe26aaf6a8a None admin] RBAC: Authorizing `identity:create_grant(project_id=701d7ad0b7594984885e7bfe8a236937, user_id=828eb58cdce44ca8827f1ce2be7c19d7, role_id=e30f587367384737a72bbcc2e35d62ad)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:07.903006 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b6be93-52c1-44b2-8380-efe26aaf6a8a None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:07.924815 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 300/610] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:58:07 2022] PUT /identity/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/828eb58cdce44ca8827f1ce2be7c19d7/roles/e30f587367384737a72bbcc2e35d62ad => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:58:07.926353 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6be93-52c1-44b2-8380-efe26aaf6a8a None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:07.949140 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b033b44-965e-4381-97f8-a9222349535e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:07.950278 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b033b44-965e-4381-97f8-a9222349535e None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:07.952142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b033b44-965e-4381-97f8-a9222349535e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:07.952834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b033b44-965e-4381-97f8-a9222349535e None admin] PATH_INFO: `/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/8e4e240f7958425a99a2cc1110e40c13/roles/e30f587367384737a72bbcc2e35d62ad` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:07.987721 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b033b44-965e-4381-97f8-a9222349535e None admin] RBAC: Authorizing `identity:create_grant(project_id=701d7ad0b7594984885e7bfe8a236937, user_id=8e4e240f7958425a99a2cc1110e40c13, role_id=e30f587367384737a72bbcc2e35d62ad)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:07.990957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b033b44-965e-4381-97f8-a9222349535e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:08.014077 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 311/611] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:58:07 2022] PUT /identity/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/8e4e240f7958425a99a2cc1110e40c13/roles/e30f587367384737a72bbcc2e35d62ad => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:58:08.081432 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:08.110163 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b6be93-52c1-44b2-8380-efe26aaf6a8a None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:08.152439 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ca62a-39c8-46e8-aa7d-a1903c44f3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:08.153139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ca62a-39c8-46e8-aa7d-a1903c44f3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:08.153425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ca62a-39c8-46e8-aa7d-a1903c44f3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:08.153711 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ca62a-39c8-46e8-aa7d-a1903c44f3c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:08.165920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ca62a-39c8-46e8-aa7d-a1903c44f3c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:08.167406 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ca62a-39c8-46e8-aa7d-a1903c44f3c2 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:08.187563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-782ca62a-39c8-46e8-aa7d-a1903c44f3c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:08.187563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:08.187563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:08.187563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:08.187563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:08.187563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:08.187563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:08.187563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:08.187563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:08.187563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:08.187563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:08.187563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:08.187563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:08.187563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:08.187563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:08.188646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:08.188646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:08.188646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:08.188646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:08.188646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:08.188646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:08.188646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:08.188646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:08.188646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:08.188646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:08.188646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:08.188646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:08.188646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:08.188646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:08.188646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:08.188646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:08.188646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:08.189786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:08.189786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:08.189786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:08.189786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:08.189786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 301/612] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:08.194874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b033b44-965e-4381-97f8-a9222349535e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:08.236221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:08.315961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b033b44-965e-4381-97f8-a9222349535e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:08.353092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c16d03-cb9a-465b-9f1a-41911d18deef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:08.353862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c16d03-cb9a-465b-9f1a-41911d18deef None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:08.354249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c16d03-cb9a-465b-9f1a-41911d18deef None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:08.354624 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c16d03-cb9a-465b-9f1a-41911d18deef None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:08.355427 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c16d03-cb9a-465b-9f1a-41911d18deef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:08.355832 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c16d03-cb9a-465b-9f1a-41911d18deef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:08.357331 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c16d03-cb9a-465b-9f1a-41911d18deef None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:08.371808 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 312/613] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:08.377764 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ca62a-39c8-46e8-aa7d-a1903c44f3c2 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:08.497244 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ca62a-39c8-46e8-aa7d-a1903c44f3c2 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:08.536921 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:08.542695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741d7a0-8868-4b14-bb6d-482b410a0fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:08.543342 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d7a0-8868-4b14-bb6d-482b410a0fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:08.543629 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d7a0-8868-4b14-bb6d-482b410a0fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:08.543908 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d7a0-8868-4b14-bb6d-482b410a0fa1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:08.555243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741d7a0-8868-4b14-bb6d-482b410a0fa1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:08.556746 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741d7a0-8868-4b14-bb6d-482b410a0fa1 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:08.572631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-c741d7a0-8868-4b14-bb6d-482b410a0fa1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:58:08.572631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:08.572631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:08.572631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:08.572631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:08.572631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:08.572631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:08.572631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:08.572631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:08.572631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:08.572631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:08.572631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:08.572631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:08.572631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:08.572631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:08.572631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:08.573995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:08.573995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:08.573995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:08.573995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:08.573995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:08.573995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:08.573995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:08.573995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:08.573995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:08.573995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:08.573995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:08.573995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:08.573995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:08.573995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:08.573995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:08.573995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:08.573995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:08.573995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:08.576022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:08.576022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:08.576022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:08.576022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:08.576022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:08.576022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:08.576022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:08.576022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:08.576022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:58:08.576022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:08.576022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 302/614] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:58:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:08.581731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c16d03-cb9a-465b-9f1a-41911d18deef None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:08.730306 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:08.739032 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c16d03-cb9a-465b-9f1a-41911d18deef None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:08.790392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0603405-f346-46d1-9b19-4956add2476c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:08.791031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0603405-f346-46d1-9b19-4956add2476c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:08.791331 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0603405-f346-46d1-9b19-4956add2476c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:08.791610 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0603405-f346-46d1-9b19-4956add2476c None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:08.792501 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0603405-f346-46d1-9b19-4956add2476c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:08.792869 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0603405-f346-46d1-9b19-4956add2476c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:08.794516 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0603405-f346-46d1-9b19-4956add2476c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:08.822885 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 313/615] 10.222.0.85 () {56 vars in 1135 bytes} [Tue Aug 2 09:58:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:08.828594 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741d7a0-8868-4b14-bb6d-482b410a0fa1 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:08.937247 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124e0b9-cfbb-4ac4-8772-5785bbbccbfa None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:08.937796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124e0b9-cfbb-4ac4-8772-5785bbbccbfa None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:08.937796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124e0b9-cfbb-4ac4-8772-5785bbbccbfa None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:08.939236 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 314/616] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:08.944330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dccb7-0818-4bfd-aa00-28b5309815fe None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:08.944643 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dccb7-0818-4bfd-aa00-28b5309815fe None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:08.944929 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dccb7-0818-4bfd-aa00-28b5309815fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:08.961576 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741d7a0-8868-4b14-bb6d-482b410a0fa1 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:08.972787 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d24dccb7-0818-4bfd-aa00-28b5309815fe None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:08.973999 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d24dccb7-0818-4bfd-aa00-28b5309815fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:09.024228 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2edef8-4fbf-4e91-803d-2d0130f2618f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:09.024906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2edef8-4fbf-4e91-803d-2d0130f2618f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:09.025198 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2edef8-4fbf-4e91-803d-2d0130f2618f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:09.025475 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2edef8-4fbf-4e91-803d-2d0130f2618f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:09.054294 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2edef8-4fbf-4e91-803d-2d0130f2618f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:09.055730 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2edef8-4fbf-4e91-803d-2d0130f2618f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:09.086186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-9f2edef8-4fbf-4e91-803d-2d0130f2618f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:09.086186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:09.086186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:09.086186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:09.086186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:09.086186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:09.086186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:09.086186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:09.086186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:09.086186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:09.086186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:09.086186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:09.086186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:09.086186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:09.086186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:09.087121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:09.087121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:09.087121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:09.087121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:09.087121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:09.087121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:09.087121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:09.087121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:09.087121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:09.087121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:09.087121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:09.087121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:09.087121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:09.087121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:09.087121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:09.087121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:09.087121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:09.088622 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:09.088622 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:09.088622 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:09.088622 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:09.088622 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 303/617] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:09.095147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2edef8-4fbf-4e91-803d-2d0130f2618f None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:09.103832 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 315/618] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:58:09.138230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dccb7-0818-4bfd-aa00-28b5309815fe None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:09.164194 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:09.300590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2edef8-4fbf-4e91-803d-2d0130f2618f None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:09.332860 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:09.356112 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dccb7-0818-4bfd-aa00-28b5309815fe None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:09.376626 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b763f1-0bf9-4738-916a-68648000b093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:09.377259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b763f1-0bf9-4738-916a-68648000b093 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:09.377543 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b763f1-0bf9-4738-916a-68648000b093 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:09.377821 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b763f1-0bf9-4738-916a-68648000b093 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:09.378524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b763f1-0bf9-4738-916a-68648000b093 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:09.378834 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b763f1-0bf9-4738-916a-68648000b093 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:09.380229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b763f1-0bf9-4738-916a-68648000b093 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:09.394467 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 304/619] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:09.395359 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506144c-f84f-4aff-9997-b2f80d6272d2 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:09.395649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506144c-f84f-4aff-9997-b2f80d6272d2 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:09.395928 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b506144c-f84f-4aff-9997-b2f80d6272d2 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:09.400542 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 305/620] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:09.401571 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506144c-f84f-4aff-9997-b2f80d6272d2 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:09.405545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5af01-1cd6-4c0f-98e4-56b228a975be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:09.406499 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5af01-1cd6-4c0f-98e4-56b228a975be None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:09.406855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5af01-1cd6-4c0f-98e4-56b228a975be None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:09.407200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5af01-1cd6-4c0f-98e4-56b228a975be None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:09.419472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5af01-1cd6-4c0f-98e4-56b228a975be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:09.425926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d7c5af01-1cd6-4c0f-98e4-56b228a975be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:09.425926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:09.425926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:09.425926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:09.425926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:09.425926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:09.425926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:09.425926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:09.425926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:09.425926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:09.425926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:09.425926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:09.425926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:09.425926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:09.425926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:09.425926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:09.427009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:09.427009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:09.427009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:09.427009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:09.427009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:09.427009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:09.427009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:09.427009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:09.427009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:09.427009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:09.427009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:09.427009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:09.427009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:09.427009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:09.427009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:09.427009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:09.427835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:09.427835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:09.427835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:09.427835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:09.427835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:09.427835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:09.427835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:09.427835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:09.427835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:09.427835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:09.427835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:09.427835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:09.427835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 316/621] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:58:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:09.429096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe44d2-64c1-4877-ba15-a46c09477bd3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:09.429096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe44d2-64c1-4877-ba15-a46c09477bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:09.429264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe44d2-64c1-4877-ba15-a46c09477bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:09.451784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-83fe44d2-64c1-4877-ba15-a46c09477bd3 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:09.453151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-83fe44d2-64c1-4877-ba15-a46c09477bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:09.537153 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 317/622] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:58:09.538022 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe44d2-64c1-4877-ba15-a46c09477bd3 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:09.559296 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b506144c-f84f-4aff-9997-b2f80d6272d2 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:09.564863 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:09.618017 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dd369-118f-4568-b61b-7f38cbd55e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:09.619021 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dd369-118f-4568-b61b-7f38cbd55e8c None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:09.619527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dd369-118f-4568-b61b-7f38cbd55e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:09.620023 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dd369-118f-4568-b61b-7f38cbd55e8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:09.628806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077dd369-118f-4568-b61b-7f38cbd55e8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:09.630600 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077dd369-118f-4568-b61b-7f38cbd55e8c None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:09.643837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-077dd369-118f-4568-b61b-7f38cbd55e8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:09.643837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:09.643837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:09.643837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:09.643837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:09.643837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:09.643837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:09.643837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:09.643837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:09.643837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:09.643837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:09.643837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:09.643837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:09.643837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:09.643837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:09.644804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:09.644804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:09.644804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:09.644804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:09.644804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:09.644804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:09.644804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:09.644804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:09.644804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:09.644804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:09.644804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:09.644804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:09.644804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:09.644804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:09.644804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:09.644804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:09.644804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:09.645684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:09.645684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:09.645684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:09.645684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:09.645684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:09.645684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:09.645684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:09.645684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:09.648081 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 306/623] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:09.648200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:09.653447 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dd369-118f-4568-b61b-7f38cbd55e8c None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:09.690423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe44d2-64c1-4877-ba15-a46c09477bd3 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:09.736347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4223e-e7c0-48b6-8aa7-22c3d3f43490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:09.736994 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4223e-e7c0-48b6-8aa7-22c3d3f43490 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:09.737285 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4223e-e7c0-48b6-8aa7-22c3d3f43490 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:09.737563 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4223e-e7c0-48b6-8aa7-22c3d3f43490 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:09.738290 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4223e-e7c0-48b6-8aa7-22c3d3f43490 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:09.738600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4223e-e7c0-48b6-8aa7-22c3d3f43490 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:09.740560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4223e-e7c0-48b6-8aa7-22c3d3f43490 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:09.752642 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 318/624] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 09:58:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:09.753465 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4223e-e7c0-48b6-8aa7-22c3d3f43490 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:09.769372 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dd369-118f-4568-b61b-7f38cbd55e8c None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:09.809756 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa9765-c886-4aa9-999d-5c3d7e737123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:09.810328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa9765-c886-4aa9-999d-5c3d7e737123 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:09.810617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa9765-c886-4aa9-999d-5c3d7e737123 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:09.810897 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa9765-c886-4aa9-999d-5c3d7e737123 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:09.824661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa9765-c886-4aa9-999d-5c3d7e737123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:09.833501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-36fa9765-c886-4aa9-999d-5c3d7e737123 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:09.833501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:09.833501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:09.833501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:09.833501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:09.833501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:09.833501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:09.833501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:09.833501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:09.833501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:09.833501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:09.833501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:09.833501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:09.833501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:09.833501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:09.833501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:09.834504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:09.834504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:09.834504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:09.834504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:09.834504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:09.834504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:09.834504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:09.834504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:09.834504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:09.834504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:09.834504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:09.834504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:09.834504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:09.834504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:09.834504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:09.834504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:09.835356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:09.835356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:09.835356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:09.835356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:09.835356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:09.835356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:09.835356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:09.835356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:09.835356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:09.835356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:09.835356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:09.835356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:09.839624 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 307/625] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:58:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:09.840635 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa9765-c886-4aa9-999d-5c3d7e737123 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:09.877312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:09.895012 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4223e-e7c0-48b6-8aa7-22c3d3f43490 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:09.937657 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2ece3-e463-4561-9c0e-468358b0717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:09.939867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2ece3-e463-4561-9c0e-468358b0717a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:09.941260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2ece3-e463-4561-9c0e-468358b0717a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:09.941557 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2ece3-e463-4561-9c0e-468358b0717a None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:09.942615 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2ece3-e463-4561-9c0e-468358b0717a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:09.942935 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2ece3-e463-4561-9c0e-468358b0717a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:09.944383 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2ece3-e463-4561-9c0e-468358b0717a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:09.946381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:09.968499 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 319/626] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:09.968499 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2ece3-e463-4561-9c0e-468358b0717a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:09.998086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa9765-c886-4aa9-999d-5c3d7e737123 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:10.041695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4b59e-8595-460f-966e-7e3432424c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:10.043186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4b59e-8595-460f-966e-7e3432424c49 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:10.043622 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4b59e-8595-460f-966e-7e3432424c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:10.044044 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4b59e-8595-460f-966e-7e3432424c49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:10.059832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4b59e-8595-460f-966e-7e3432424c49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:10.062074 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4b59e-8595-460f-966e-7e3432424c49 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:10.079981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-d7e4b59e-8595-460f-966e-7e3432424c49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:10.079981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:10.079981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:10.079981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:10.079981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:10.079981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:10.079981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:10.079981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:10.079981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:10.079981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:10.079981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:10.079981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:10.079981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:10.079981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:10.079981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:10.081049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:10.081049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:10.081049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:10.081049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:10.081049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:10.081049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:10.081049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:10.081049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:10.081049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:10.081049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:10.081049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:10.081049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:10.081049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:10.081049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:10.081049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:10.081049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:10.081049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:10.081935 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:10.081935 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:10.081935 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:10.081935 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:10.084657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 308/627] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:10.085690 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4b59e-8595-460f-966e-7e3432424c49 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:10.101246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2ece3-e463-4561-9c0e-468358b0717a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:10.141950 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee68bdb-0afc-4fe5-b6da-5d6bc1b652b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:10.142938 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee68bdb-0afc-4fe5-b6da-5d6bc1b652b8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:10.143380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee68bdb-0afc-4fe5-b6da-5d6bc1b652b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:10.143802 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee68bdb-0afc-4fe5-b6da-5d6bc1b652b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:10.144814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee68bdb-0afc-4fe5-b6da-5d6bc1b652b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:10.145274 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee68bdb-0afc-4fe5-b6da-5d6bc1b652b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:10.146782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee68bdb-0afc-4fe5-b6da-5d6bc1b652b8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:10.161199 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 320/628] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 09:58:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:10.162363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee68bdb-0afc-4fe5-b6da-5d6bc1b652b8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:10.184649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:10.211596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4b59e-8595-460f-966e-7e3432424c49 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:10.229523 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:10.253161 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7e542-9904-4b33-9129-a0a5440a2ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:10.254346 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7e542-9904-4b33-9129-a0a5440a2ee3 None admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:10.254841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7e542-9904-4b33-9129-a0a5440a2ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:10.255365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7e542-9904-4b33-9129-a0a5440a2ee3 None admin] PATH_INFO: `/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/e9cfed2469a7419f8fcbe09d25cb896e/roles/e30f587367384737a72bbcc2e35d62ad` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:10.272682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7e542-9904-4b33-9129-a0a5440a2ee3 None admin] RBAC: Authorizing `identity:create_grant(project_id=701d7ad0b7594984885e7bfe8a236937, user_id=e9cfed2469a7419f8fcbe09d25cb896e, role_id=e30f587367384737a72bbcc2e35d62ad)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:10.274912 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7e542-9904-4b33-9129-a0a5440a2ee3 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:10.292590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 309/629] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:58:10 2022] PUT /identity/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/e9cfed2469a7419f8fcbe09d25cb896e/roles/e30f587367384737a72bbcc2e35d62ad => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:58:10.293935 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7e542-9904-4b33-9129-a0a5440a2ee3 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:10.304500 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee68bdb-0afc-4fe5-b6da-5d6bc1b652b8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:10.345106 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d78a46-b368-43de-88c6-b57d128f4255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:10.345655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d78a46-b368-43de-88c6-b57d128f4255 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:10.347911 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d78a46-b368-43de-88c6-b57d128f4255 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:10.350385 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d78a46-b368-43de-88c6-b57d128f4255 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:10.351737 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d78a46-b368-43de-88c6-b57d128f4255 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:10.352369 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d78a46-b368-43de-88c6-b57d128f4255 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:10.354942 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d78a46-b368-43de-88c6-b57d128f4255 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:10.394301 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 321/630] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:10.399653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d78a46-b368-43de-88c6-b57d128f4255 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:10.491513 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7e542-9904-4b33-9129-a0a5440a2ee3 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:10.522745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:10.527199 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d78a46-b368-43de-88c6-b57d128f4255 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:10.532933 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8b9ac-0c8e-49a4-ab82-ccc58025a7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:10.533906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8b9ac-0c8e-49a4-ab82-ccc58025a7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:10.534404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8b9ac-0c8e-49a4-ab82-ccc58025a7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:10.534928 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8b9ac-0c8e-49a4-ab82-ccc58025a7a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:10.546036 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:10.551092 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8b9ac-0c8e-49a4-ab82-ccc58025a7a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:10.552984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8b9ac-0c8e-49a4-ab82-ccc58025a7a0 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:10.565492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294f7db-490b-43cd-b510-301fdb8773cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:10.566135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294f7db-490b-43cd-b510-301fdb8773cf None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:10.566409 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294f7db-490b-43cd-b510-301fdb8773cf None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:10.566682 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294f7db-490b-43cd-b510-301fdb8773cf None admin] PATH_INFO: `/v3/users/glance` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:10.568568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-64d8b9ac-0c8e-49a4-ab82-ccc58025a7a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:10.568568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:10.568568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:10.568568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:10.568568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:10.568568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:10.568568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:10.568568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:10.568568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:10.568568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:10.568568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:10.568568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:10.568568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:10.568568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:10.568568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:10.569665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:10.569665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:10.569665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:10.569665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:10.569665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:10.569665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:10.569665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:10.569665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:10.569665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:10.569665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:10.569665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:10.569665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:10.569665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:10.569665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:10.569665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:10.569665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:10.569665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:10.570849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:10.570849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:10.570849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:10.570849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:10.570849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 310/631] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:10.571165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07bbcc-2d10-4a5c-b270-37754d216015 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:10.571296 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07bbcc-2d10-4a5c-b270-37754d216015 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:10.571573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07bbcc-2d10-4a5c-b270-37754d216015 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:10.572999 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 311/632] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:10.577901 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a6598-fbda-4029-acd4-e86f97d870ce None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:10.578187 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a6598-fbda-4029-acd4-e86f97d870ce None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:10.578639 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a6598-fbda-4029-acd4-e86f97d870ce None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:10.579587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294f7db-490b-43cd-b510-301fdb8773cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:10.584092 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 312/633] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:10.584092 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a6598-fbda-4029-acd4-e86f97d870ce None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:10.584311 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b294f7db-490b-43cd-b510-301fdb8773cf None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:10.593777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-b294f7db-490b-43cd-b510-301fdb8773cf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 09:58:10.593777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:10.593777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:10.593777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:10.593777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:10.593777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:10.593777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:10.593777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:10.593777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:10.593777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:10.593777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:10.593777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:10.593777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:10.593777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:10.593777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:10.593777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:10.594745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:10.594745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:10.594745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:10.594745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:10.594745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:10.594745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:10.594745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:10.594745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:10.594745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:10.594745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:10.594745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:10.594745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:10.594745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:10.594745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:10.594745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:10.594745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:10.594745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:10.594745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:10.595718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:10.595718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:10.595718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:10.595718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:10.595718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:10.595718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:10.595718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:10.595718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:10.595718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 09:58:10.595718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:10.595718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 322/634] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:58:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:10.596320 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9b11c-9f6c-4df7-bae2-34bc991aefbc None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:10.596417 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9b11c-9f6c-4df7-bae2-34bc991aefbc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:10.596745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9b11c-9f6c-4df7-bae2-34bc991aefbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:10.615315 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-84b9b11c-9f6c-4df7-bae2-34bc991aefbc None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:10.616504 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-84b9b11c-9f6c-4df7-bae2-34bc991aefbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:10.686246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 323/635] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:58:10.687575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac47f1b-9596-40df-9b4e-49ebce921352 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:10.687870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac47f1b-9596-40df-9b4e-49ebce921352 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:10.688146 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac47f1b-9596-40df-9b4e-49ebce921352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:10.706872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0ac47f1b-9596-40df-9b4e-49ebce921352 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:10.708112 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0ac47f1b-9596-40df-9b4e-49ebce921352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:10.720952 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a6598-fbda-4029-acd4-e86f97d870ce None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:10.761176 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdd063-c0b6-4e5c-990a-d5082a0a8492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:10.761922 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdd063-c0b6-4e5c-990a-d5082a0a8492 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:10.762216 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdd063-c0b6-4e5c-990a-d5082a0a8492 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:10.762482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdd063-c0b6-4e5c-990a-d5082a0a8492 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:10.763175 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdd063-c0b6-4e5c-990a-d5082a0a8492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:10.763482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdd063-c0b6-4e5c-990a-d5082a0a8492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:10.765048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdd063-c0b6-4e5c-990a-d5082a0a8492 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:10.782588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 313/636] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:10.782588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdd063-c0b6-4e5c-990a-d5082a0a8492 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:10.788799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 324/637] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:58:10.797840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac47f1b-9596-40df-9b4e-49ebce921352 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:10.825208 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:10.844437 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:10.895836 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdd063-c0b6-4e5c-990a-d5082a0a8492 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:10.916635 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac47f1b-9596-40df-9b4e-49ebce921352 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:10.939570 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71520ea-4b1c-431c-ac0c-799b0f4634eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:10.940186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71520ea-4b1c-431c-ac0c-799b0f4634eb None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:10.940645 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71520ea-4b1c-431c-ac0c-799b0f4634eb None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:10.940753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71520ea-4b1c-431c-ac0c-799b0f4634eb None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:10.941548 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71520ea-4b1c-431c-ac0c-799b0f4634eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:10.941852 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71520ea-4b1c-431c-ac0c-799b0f4634eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:10.943548 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71520ea-4b1c-431c-ac0c-799b0f4634eb None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:10.959219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2f8ea-c8c4-4353-9360-fdf319b71be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:10.959857 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2f8ea-c8c4-4353-9360-fdf319b71be4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:10.960133 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2f8ea-c8c4-4353-9360-fdf319b71be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:10.960410 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2f8ea-c8c4-4353-9360-fdf319b71be4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:10.962655 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 314/638] 10.222.0.85 () {56 vars in 1137 bytes} [Tue Aug 2 09:58:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:10.963390 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71520ea-4b1c-431c-ac0c-799b0f4634eb None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:10.977266 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2f8ea-c8c4-4353-9360-fdf319b71be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:10.982851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-2fc2f8ea-c8c4-4353-9360-fdf319b71be4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:10.982851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:10.982851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:10.982851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:10.982851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:10.982851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:10.982851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:10.982851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:10.982851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:10.982851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:10.982851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:10.982851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:10.982851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:10.982851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:10.982851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:10.982851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:10.984486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:10.984486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:10.984486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:10.984486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:10.984486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:10.984486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:10.984486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:10.984486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:10.984486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:10.984486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:10.984486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:10.984486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:10.984486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:10.984486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:10.984486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:10.984486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:10.985353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:10.985353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:10.985353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:10.985353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:10.985353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:10.985353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:10.985353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:10.985353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:10.985353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:10.985353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:10.985353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:10.985353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:10.985353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 325/639] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:58:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:10.985353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2f8ea-c8c4-4353-9360-fdf319b71be4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:11.072176 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:11.080171 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71520ea-4b1c-431c-ac0c-799b0f4634eb None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:11.084682 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:11.091225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2f8ea-c8c4-4353-9360-fdf319b71be4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:11.116919 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa44dc-6b5a-4180-83a6-19fc10f1d4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:11.117635 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa44dc-6b5a-4180-83a6-19fc10f1d4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:11.118010 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa44dc-6b5a-4180-83a6-19fc10f1d4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:11.118344 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa44dc-6b5a-4180-83a6-19fc10f1d4c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:11.126321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa44dc-6b5a-4180-83a6-19fc10f1d4c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:11.127015 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745435c-1230-41d8-81e1-728b0d7279c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:11.127660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745435c-1230-41d8-81e1-728b0d7279c2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:11.127822 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa44dc-6b5a-4180-83a6-19fc10f1d4c2 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:11.127951 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745435c-1230-41d8-81e1-728b0d7279c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:11.128208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745435c-1230-41d8-81e1-728b0d7279c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:11.140072 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745435c-1230-41d8-81e1-728b0d7279c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:11.141003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-89aa44dc-6b5a-4180-83a6-19fc10f1d4c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:58:11.141003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:11.141003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:11.141003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:11.141003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:11.141003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:11.141003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:11.141003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:11.141003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:11.141003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:11.141003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:11.141003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:11.141003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:11.141003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:11.141003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:11.141003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:11.141911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:11.141911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:11.141911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:11.141911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:11.141911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:11.141911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:11.141911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:11.141911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:11.141911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:11.141911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:11.141911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:11.141911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:11.141911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:11.141911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:11.141911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:11.141911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:11.141911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:11.141911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:11.143427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:11.143427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:11.143427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:11.143427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:11.143427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:11.143427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:11.143427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:11.143427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:11.143427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:58:11.143427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:11.143427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 315/640] 10.222.0.85 () {56 vars in 1093 bytes} [Tue Aug 2 09:58:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:11.143427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa44dc-6b5a-4180-83a6-19fc10f1d4c2 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:11.149175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d745435c-1230-41d8-81e1-728b0d7279c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:11.149175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:11.149175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:11.149175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:11.149175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:11.149175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:11.149175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:11.149175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:11.149175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:11.149175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:11.149175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:11.149175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:11.149175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:11.149175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:11.149175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:11.149175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:11.150159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:11.150159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:11.150159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:11.150159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:11.150159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:11.150159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:11.150159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:11.150159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:11.150159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:11.150159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:11.150159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:11.150159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:11.150159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:11.150159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:11.150159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:11.150159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:11.151039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:11.151039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:11.151039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:11.151039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:11.151039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:11.151039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:11.151039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:11.151039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:11.151039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:11.151039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:11.151039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:11.151039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:11.151039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 326/641] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:58:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:11.151731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745435c-1230-41d8-81e1-728b0d7279c2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:11.258146 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa44dc-6b5a-4180-83a6-19fc10f1d4c2 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:11.259348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745435c-1230-41d8-81e1-728b0d7279c2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:11.297195 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e178d7e-6262-4b8f-86db-4a6bf2d86240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:11.298157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e178d7e-6262-4b8f-86db-4a6bf2d86240 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:11.298621 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e178d7e-6262-4b8f-86db-4a6bf2d86240 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:11.299077 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e178d7e-6262-4b8f-86db-4a6bf2d86240 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:11.300024 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e178d7e-6262-4b8f-86db-4a6bf2d86240 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:11.300288 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e178d7e-6262-4b8f-86db-4a6bf2d86240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:11.301724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e178d7e-6262-4b8f-86db-4a6bf2d86240 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:11.311238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 327/642] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 09:58:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:11.311411 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d17399-4314-44a8-8d4e-ace6384fab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:11.312228 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d17399-4314-44a8-8d4e-ace6384fab32 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:11.312721 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d17399-4314-44a8-8d4e-ace6384fab32 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:11.313096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d17399-4314-44a8-8d4e-ace6384fab32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:11.316603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e178d7e-6262-4b8f-86db-4a6bf2d86240 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:11.339292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:11.344479 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:11.393190 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d17399-4314-44a8-8d4e-ace6384fab32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:11.394741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d17399-4314-44a8-8d4e-ace6384fab32 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:11.428959 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e178d7e-6262-4b8f-86db-4a6bf2d86240 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:11.465184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1247bb8-a76c-4d9e-b780-bf18e75944c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:11.465848 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1247bb8-a76c-4d9e-b780-bf18e75944c4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:11.466144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1247bb8-a76c-4d9e-b780-bf18e75944c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:11.466416 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1247bb8-a76c-4d9e-b780-bf18e75944c4 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:11.467815 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1247bb8-a76c-4d9e-b780-bf18e75944c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:11.468114 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1247bb8-a76c-4d9e-b780-bf18e75944c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:11.469642 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1247bb8-a76c-4d9e-b780-bf18e75944c4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:11.488691 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 328/643] 10.222.0.85 () {56 vars in 1133 bytes} [Tue Aug 2 09:58:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:11.489549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1247bb8-a76c-4d9e-b780-bf18e75944c4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:11.511607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 316/644] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:58:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:58:11.512822 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d17399-4314-44a8-8d4e-ace6384fab32 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:11.573867 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:11.577283 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:11.601075 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1247bb8-a76c-4d9e-b780-bf18e75944c4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:11.624663 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d17399-4314-44a8-8d4e-ace6384fab32 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:11.639960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a940a-fb0c-4399-8cef-a0626c93fb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:11.640688 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a940a-fb0c-4399-8cef-a0626c93fb51 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:11.640987 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a940a-fb0c-4399-8cef-a0626c93fb51 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:11.641262 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a940a-fb0c-4399-8cef-a0626c93fb51 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:11.642179 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a940a-fb0c-4399-8cef-a0626c93fb51 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:11.642484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a940a-fb0c-4399-8cef-a0626c93fb51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:11.643919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a940a-fb0c-4399-8cef-a0626c93fb51 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:11.652720 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 329/645] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 09:58:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:11.653549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a940a-fb0c-4399-8cef-a0626c93fb51 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:11.669844 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6b35b-ab21-45f6-abff-196826378372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:11.670544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6b35b-ab21-45f6-abff-196826378372 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:11.670829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6b35b-ab21-45f6-abff-196826378372 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:11.671167 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6b35b-ab21-45f6-abff-196826378372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:11.681592 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6b35b-ab21-45f6-abff-196826378372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:11.683493 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6b35b-ab21-45f6-abff-196826378372 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:11.700883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-92e6b35b-ab21-45f6-abff-196826378372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:11.700883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:11.700883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:11.700883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:11.700883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:11.700883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:11.700883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:11.700883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:11.700883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:11.700883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:11.700883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:11.700883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:11.700883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:11.700883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:11.700883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:11.702559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:11.702559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:11.702559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:11.702559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:11.702559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:11.702559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:11.702559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:11.702559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:11.702559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:11.702559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:11.702559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:11.702559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:11.702559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:11.702559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:11.702559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:11.702559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:11.702559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:11.703673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:11.703673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:11.703673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:11.703673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:11.703673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 317/646] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:11.704573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6b35b-ab21-45f6-abff-196826378372 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:11.773075 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a940a-fb0c-4399-8cef-a0626c93fb51 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:11.812022 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cb5fa-de98-42a9-b28f-3974c2e0cdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:11.812695 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cb5fa-de98-42a9-b28f-3974c2e0cdf9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:11.813000 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cb5fa-de98-42a9-b28f-3974c2e0cdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:11.813269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cb5fa-de98-42a9-b28f-3974c2e0cdf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:11.813564 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6b35b-ab21-45f6-abff-196826378372 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:11.821916 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:11.824326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:11.852951 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc146e0-c8b0-4896-b062-a79d6e80a4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:11.853590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc146e0-c8b0-4896-b062-a79d6e80a4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:11.853870 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc146e0-c8b0-4896-b062-a79d6e80a4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:11.854144 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc146e0-c8b0-4896-b062-a79d6e80a4c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:11.865133 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc146e0-c8b0-4896-b062-a79d6e80a4c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:11.866590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc146e0-c8b0-4896-b062-a79d6e80a4c5 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:11.882077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-dcc146e0-c8b0-4896-b062-a79d6e80a4c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:11.882077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:11.882077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:11.882077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:11.882077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:11.882077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:11.882077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:11.882077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:11.882077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:11.882077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:11.882077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:11.882077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:11.882077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:11.882077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:11.882077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:11.883154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:11.883154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:11.883154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:11.883154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:11.883154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:11.883154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:11.883154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:11.883154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:11.883154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:11.883154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:11.883154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:11.883154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:11.883154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:11.883154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:11.883154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:11.883154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:11.883154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:11.884525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:11.884525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:11.884525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:11.884525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:11.886084 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 318/647] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:11.886999 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc146e0-c8b0-4896-b062-a79d6e80a4c5 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:11.895540 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86cb5fa-de98-42a9-b28f-3974c2e0cdf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:11.897436 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86cb5fa-de98-42a9-b28f-3974c2e0cdf9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:11.991560 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc146e0-c8b0-4896-b062-a79d6e80a4c5 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:12.008262 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 330/648] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:58:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:58:12.013895 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cb5fa-de98-42a9-b28f-3974c2e0cdf9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:12.028103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a86d60-3e41-4513-9933-0a1fbbdef83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:12.028904 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a86d60-3e41-4513-9933-0a1fbbdef83d None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:12.029205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a86d60-3e41-4513-9933-0a1fbbdef83d None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:12.029480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a86d60-3e41-4513-9933-0a1fbbdef83d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:12.047673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a86d60-3e41-4513-9933-0a1fbbdef83d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:12.050012 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a86d60-3e41-4513-9933-0a1fbbdef83d None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:12.061216 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:12.069503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-f9a86d60-3e41-4513-9933-0a1fbbdef83d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:12.069503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:12.069503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:12.069503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:12.069503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:12.069503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:12.069503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:12.069503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:12.069503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:12.069503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:12.069503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:12.069503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:12.069503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:12.069503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:12.069503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:12.070400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:12.070400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:12.070400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:12.070400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:12.070400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:12.070400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:12.070400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:12.070400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:12.070400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:12.070400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:12.070400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:12.070400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:12.070400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:12.070400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:12.070400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:12.070400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:12.070400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:12.071279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:12.071279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:12.071279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:12.071279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:12.071279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 319/649] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:12.072035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a86d60-3e41-4513-9933-0a1fbbdef83d None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:12.091572 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:12.132155 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cb5fa-de98-42a9-b28f-3974c2e0cdf9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:12.173158 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc19780-17e7-4d2b-9cfa-5731d9d14bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:12.174005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc19780-17e7-4d2b-9cfa-5731d9d14bae None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:12.174413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc19780-17e7-4d2b-9cfa-5731d9d14bae None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:12.174763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc19780-17e7-4d2b-9cfa-5731d9d14bae None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:12.175596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc19780-17e7-4d2b-9cfa-5731d9d14bae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:12.175973 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc19780-17e7-4d2b-9cfa-5731d9d14bae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:12.177700 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc19780-17e7-4d2b-9cfa-5731d9d14bae None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:12.188530 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a86d60-3e41-4513-9933-0a1fbbdef83d None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:12.190936 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 331/650] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:12.191780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc19780-17e7-4d2b-9cfa-5731d9d14bae None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:12.228060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fc35f-5157-4354-974e-8504285f357f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:12.228715 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fc35f-5157-4354-974e-8504285f357f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:12.229003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fc35f-5157-4354-974e-8504285f357f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:12.229344 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fc35f-5157-4354-974e-8504285f357f None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:12.230044 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fc35f-5157-4354-974e-8504285f357f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:12.230353 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fc35f-5157-4354-974e-8504285f357f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:12.231724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fc35f-5157-4354-974e-8504285f357f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:12.245159 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 320/651] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:12.245817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fc35f-5157-4354-974e-8504285f357f None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:12.308197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:12.313935 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc19780-17e7-4d2b-9cfa-5731d9d14bae None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:12.333063 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:12.353820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f5741-5dcf-40cc-a13e-438ba1bdc284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:12.354456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f5741-5dcf-40cc-a13e-438ba1bdc284 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:12.354745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f5741-5dcf-40cc-a13e-438ba1bdc284 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:12.355019 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f5741-5dcf-40cc-a13e-438ba1bdc284 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:12.366342 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f5741-5dcf-40cc-a13e-438ba1bdc284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:12.367809 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f5741-5dcf-40cc-a13e-438ba1bdc284 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:12.369550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fc35f-5157-4354-974e-8504285f357f None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:12.383467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-ad1f5741-5dcf-40cc-a13e-438ba1bdc284 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:12.383467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:12.383467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:12.383467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:12.383467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:12.383467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:12.383467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:12.383467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:12.383467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:12.383467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:12.383467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:12.383467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:12.383467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:12.383467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:12.383467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:12.384702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:12.384702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:12.384702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:12.384702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:12.384702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:12.384702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:12.384702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:12.384702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:12.384702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:12.384702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:12.384702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:12.384702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:12.384702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:12.384702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:12.384702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:12.384702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:12.384702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:12.385606 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:12.385606 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:12.385606 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:12.385606 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:12.385606 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 332/652] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:12.386157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f5741-5dcf-40cc-a13e-438ba1bdc284 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:12.413600 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d2338-3057-4808-8b03-f293d89a8b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:12.414170 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d2338-3057-4808-8b03-f293d89a8b62 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:12.414455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d2338-3057-4808-8b03-f293d89a8b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:12.414799 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d2338-3057-4808-8b03-f293d89a8b62 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:12.415426 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d2338-3057-4808-8b03-f293d89a8b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:12.415734 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d2338-3057-4808-8b03-f293d89a8b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:12.417235 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d2338-3057-4808-8b03-f293d89a8b62 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:12.436226 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 321/653] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:12.436226 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d2338-3057-4808-8b03-f293d89a8b62 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:12.500761 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f5741-5dcf-40cc-a13e-438ba1bdc284 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:12.534835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848b430-c84f-4769-b913-5768f8948df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:12.535552 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848b430-c84f-4769-b913-5768f8948df1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:12.535902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848b430-c84f-4769-b913-5768f8948df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:12.536176 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848b430-c84f-4769-b913-5768f8948df1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:12.540241 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d2338-3057-4808-8b03-f293d89a8b62 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:12.544144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848b430-c84f-4769-b913-5768f8948df1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:12.546323 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848b430-c84f-4769-b913-5768f8948df1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:12.557313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d848b430-c84f-4769-b913-5768f8948df1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 09:58:12.557313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:12.557313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:12.557313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:12.557313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:12.557313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:12.557313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:12.557313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:12.557313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:12.557313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:12.557313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:12.557313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:12.557313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:12.557313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:12.557313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:12.557313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:12.558333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:12.558333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:12.558333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:12.558333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:12.558333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:12.558333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:12.558333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:12.558333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:12.558333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:12.558333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:12.558333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:12.558333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:12.558333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:12.558333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:12.558333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:12.558333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:12.558333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:12.558333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:12.559467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:12.559467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:12.559467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:12.559467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:12.559467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:12.559467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:12.559467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:12.559467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:12.559467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 09:58:12.559467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:12.560603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 333/654] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:58:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:12.561591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848b430-c84f-4769-b913-5768f8948df1 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:12.570054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:12.574245 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:12.576768 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966da72-7251-4457-b8fc-47a4610fd11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:12.577569 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966da72-7251-4457-b8fc-47a4610fd11c None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:12.577906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966da72-7251-4457-b8fc-47a4610fd11c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:12.578239 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966da72-7251-4457-b8fc-47a4610fd11c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:12.585451 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966da72-7251-4457-b8fc-47a4610fd11c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:12.587094 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966da72-7251-4457-b8fc-47a4610fd11c None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:12.599272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-c966da72-7251-4457-b8fc-47a4610fd11c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:12.599272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:12.599272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:12.599272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:12.599272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:12.599272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:12.599272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:12.599272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:12.599272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:12.599272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:12.599272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:12.599272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:12.599272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:12.599272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:12.599272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:12.600322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:12.600322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:12.600322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:12.600322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:12.600322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:12.600322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:12.600322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:12.600322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:12.600322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:12.600322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:12.600322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:12.600322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:12.600322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:12.600322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:12.600322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:12.600322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:12.600322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:12.606143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:12.606143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:12.606143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:12.606143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:12.606143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:12.606143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:12.606143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:12.606143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:12.606143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 322/655] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:12.606143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966da72-7251-4457-b8fc-47a4610fd11c None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:12.667152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848b430-c84f-4769-b913-5768f8948df1 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:12.700563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966da72-7251-4457-b8fc-47a4610fd11c None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:12.701469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b02b9a-eba5-41a6-b0a5-1b4966fc34c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:12.702229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b02b9a-eba5-41a6-b0a5-1b4966fc34c3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:12.702515 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b02b9a-eba5-41a6-b0a5-1b4966fc34c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:12.702799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b02b9a-eba5-41a6-b0a5-1b4966fc34c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:12.703490 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b02b9a-eba5-41a6-b0a5-1b4966fc34c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:12.703796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b02b9a-eba5-41a6-b0a5-1b4966fc34c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:12.705194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b02b9a-eba5-41a6-b0a5-1b4966fc34c3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:12.716724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 334/656] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:12.718259 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad15793-e3cd-46b6-a686-c2cc4ee3a5df None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:12.718544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad15793-e3cd-46b6-a686-c2cc4ee3a5df None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:12.718816 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad15793-e3cd-46b6-a686-c2cc4ee3a5df None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:12.720008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 335/657] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:12.720714 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad15793-e3cd-46b6-a686-c2cc4ee3a5df None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:12.738506 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d38d0b-30cc-4c7d-bbf1-05537cf212a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:12.739144 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d38d0b-30cc-4c7d-bbf1-05537cf212a7 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:12.739430 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d38d0b-30cc-4c7d-bbf1-05537cf212a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:12.739709 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d38d0b-30cc-4c7d-bbf1-05537cf212a7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:12.747214 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d38d0b-30cc-4c7d-bbf1-05537cf212a7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:12.748752 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d38d0b-30cc-4c7d-bbf1-05537cf212a7 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:12.760264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-54d38d0b-30cc-4c7d-bbf1-05537cf212a7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 09:58:12.760264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:12.760264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:12.760264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:12.760264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:12.760264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:12.760264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:12.760264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:12.760264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:12.760264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:12.760264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:12.760264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:12.760264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:12.760264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:12.760264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:12.760264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:12.761266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:12.761266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:12.761266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:12.761266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:12.761266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:12.761266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:12.761266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:12.761266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:12.761266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:12.761266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:12.761266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:12.761266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:12.761266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:12.761266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:12.761266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:12.761266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:12.761266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:12.761266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:12.762201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:12.762201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:12.762201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:12.762201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:12.762201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:12.762201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:12.762201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:12.762201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:12.762201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 09:58:12.762201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:12.762201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 323/658] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:58:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:12.762201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d38d0b-30cc-4c7d-bbf1-05537cf212a7 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:12.798342 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:12.815880 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:12.829067 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad15793-e3cd-46b6-a686-c2cc4ee3a5df None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:12.863403 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b1af0-00e4-41e3-97d8-d413423da9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:12.864041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b1af0-00e4-41e3-97d8-d413423da9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:12.864300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d38d0b-30cc-4c7d-bbf1-05537cf212a7 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:12.864405 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b1af0-00e4-41e3-97d8-d413423da9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:12.864647 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b1af0-00e4-41e3-97d8-d413423da9a8 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:12.865447 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b1af0-00e4-41e3-97d8-d413423da9a8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:12.865760 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b1af0-00e4-41e3-97d8-d413423da9a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:12.867187 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b1af0-00e4-41e3-97d8-d413423da9a8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:12.884555 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 336/659] 10.222.0.85 () {56 vars in 1139 bytes} [Tue Aug 2 09:58:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:12.885471 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b1af0-00e4-41e3-97d8-d413423da9a8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:12.902312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd6308a-8809-4cf4-a40f-bc73a77a93ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:12.902932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6308a-8809-4cf4-a40f-bc73a77a93ad None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:12.903224 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6308a-8809-4cf4-a40f-bc73a77a93ad None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:12.903502 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd6308a-8809-4cf4-a40f-bc73a77a93ad None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:12.904255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6308a-8809-4cf4-a40f-bc73a77a93ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:12.904738 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6308a-8809-4cf4-a40f-bc73a77a93ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:12.906161 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd6308a-8809-4cf4-a40f-bc73a77a93ad None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:12.918059 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 324/660] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:12.919388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b6043-6f75-4e27-922c-0aeb8c69e245 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:12.919710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b6043-6f75-4e27-922c-0aeb8c69e245 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:12.919966 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b6043-6f75-4e27-922c-0aeb8c69e245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:12.938126 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-d79b6043-6f75-4e27-922c-0aeb8c69e245 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:12.939315 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-d79b6043-6f75-4e27-922c-0aeb8c69e245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:12.985813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b1af0-00e4-41e3-97d8-d413423da9a8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:13.004900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 325/661] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:58:13.005726 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b6043-6f75-4e27-922c-0aeb8c69e245 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:13.012430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:13.022186 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb7887-cc63-4047-9dd0-639b7d138180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:13.022857 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb7887-cc63-4047-9dd0-639b7d138180 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:13.023146 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb7887-cc63-4047-9dd0-639b7d138180 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:13.023429 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb7887-cc63-4047-9dd0-639b7d138180 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:13.031096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb7887-cc63-4047-9dd0-639b7d138180 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:13.032563 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb7887-cc63-4047-9dd0-639b7d138180 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:13.044089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-fefb7887-cc63-4047-9dd0-639b7d138180 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:13.044089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:13.044089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:13.044089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:13.044089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:13.044089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:13.044089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:13.044089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:13.044089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:13.044089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:13.044089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:13.044089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:13.044089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:13.044089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:13.044089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:13.045785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:13.045785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:13.045785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:13.045785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:13.045785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:13.045785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:13.045785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:13.045785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:13.045785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:13.045785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:13.045785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:13.045785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:13.045785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:13.045785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:13.045785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:13.045785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:13.045785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:13.046974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:13.046974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:13.046974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:13.046974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:13.046974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:13.046974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:13.046974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:13.046974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:13.048598 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 337/662] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:13.049502 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb7887-cc63-4047-9dd0-639b7d138180 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:13.057358 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:13.113589 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b6043-6f75-4e27-922c-0aeb8c69e245 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:13.147632 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37ef07-df63-40d1-82a1-df4f713600cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:13.148276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37ef07-df63-40d1-82a1-df4f713600cd None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:13.148591 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37ef07-df63-40d1-82a1-df4f713600cd None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:13.148853 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb7887-cc63-4047-9dd0-639b7d138180 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:13.148969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37ef07-df63-40d1-82a1-df4f713600cd None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:13.149653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37ef07-df63-40d1-82a1-df4f713600cd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:13.149964 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37ef07-df63-40d1-82a1-df4f713600cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:13.151396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc37ef07-df63-40d1-82a1-df4f713600cd None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:13.169786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 326/663] 10.222.0.85 () {56 vars in 1137 bytes} [Tue Aug 2 09:58:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:13.171190 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37ef07-df63-40d1-82a1-df4f713600cd None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:13.184157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43fe11-5c6d-4666-b9c1-9c0d1a31d77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:13.185012 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43fe11-5c6d-4666-b9c1-9c0d1a31d77d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:13.185298 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43fe11-5c6d-4666-b9c1-9c0d1a31d77d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:13.185578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43fe11-5c6d-4666-b9c1-9c0d1a31d77d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:13.242737 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:13.255820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43fe11-5c6d-4666-b9c1-9c0d1a31d77d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:13.257427 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43fe11-5c6d-4666-b9c1-9c0d1a31d77d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:13.269828 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:13.272890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37ef07-df63-40d1-82a1-df4f713600cd None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:13.308623 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e750fc-3446-4f8c-98e5-a10c14e883c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:13.309232 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e750fc-3446-4f8c-98e5-a10c14e883c5 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:13.309510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e750fc-3446-4f8c-98e5-a10c14e883c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:13.309782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e750fc-3446-4f8c-98e5-a10c14e883c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:13.310559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e750fc-3446-4f8c-98e5-a10c14e883c5 None admin] RBAC: Adding query filter params (role.id=e30f587367384737a72bbcc2e35d62ad, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=0af63c36df2c4ceaa2df4d3ac59542bc) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:13.311392 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e750fc-3446-4f8c-98e5-a10c14e883c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:13.312843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e750fc-3446-4f8c-98e5-a10c14e883c5 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:13.320384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 327/664] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:58:13 2022] GET /identity/v3/role_assignments?user.id=0af63c36df2c4ceaa2df4d3ac59542bc&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=e30f587367384737a72bbcc2e35d62ad => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:13.321206 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e750fc-3446-4f8c-98e5-a10c14e883c5 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:13.367618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 338/665] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:58:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:58:13.368674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43fe11-5c6d-4666-b9c1-9c0d1a31d77d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:13.460524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e750fc-3446-4f8c-98e5-a10c14e883c5 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:13.469989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:13.488835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43fe11-5c6d-4666-b9c1-9c0d1a31d77d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:13.509200 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6c5c9-f81f-4e94-aee5-c4a31f6c063c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:13.510690 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6c5c9-f81f-4e94-aee5-c4a31f6c063c None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:13.511336 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6c5c9-f81f-4e94-aee5-c4a31f6c063c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:13.511336 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb6c5c9-f81f-4e94-aee5-c4a31f6c063c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:13.527392 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb6c5c9-f81f-4e94-aee5-c4a31f6c063c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:13.528811 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a93da-9100-4273-92f8-48ca9b5676df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:13.530045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a93da-9100-4273-92f8-48ca9b5676df None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:13.530673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a93da-9100-4273-92f8-48ca9b5676df None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:13.530673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a93da-9100-4273-92f8-48ca9b5676df None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:13.532709 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a93da-9100-4273-92f8-48ca9b5676df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:13.532709 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a93da-9100-4273-92f8-48ca9b5676df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:13.533263 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a93da-9100-4273-92f8-48ca9b5676df None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:13.533457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-beb6c5c9-f81f-4e94-aee5-c4a31f6c063c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:13.533457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:13.533457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:13.533457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:13.533457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:13.533457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:13.533457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:13.533457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:13.533457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:13.533457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:13.533457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:13.533457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:13.533457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:13.533457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:13.533457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:13.533457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:13.534332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:13.534332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:13.534332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:13.534332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:13.534332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:13.534332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:13.534332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:13.534332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:13.534332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:13.534332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:13.534332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:13.534332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:13.534332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:13.534332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:13.534332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:13.534332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:13.536848 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:13.536848 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:13.536848 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:13.536848 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:13.536848 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:13.536848 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:13.536848 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:13.536848 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:13.536848 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:13.536848 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:13.536848 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:13.536848 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:13.536848 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 328/666] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:58:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:13.536848 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6c5c9-f81f-4e94-aee5-c4a31f6c063c None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:13.545625 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 339/667] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:13.547469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a93da-9100-4273-92f8-48ca9b5676df None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:13.571274 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:13.650275 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb6c5c9-f81f-4e94-aee5-c4a31f6c063c None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:13.656870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a93da-9100-4273-92f8-48ca9b5676df None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:13.684651 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff48ed1-67b7-44c5-8183-45ed957f8d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:13.685270 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff48ed1-67b7-44c5-8183-45ed957f8d9b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:13.685630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff48ed1-67b7-44c5-8183-45ed957f8d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:13.686413 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff48ed1-67b7-44c5-8183-45ed957f8d9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:13.694904 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e74a8-218d-4701-9946-7ee553d76354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:13.695889 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e74a8-218d-4701-9946-7ee553d76354 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:13.696394 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e74a8-218d-4701-9946-7ee553d76354 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:13.696924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e74a8-218d-4701-9946-7ee553d76354 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:13.709257 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e74a8-218d-4701-9946-7ee553d76354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:13.711221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e74a8-218d-4701-9946-7ee553d76354 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:13.720347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:13.727744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-9a4e74a8-218d-4701-9946-7ee553d76354 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:13.727744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:13.727744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:13.727744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:13.727744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:13.727744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:13.727744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:13.727744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:13.727744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:13.727744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:13.727744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:13.727744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:13.727744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:13.727744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:13.727744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:13.728846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:13.728846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:13.728846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:13.728846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:13.728846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:13.728846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:13.728846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:13.728846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:13.728846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:13.728846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:13.728846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:13.728846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:13.728846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:13.728846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:13.728846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:13.728846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:13.728846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:13.733452 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:13.733452 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:13.733452 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:13.733452 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:13.733452 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 340/668] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:13.733452 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e74a8-218d-4701-9946-7ee553d76354 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:13.763231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff48ed1-67b7-44c5-8183-45ed957f8d9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:13.764745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff48ed1-67b7-44c5-8183-45ed957f8d9b None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:13.790101 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:13.841051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e74a8-218d-4701-9946-7ee553d76354 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:13.879748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 329/669] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:58:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:58:13.879748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff48ed1-67b7-44c5-8183-45ed957f8d9b None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:13.883283 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593ad16-02a1-4a22-b5fb-6f521eaa2901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:13.884163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593ad16-02a1-4a22-b5fb-6f521eaa2901 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:13.884445 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593ad16-02a1-4a22-b5fb-6f521eaa2901 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:13.884751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4593ad16-02a1-4a22-b5fb-6f521eaa2901 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:13.885477 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593ad16-02a1-4a22-b5fb-6f521eaa2901 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:13.885784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593ad16-02a1-4a22-b5fb-6f521eaa2901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:13.887268 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4593ad16-02a1-4a22-b5fb-6f521eaa2901 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:13.900531 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 341/670] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 09:58:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:13.900531 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593ad16-02a1-4a22-b5fb-6f521eaa2901 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:13.961328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:13.991476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff48ed1-67b7-44c5-8183-45ed957f8d9b None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:14.003779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4593ad16-02a1-4a22-b5fb-6f521eaa2901 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:14.019940 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:14.032551 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f930c5-05ad-437f-9076-ecb4b212250f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:14.033174 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f930c5-05ad-437f-9076-ecb4b212250f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:14.033459 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f930c5-05ad-437f-9076-ecb4b212250f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:14.033740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f930c5-05ad-437f-9076-ecb4b212250f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:14.034532 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f930c5-05ad-437f-9076-ecb4b212250f None admin] RBAC: Adding query filter params (role.id=e30f587367384737a72bbcc2e35d62ad, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=310867deefd34a598cfef2f3e4245ace) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:14.034852 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f930c5-05ad-437f-9076-ecb4b212250f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:14.036321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f930c5-05ad-437f-9076-ecb4b212250f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:14.041955 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7602d3-f5f1-444b-9754-7649c2159d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:14.042521 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7602d3-f5f1-444b-9754-7649c2159d43 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:14.042799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7602d3-f5f1-444b-9754-7649c2159d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:14.043073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7602d3-f5f1-444b-9754-7649c2159d43 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:14.043856 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7602d3-f5f1-444b-9754-7649c2159d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:14.044170 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7602d3-f5f1-444b-9754-7649c2159d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:14.045645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7602d3-f5f1-444b-9754-7649c2159d43 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:14.048919 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 330/671] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:58:13 2022] GET /identity/v3/role_assignments?user.id=310867deefd34a598cfef2f3e4245ace&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=e30f587367384737a72bbcc2e35d62ad => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:14.050633 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f930c5-05ad-437f-9076-ecb4b212250f None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:14.069525 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 342/672] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:14.069726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7602d3-f5f1-444b-9754-7649c2159d43 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:14.190861 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f930c5-05ad-437f-9076-ecb4b212250f None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:14.203043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7602d3-f5f1-444b-9754-7649c2159d43 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:14.236064 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:14.250296 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00565f0-69f8-42cb-9b60-1a81a26e8127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:14.251211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00565f0-69f8-42cb-9b60-1a81a26e8127 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:14.251819 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00565f0-69f8-42cb-9b60-1a81a26e8127 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:14.252244 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00565f0-69f8-42cb-9b60-1a81a26e8127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:14.267252 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b2972-96fe-400b-b36e-5d90ec43f7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:14.267252 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b2972-96fe-400b-b36e-5d90ec43f7ae None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:14.267581 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b2972-96fe-400b-b36e-5d90ec43f7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:14.267783 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26b2972-96fe-400b-b36e-5d90ec43f7ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:14.270129 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00565f0-69f8-42cb-9b60-1a81a26e8127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:14.272679 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00565f0-69f8-42cb-9b60-1a81a26e8127 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:14.288234 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b2972-96fe-400b-b36e-5d90ec43f7ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:14.291740 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26b2972-96fe-400b-b36e-5d90ec43f7ae None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:14.295115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-f00565f0-69f8-42cb-9b60-1a81a26e8127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:14.295115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:14.295115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:14.295115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:14.295115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:14.295115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:14.295115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:14.295115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:14.295115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:14.295115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:14.295115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:14.295115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:14.295115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:14.295115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:14.295115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:14.295959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:14.295959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:14.295959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:14.295959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:14.295959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:14.295959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:14.295959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:14.295959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:14.295959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:14.295959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:14.295959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:14.295959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:14.295959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:14.295959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:14.295959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:14.295959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:14.295959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:14.296934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:14.296934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:14.296934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:14.296934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:14.296934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 331/673] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:14.298374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00565f0-69f8-42cb-9b60-1a81a26e8127 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:14.317566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-c26b2972-96fe-400b-b36e-5d90ec43f7ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:14.317566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:14.317566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:14.317566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:14.317566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:14.317566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:14.317566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:14.317566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:14.317566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:14.317566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:14.317566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:14.317566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:14.317566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:14.317566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:14.317566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:14.318472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:14.318472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:14.318472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:14.318472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:14.318472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:14.318472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:14.318472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:14.318472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:14.318472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:14.318472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:14.318472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:14.318472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:14.318472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:14.318472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:14.318472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:14.318472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:14.318472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:14.319346 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:14.319346 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:14.319346 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:14.319346 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:14.319346 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 343/674] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:14.319622 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b2972-96fe-400b-b36e-5d90ec43f7ae None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:14.372082 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:14.441282 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00565f0-69f8-42cb-9b60-1a81a26e8127 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:14.458338 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26b2972-96fe-400b-b36e-5d90ec43f7ae None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:14.480187 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af556c42-05fb-47aa-a5a9-44049822fa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:14.481681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af556c42-05fb-47aa-a5a9-44049822fa7c None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:14.482168 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af556c42-05fb-47aa-a5a9-44049822fa7c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:14.482791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af556c42-05fb-47aa-a5a9-44049822fa7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:14.490417 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af556c42-05fb-47aa-a5a9-44049822fa7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:14.492175 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af556c42-05fb-47aa-a5a9-44049822fa7c None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:14.501403 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bdebe-8a3d-437e-a585-8a5cf8106850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:14.502032 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bdebe-8a3d-437e-a585-8a5cf8106850 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:14.502317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bdebe-8a3d-437e-a585-8a5cf8106850 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:14.502596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bdebe-8a3d-437e-a585-8a5cf8106850 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:14.503300 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bdebe-8a3d-437e-a585-8a5cf8106850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:14.503608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bdebe-8a3d-437e-a585-8a5cf8106850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:14.506190 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bdebe-8a3d-437e-a585-8a5cf8106850 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:14.507004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-af556c42-05fb-47aa-a5a9-44049822fa7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:14.507004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:14.507004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:14.507004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:14.507004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:14.507004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:14.507004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:14.507004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:14.507004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:14.507004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:14.507004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:14.507004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:14.507004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:14.507004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:14.507004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:14.507843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:14.507843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:14.507843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:14.507843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:14.507843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:14.507843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:14.507843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:14.507843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:14.507843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:14.507843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:14.507843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:14.507843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:14.507843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:14.507843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:14.507843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:14.507843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:14.507843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:14.509343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:14.509343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:14.509343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:14.509343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:14.509343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:14.509343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:14.509343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:14.509343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:14.511318 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 332/675] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:14.512294 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af556c42-05fb-47aa-a5a9-44049822fa7c None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:14.524044 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 344/676] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:14.530881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bdebe-8a3d-437e-a585-8a5cf8106850 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:14.583348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:14.637936 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:14.642143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af556c42-05fb-47aa-a5a9-44049822fa7c None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:14.689286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bdebe-8a3d-437e-a585-8a5cf8106850 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:14.700103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8669c37-0d46-4b89-9bd2-a87ea1cd606b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:14.703385 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8669c37-0d46-4b89-9bd2-a87ea1cd606b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:14.704577 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8669c37-0d46-4b89-9bd2-a87ea1cd606b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:14.705206 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8669c37-0d46-4b89-9bd2-a87ea1cd606b None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:14.706357 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8669c37-0d46-4b89-9bd2-a87ea1cd606b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:14.707688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8669c37-0d46-4b89-9bd2-a87ea1cd606b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:14.711075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8669c37-0d46-4b89-9bd2-a87ea1cd606b None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:14.735910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 333/677] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:14.737122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8669c37-0d46-4b89-9bd2-a87ea1cd606b None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:14.773248 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436655f3-496d-4e75-a657-b983395a60ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:14.773884 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436655f3-496d-4e75-a657-b983395a60ab None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:14.774214 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436655f3-496d-4e75-a657-b983395a60ab None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:14.774494 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436655f3-496d-4e75-a657-b983395a60ab None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:14.775703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436655f3-496d-4e75-a657-b983395a60ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:14.776018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436655f3-496d-4e75-a657-b983395a60ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:14.783256 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436655f3-496d-4e75-a657-b983395a60ab None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:14.807809 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 345/678] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:14.808495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436655f3-496d-4e75-a657-b983395a60ab None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:14.874827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8669c37-0d46-4b89-9bd2-a87ea1cd606b None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:14.921218 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd6e87-fb2d-4339-a33e-543f883ef3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:14.922273 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd6e87-fb2d-4339-a33e-543f883ef3ac None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:14.922782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd6e87-fb2d-4339-a33e-543f883ef3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:14.923497 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd6e87-fb2d-4339-a33e-543f883ef3ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:14.933041 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd6e87-fb2d-4339-a33e-543f883ef3ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:14.935527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cd6e87-fb2d-4339-a33e-543f883ef3ac None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:14.953789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-77cd6e87-fb2d-4339-a33e-543f883ef3ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:14.953789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:14.953789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:14.953789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:14.953789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:14.953789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:14.953789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:14.953789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:14.953789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:14.953789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:14.953789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:14.953789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:14.953789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:14.953789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:14.953789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:14.954733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:14.954733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:14.954733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:14.954733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:14.954733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:14.954733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:14.954733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:14.954733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:14.954733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:14.954733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:14.954733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:14.954733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:14.954733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:14.954733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:14.954733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:14.954733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:14.954733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:14.955612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:14.955612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:14.955612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:14.955612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:14.955612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:14.955612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:14.955612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:14.955612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:14.958328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:14.959122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 334/679] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:14.960045 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd6e87-fb2d-4339-a33e-543f883ef3ac None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:14.972580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436655f3-496d-4e75-a657-b983395a60ab None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:14.990145 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:15.019069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc9e3c-ce26-4385-a744-f53c1f7805d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:15.020074 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc9e3c-ce26-4385-a744-f53c1f7805d9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:15.020538 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc9e3c-ce26-4385-a744-f53c1f7805d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:15.020998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc9e3c-ce26-4385-a744-f53c1f7805d9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:15.029473 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc9e3c-ce26-4385-a744-f53c1f7805d9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:15.031227 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc9e3c-ce26-4385-a744-f53c1f7805d9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:15.043619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-fbcc9e3c-ce26-4385-a744-f53c1f7805d9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:58:15.043619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:15.043619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:15.043619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:15.043619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:15.043619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:15.043619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:15.043619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:15.043619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:15.043619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:15.043619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:15.043619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:15.043619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:15.043619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:15.043619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:15.043619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:15.045849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:15.045849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:15.045849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:15.045849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:15.045849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:15.045849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:15.045849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:15.045849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:15.045849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:15.045849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:15.045849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:15.045849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:15.045849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:15.045849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:15.045849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:15.045849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:15.045849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:15.045849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:15.047194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:15.047194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:15.047194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:15.047194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:15.047194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:15.047194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:15.047194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:15.047194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:15.047194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:58:15.047194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:15.049496 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 346/680] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:58:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:15.050466 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc9e3c-ce26-4385-a744-f53c1f7805d9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:15.087282 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd6e87-fb2d-4339-a33e-543f883ef3ac None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:15.123897 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cfc7f-1c6a-4360-b294-14e030fc417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:15.124539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cfc7f-1c6a-4360-b294-14e030fc417d None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:15.124986 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cfc7f-1c6a-4360-b294-14e030fc417d None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:15.125312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6cfc7f-1c6a-4360-b294-14e030fc417d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:15.126208 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6cfc7f-1c6a-4360-b294-14e030fc417d None admin] RBAC: Adding query filter params (role.id=e30f587367384737a72bbcc2e35d62ad, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=828eb58cdce44ca8827f1ce2be7c19d7) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:15.126625 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6cfc7f-1c6a-4360-b294-14e030fc417d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:15.128170 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6cfc7f-1c6a-4360-b294-14e030fc417d None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:15.135242 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 335/681] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:58:14 2022] GET /identity/v3/role_assignments?user.id=828eb58cdce44ca8827f1ce2be7c19d7&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=e30f587367384737a72bbcc2e35d62ad => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:15.136255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cfc7f-1c6a-4360-b294-14e030fc417d None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:15.164408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc9e3c-ce26-4385-a744-f53c1f7805d9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:15.205357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ff3e9-7336-4318-acbc-0969f06186f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:15.206642 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ff3e9-7336-4318-acbc-0969f06186f7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:15.207102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ff3e9-7336-4318-acbc-0969f06186f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:15.207580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ff3e9-7336-4318-acbc-0969f06186f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:15.208549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ff3e9-7336-4318-acbc-0969f06186f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:15.209014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ff3e9-7336-4318-acbc-0969f06186f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:15.210655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ff3e9-7336-4318-acbc-0969f06186f7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:15.225864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 347/682] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:15.233729 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ff3e9-7336-4318-acbc-0969f06186f7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:15.240491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:15.266665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6cfc7f-1c6a-4360-b294-14e030fc417d None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:15.270529 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:15.337918 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe7d97-0e12-43cf-9cff-94d0874d07b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:15.338704 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe7d97-0e12-43cf-9cff-94d0874d07b5 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:15.339110 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe7d97-0e12-43cf-9cff-94d0874d07b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:15.339579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe7d97-0e12-43cf-9cff-94d0874d07b5 None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:15.340533 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe7d97-0e12-43cf-9cff-94d0874d07b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:15.340953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe7d97-0e12-43cf-9cff-94d0874d07b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:15.343237 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe7d97-0e12-43cf-9cff-94d0874d07b5 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:15.364836 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 336/683] 10.222.0.85 () {56 vars in 1135 bytes} [Tue Aug 2 09:58:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:15.371214 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe7d97-0e12-43cf-9cff-94d0874d07b5 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:15.431550 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ff3e9-7336-4318-acbc-0969f06186f7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:15.480708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8bfd3-fe30-4b82-a9cf-6b0c0efc1b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:15.481848 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8bfd3-fe30-4b82-a9cf-6b0c0efc1b1e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:15.482794 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8bfd3-fe30-4b82-a9cf-6b0c0efc1b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:15.483504 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8bfd3-fe30-4b82-a9cf-6b0c0efc1b1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:15.484721 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8bfd3-fe30-4b82-a9cf-6b0c0efc1b1e None admin] RBAC: Adding query filter params (role.id=e30f587367384737a72bbcc2e35d62ad, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=8e4e240f7958425a99a2cc1110e40c13) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:15.485600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8bfd3-fe30-4b82-a9cf-6b0c0efc1b1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:15.487486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8bfd3-fe30-4b82-a9cf-6b0c0efc1b1e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:15.492395 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe7d97-0e12-43cf-9cff-94d0874d07b5 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:15.496945 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 348/684] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:58:15 2022] GET /identity/v3/role_assignments?user.id=8e4e240f7958425a99a2cc1110e40c13&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=e30f587367384737a72bbcc2e35d62ad => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:15.533079 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570639f-84b4-4ca4-8715-2f7be15a6b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:15.533723 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570639f-84b4-4ca4-8715-2f7be15a6b43 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:15.534009 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570639f-84b4-4ca4-8715-2f7be15a6b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:15.534287 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570639f-84b4-4ca4-8715-2f7be15a6b43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:15.550024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:15.616350 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570639f-84b4-4ca4-8715-2f7be15a6b43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:15.617955 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570639f-84b4-4ca4-8715-2f7be15a6b43 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:15.634148 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a928d3-fd33-44d2-9a5d-4ad961dca448 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:15.634537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a928d3-fd33-44d2-9a5d-4ad961dca448 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:15.634891 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a928d3-fd33-44d2-9a5d-4ad961dca448 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:15.637014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 349/685] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:15.642786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909bb0f-eb9d-4cb2-bf67-c8f55caef7cd None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:15.643210 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909bb0f-eb9d-4cb2-bf67-c8f55caef7cd None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:15.643561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909bb0f-eb9d-4cb2-bf67-c8f55caef7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:15.670343 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3909bb0f-eb9d-4cb2-bf67-c8f55caef7cd None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:15.672042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3909bb0f-eb9d-4cb2-bf67-c8f55caef7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:15.749515 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 337/686] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:58:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 09:58:15.756617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570639f-84b4-4ca4-8715-2f7be15a6b43 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:15.782537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 350/687] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:58:15.804282 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:15.810363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909bb0f-eb9d-4cb2-bf67-c8f55caef7cd None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:15.822494 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:15.871593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570639f-84b4-4ca4-8715-2f7be15a6b43 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:15.910827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb0a15-4052-4546-b5e2-6188479187d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:15.911475 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb0a15-4052-4546-b5e2-6188479187d5 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:15.911759 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb0a15-4052-4546-b5e2-6188479187d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:15.912035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb0a15-4052-4546-b5e2-6188479187d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:15.923820 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb0a15-4052-4546-b5e2-6188479187d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:15.925381 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb0a15-4052-4546-b5e2-6188479187d5 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:15.925640 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909bb0f-eb9d-4cb2-bf67-c8f55caef7cd None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:15.941804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-f1cb0a15-4052-4546-b5e2-6188479187d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:15.941804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:15.941804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:15.941804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:15.941804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:15.941804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:15.941804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:15.941804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:15.941804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:15.941804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:15.941804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:15.941804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:15.941804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:15.941804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:15.941804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:15.942776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:15.942776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:15.942776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:15.942776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:15.942776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:15.942776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:15.942776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:15.942776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:15.942776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:15.942776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:15.942776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:15.942776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:15.942776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:15.942776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:15.942776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:15.942776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:15.942776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:15.943654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:15.943654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:15.943654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:15.943654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:15.943654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 338/688] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:15.948824 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb0a15-4052-4546-b5e2-6188479187d5 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:15.967132 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83a025-a246-4633-a88d-66323ba08739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:15.968152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83a025-a246-4633-a88d-66323ba08739 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:15.968696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83a025-a246-4633-a88d-66323ba08739 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:15.969201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83a025-a246-4633-a88d-66323ba08739 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:15.981943 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83a025-a246-4633-a88d-66323ba08739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:15.984495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83a025-a246-4633-a88d-66323ba08739 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:16.004048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-7e83a025-a246-4633-a88d-66323ba08739 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:16.004048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:16.004048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:16.004048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:16.004048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:16.004048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:16.004048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:16.004048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:16.004048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:16.004048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:16.004048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:16.004048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:16.004048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:16.004048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:16.004048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:16.005042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:16.005042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:16.005042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:16.005042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:16.005042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:16.005042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:16.005042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:16.005042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:16.005042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:16.005042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:16.005042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:16.005042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:16.005042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:16.005042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:16.005042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:16.005042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:16.005042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:16.005937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:16.005937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:16.005937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:16.005937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:16.008135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 351/689] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:16.014375 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83a025-a246-4633-a88d-66323ba08739 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:16.060980 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:16.066673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb0a15-4052-4546-b5e2-6188479187d5 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:16.097519 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:16.133256 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c40b5-f99e-4150-bb9d-6ce5e83fea95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:16.134144 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c40b5-f99e-4150-bb9d-6ce5e83fea95 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:16.134423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c40b5-f99e-4150-bb9d-6ce5e83fea95 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:16.134695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c40b5-f99e-4150-bb9d-6ce5e83fea95 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:16.135395 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c40b5-f99e-4150-bb9d-6ce5e83fea95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:16.135720 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c40b5-f99e-4150-bb9d-6ce5e83fea95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:16.138826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c40b5-f99e-4150-bb9d-6ce5e83fea95 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:16.159119 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 339/690] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:16.164718 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c40b5-f99e-4150-bb9d-6ce5e83fea95 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:16.177687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83a025-a246-4633-a88d-66323ba08739 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:16.242733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfc468-0e05-4ee4-80e1-f67cafb30a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:16.243359 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfc468-0e05-4ee4-80e1-f67cafb30a79 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:16.243639 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfc468-0e05-4ee4-80e1-f67cafb30a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:16.243912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfc468-0e05-4ee4-80e1-f67cafb30a79 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:16.244643 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfc468-0e05-4ee4-80e1-f67cafb30a79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:16.244950 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfc468-0e05-4ee4-80e1-f67cafb30a79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:16.246327 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfc468-0e05-4ee4-80e1-f67cafb30a79 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:16.272379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 352/691] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:16.278361 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfc468-0e05-4ee4-80e1-f67cafb30a79 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:16.354236 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c40b5-f99e-4150-bb9d-6ce5e83fea95 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:16.411518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac4863-29cd-4447-8fa7-0f4d7f0db970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:16.412202 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac4863-29cd-4447-8fa7-0f4d7f0db970 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:16.412568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac4863-29cd-4447-8fa7-0f4d7f0db970 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:16.412896 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac4863-29cd-4447-8fa7-0f4d7f0db970 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:16.422622 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac4863-29cd-4447-8fa7-0f4d7f0db970 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:16.424083 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac4863-29cd-4447-8fa7-0f4d7f0db970 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:16.444745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-4cac4863-29cd-4447-8fa7-0f4d7f0db970 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:16.444745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:16.444745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:16.444745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:16.444745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:16.444745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:16.444745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:16.444745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:16.444745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:16.444745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:16.444745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:16.444745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:16.444745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:16.444745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:16.444745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:16.446538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:16.446538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:16.446538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:16.446538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:16.446538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:16.446538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:16.446538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:16.446538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:16.446538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:16.446538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:16.446538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:16.446538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:16.446538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:16.446538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:16.446538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:16.446538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:16.446538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:16.448086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:16.448086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:16.448086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:16.448086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:16.448086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:16.448086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:16.448086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:16.448086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:16.450853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 340/692] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:16.453362 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c73850-42d7-4d18-b061-18de913bb2bf None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:16.453657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c73850-42d7-4d18-b061-18de913bb2bf None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:16.453953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c73850-42d7-4d18-b061-18de913bb2bf None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:16.460538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 341/693] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:16.461626 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c73850-42d7-4d18-b061-18de913bb2bf None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:16.465062 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfc468-0e05-4ee4-80e1-f67cafb30a79 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:16.486586 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:16.503427 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:16.523213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c33891-c2ee-4857-92fe-1f0534b05e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:16.523712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c33891-c2ee-4857-92fe-1f0534b05e24 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:16.523999 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c33891-c2ee-4857-92fe-1f0534b05e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:16.524275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c33891-c2ee-4857-92fe-1f0534b05e24 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:16.525012 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c33891-c2ee-4857-92fe-1f0534b05e24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:16.526669 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c33891-c2ee-4857-92fe-1f0534b05e24 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:16.557289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 353/694] 10.222.0.85 () {60 vars in 1132 bytes} [Tue Aug 2 09:58:16 2022] POST /identity/v3/users => generated 254 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:58:16.558368 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f423b-e5e3-42de-8f81-9346ccce226c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:16.558712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f423b-e5e3-42de-8f81-9346ccce226c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:16.558982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f423b-e5e3-42de-8f81-9346ccce226c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:16.601296 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-080f423b-e5e3-42de-8f81-9346ccce226c None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:16.603130 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-080f423b-e5e3-42de-8f81-9346ccce226c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:16.619391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c73850-42d7-4d18-b061-18de913bb2bf None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:16.721380 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b551c2-f0c8-42d7-95d7-2be3e8791c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:16.722496 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b551c2-f0c8-42d7-95d7-2be3e8791c9c None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:16.723988 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b551c2-f0c8-42d7-95d7-2be3e8791c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:16.724823 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b551c2-f0c8-42d7-95d7-2be3e8791c9c None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:16.726775 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b551c2-f0c8-42d7-95d7-2be3e8791c9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:16.727438 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b551c2-f0c8-42d7-95d7-2be3e8791c9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:16.730857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b551c2-f0c8-42d7-95d7-2be3e8791c9c None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:16.767210 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 342/695] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:16.775536 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b551c2-f0c8-42d7-95d7-2be3e8791c9c None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:16.800776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 354/696] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:58:16.845569 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f423b-e5e3-42de-8f81-9346ccce226c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:16.892844 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:16.929094 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b551c2-f0c8-42d7-95d7-2be3e8791c9c None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:16.984237 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c40e8-a7ea-432d-9ae5-6cff9427dd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:16.985514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c40e8-a7ea-432d-9ae5-6cff9427dd92 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:16.985966 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c40e8-a7ea-432d-9ae5-6cff9427dd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:16.986221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c40e8-a7ea-432d-9ae5-6cff9427dd92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:16.987079 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c40e8-a7ea-432d-9ae5-6cff9427dd92 None admin] RBAC: Adding query filter params (role.id=e30f587367384737a72bbcc2e35d62ad, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=e9cfed2469a7419f8fcbe09d25cb896e) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:16.987880 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c40e8-a7ea-432d-9ae5-6cff9427dd92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:16.989696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c40e8-a7ea-432d-9ae5-6cff9427dd92 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:16.995980 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f423b-e5e3-42de-8f81-9346ccce226c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:16.997136 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 343/697] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:58:16 2022] GET /identity/v3/role_assignments?user.id=e9cfed2469a7419f8fcbe09d25cb896e&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=e30f587367384737a72bbcc2e35d62ad => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:17.010796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:17.051491 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5892d-ff0e-4cc6-b1b7-a1de102f99b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:17.052084 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5892d-ff0e-4cc6-b1b7-a1de102f99b4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:17.052366 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5892d-ff0e-4cc6-b1b7-a1de102f99b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:17.052678 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5892d-ff0e-4cc6-b1b7-a1de102f99b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:17.066531 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5892d-ff0e-4cc6-b1b7-a1de102f99b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:17.071967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-6eb5892d-ff0e-4cc6-b1b7-a1de102f99b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:58:17.071967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:17.071967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:17.071967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:17.071967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:17.071967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:17.071967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:17.071967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:17.071967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:17.071967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:17.071967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:17.071967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:17.071967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:17.071967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:17.071967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:17.071967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:17.072967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:17.072967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:17.072967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:17.072967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:17.072967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:17.072967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:17.072967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:17.072967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:17.072967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:17.072967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:17.072967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:17.072967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:17.072967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:17.072967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:17.072967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:17.072967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:17.073792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:17.073792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:17.073792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:17.073792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:17.073792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:17.073792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:17.073792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:17.073792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:17.073792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:17.073792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:17.073792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:58:17.073792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:17.074422 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 355/698] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:58:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:17.080383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c40e8-a7ea-432d-9ae5-6cff9427dd92 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:17.215810 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c40e8-a7ea-432d-9ae5-6cff9427dd92 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:17.256620 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ca17b-8ab4-45ea-8f36-c8630e09ee69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:17.257196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ca17b-8ab4-45ea-8f36-c8630e09ee69 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:17.257475 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ca17b-8ab4-45ea-8f36-c8630e09ee69 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:17.257746 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ca17b-8ab4-45ea-8f36-c8630e09ee69 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:17.258713 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ca17b-8ab4-45ea-8f36-c8630e09ee69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:17.259015 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ca17b-8ab4-45ea-8f36-c8630e09ee69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:17.260388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ca17b-8ab4-45ea-8f36-c8630e09ee69 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:17.266197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:17.270747 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 344/699] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:58:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:17.276560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5892d-ff0e-4cc6-b1b7-a1de102f99b4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:17.393486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5892d-ff0e-4cc6-b1b7-a1de102f99b4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:17.428657 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be1ae7-3dbb-4adf-8bd7-50ba2ec79ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:17.429294 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be1ae7-3dbb-4adf-8bd7-50ba2ec79ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:17.429571 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be1ae7-3dbb-4adf-8bd7-50ba2ec79ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:17.429841 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be1ae7-3dbb-4adf-8bd7-50ba2ec79ef1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:17.440670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be1ae7-3dbb-4adf-8bd7-50ba2ec79ef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:17.442329 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be1ae7-3dbb-4adf-8bd7-50ba2ec79ef1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:17.458804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-53be1ae7-3dbb-4adf-8bd7-50ba2ec79ef1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:17.458804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:17.458804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:17.458804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:17.458804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:17.458804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:17.458804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:17.458804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:17.458804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:17.458804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:17.458804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:17.458804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:17.458804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:17.458804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:17.458804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:17.459746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:17.459746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:17.459746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:17.459746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:17.459746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:17.459746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:17.459746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:17.459746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:17.459746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:17.459746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:17.459746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:17.459746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:17.459746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:17.459746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:17.459746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:17.459746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:17.459746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:17.460661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:17.460661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:17.460661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:17.460661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:17.460661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 356/700] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:17.465931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ca17b-8ab4-45ea-8f36-c8630e09ee69 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:17.586314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ca17b-8ab4-45ea-8f36-c8630e09ee69 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:17.622060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f7e2b-0eb1-42d2-8b49-8cf485c7adcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:17.623378 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f7e2b-0eb1-42d2-8b49-8cf485c7adcc None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:17.623522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f7e2b-0eb1-42d2-8b49-8cf485c7adcc None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:17.623768 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f7e2b-0eb1-42d2-8b49-8cf485c7adcc None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:17.624588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f7e2b-0eb1-42d2-8b49-8cf485c7adcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:17.624896 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f7e2b-0eb1-42d2-8b49-8cf485c7adcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:17.626258 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f7e2b-0eb1-42d2-8b49-8cf485c7adcc None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:17.639228 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 345/701] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:17.645045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be1ae7-3dbb-4adf-8bd7-50ba2ec79ef1 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:17.665864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:17.759227 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be1ae7-3dbb-4adf-8bd7-50ba2ec79ef1 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:17.805363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd108b8-0eec-44cb-9229-00a46006c56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:17.806048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd108b8-0eec-44cb-9229-00a46006c56b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:17.806329 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd108b8-0eec-44cb-9229-00a46006c56b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:17.806600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd108b8-0eec-44cb-9229-00a46006c56b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:17.935119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd108b8-0eec-44cb-9229-00a46006c56b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:17.936702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd108b8-0eec-44cb-9229-00a46006c56b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:17.949014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-fdd108b8-0eec-44cb-9229-00a46006c56b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:58:17.949014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:17.949014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:17.949014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:17.949014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:17.949014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:17.949014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:17.949014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:17.949014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:17.949014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:17.949014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:17.949014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:17.949014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:17.949014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:17.949014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:17.949014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:17.952033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:17.952033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:17.952033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:17.952033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:17.952033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:17.952033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:17.952033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:17.952033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:17.952033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:17.952033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:17.952033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:17.952033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:17.952033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:17.952033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:17.952033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:17.952033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:17.952033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:17.952033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:17.954348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:17.954348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:17.954348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:17.954348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:17.954348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:17.954348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:17.954348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:17.954348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:17.954348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:58:17.954348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:17.954348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 357/702] 10.222.0.85 () {56 vars in 1093 bytes} [Tue Aug 2 09:58:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:17.960381 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f7e2b-0eb1-42d2-8b49-8cf485c7adcc None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:18.038779 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:18.086805 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f7e2b-0eb1-42d2-8b49-8cf485c7adcc None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:18.105018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d39bf2-bdb9-46e4-ae64-0eb65fc680f6 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:18.105633 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d39bf2-bdb9-46e4-ae64-0eb65fc680f6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:18.106114 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d39bf2-bdb9-46e4-ae64-0eb65fc680f6 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:18.112300 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 358/703] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:18.113682 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a28b7c-d325-4960-aac4-d3e3c7bc0144 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:18.114212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a28b7c-d325-4960-aac4-d3e3c7bc0144 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:18.114683 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a28b7c-d325-4960-aac4-d3e3c7bc0144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:18.133960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-64a28b7c-d325-4960-aac4-d3e3c7bc0144 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:18.135474 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-64a28b7c-d325-4960-aac4-d3e3c7bc0144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:18.140201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a5e87-cc4c-4a2d-8289-d4ed0f3470b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:18.145450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a5e87-cc4c-4a2d-8289-d4ed0f3470b7 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:18.145984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a5e87-cc4c-4a2d-8289-d4ed0f3470b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:18.146460 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a5e87-cc4c-4a2d-8289-d4ed0f3470b7 None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:18.147484 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a5e87-cc4c-4a2d-8289-d4ed0f3470b7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:18.148010 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a5e87-cc4c-4a2d-8289-d4ed0f3470b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:18.149766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249a5e87-cc4c-4a2d-8289-d4ed0f3470b7 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:18.180937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 346/704] 10.222.0.85 () {56 vars in 1133 bytes} [Tue Aug 2 09:58:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:18.186852 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a5e87-cc4c-4a2d-8289-d4ed0f3470b7 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:18.268894 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 359/705] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:58:18.276209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488de3e8-a6fd-4ec1-9d40-fcf49004f5c8 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:18.276864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488de3e8-a6fd-4ec1-9d40-fcf49004f5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:18.277756 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488de3e8-a6fd-4ec1-9d40-fcf49004f5c8 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:18.280035 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 360/706] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:18.285295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4baca-856b-4fc0-b4db-99517a4af794 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:18.285805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4baca-856b-4fc0-b4db-99517a4af794 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:18.286291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4baca-856b-4fc0-b4db-99517a4af794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:18.326018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1be4baca-856b-4fc0-b4db-99517a4af794 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:18.327745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1be4baca-856b-4fc0-b4db-99517a4af794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:18.330704 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:18.350489 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a5e87-cc4c-4a2d-8289-d4ed0f3470b7 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:18.374139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:18.394398 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037dc03c-0029-4dd4-b292-6a85833a2bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:18.395392 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dc03c-0029-4dd4-b292-6a85833a2bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:18.395876 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dc03c-0029-4dd4-b292-6a85833a2bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:18.396412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dc03c-0029-4dd4-b292-6a85833a2bc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:18.419837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 361/707] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 09:58:18.421066 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4baca-856b-4fc0-b4db-99517a4af794 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:18.498037 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037dc03c-0029-4dd4-b292-6a85833a2bc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:18.500159 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037dc03c-0029-4dd4-b292-6a85833a2bc5 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:18.550669 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4baca-856b-4fc0-b4db-99517a4af794 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:18.593437 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204463b-5050-4d41-b5b0-a86f4c87f111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:18.594096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204463b-5050-4d41-b5b0-a86f4c87f111 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:18.594373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204463b-5050-4d41-b5b0-a86f4c87f111 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:18.594639 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5204463b-5050-4d41-b5b0-a86f4c87f111 None admin] PATH_INFO: `/v3/services/network` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:18.595275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204463b-5050-4d41-b5b0-a86f4c87f111 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:18.596744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5204463b-5050-4d41-b5b0-a86f4c87f111 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:18.608554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5204463b-5050-4d41-b5b0-a86f4c87f111 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 09:58:18.608554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:18.608554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:18.608554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:18.608554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:18.608554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:18.608554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:18.608554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:18.608554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 09:58:18.608554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:18.608554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:18.608554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:18.608554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:18.608554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:18.608554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:18.608554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:18.608554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:18.609645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:18.609645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:18.609645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:18.609645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:18.609645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:18.609645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:18.609645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:18.609645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:18.609645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:18.609645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:18.609645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:18.609645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:18.609645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:18.609645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:18.609645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:18.609645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:18.610513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:18.610513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:18.610513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:18.610513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:18.610513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:18.610513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:18.610513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:18.610513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:18.610513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:18.610513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:18.610513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:18.610513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:18.610513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 09:58:18.610513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:18.614737 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 362/708] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:18 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:18.615709 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204463b-5050-4d41-b5b0-a86f4c87f111 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:18.619282 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:18.732378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5204463b-5050-4d41-b5b0-a86f4c87f111 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:18.746898 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 347/709] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:58:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:58:18.748614 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037dc03c-0029-4dd4-b292-6a85833a2bc5 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:18.771153 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:18.785661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340c949-985f-4d83-afa3-7869e1162546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:18.786551 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340c949-985f-4d83-afa3-7869e1162546 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:18.786831 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340c949-985f-4d83-afa3-7869e1162546 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:18.787101 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340c949-985f-4d83-afa3-7869e1162546 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:18.788129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340c949-985f-4d83-afa3-7869e1162546 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:18.789779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340c949-985f-4d83-afa3-7869e1162546 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:18.802169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-c340c949-985f-4d83-afa3-7869e1162546 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 09:58:18.802169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:18.802169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:18.802169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:18.802169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:18.802169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:18.802169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:18.802169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:18.802169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 09:58:18.802169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:18.802169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:18.802169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:18.802169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:18.802169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:18.802169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:18.802169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:18.803174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:18.803174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:18.803174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:18.803174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:18.803174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:18.803174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:18.803174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:18.803174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:18.803174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:18.803174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:18.803174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:18.803174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:18.803174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:18.803174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:18.803174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:18.803174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:18.804005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:18.804005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:18.804005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:18.804005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:18.804005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:18.804005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:18.804005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:18.804005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:18.804005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:18.804005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:18.804005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:18.804005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:18.804005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:18.804005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 09:58:18.804005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:18.808840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 363/710] 10.222.0.85 () {56 vars in 1129 bytes} [Tue Aug 2 09:58:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:18.810156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340c949-985f-4d83-afa3-7869e1162546 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:18.874044 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037dc03c-0029-4dd4-b292-6a85833a2bc5 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:18.898289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:18.914849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd465923-8fe2-4202-90cc-84e61ba9c95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:18.915820 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd465923-8fe2-4202-90cc-84e61ba9c95e None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:18.916422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd465923-8fe2-4202-90cc-84e61ba9c95e None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:18.916927 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd465923-8fe2-4202-90cc-84e61ba9c95e None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:18.917809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd465923-8fe2-4202-90cc-84e61ba9c95e None admin] RBAC: Adding query filter params (name=network) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:18.918311 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd465923-8fe2-4202-90cc-84e61ba9c95e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:18.920672 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd465923-8fe2-4202-90cc-84e61ba9c95e None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:18.926172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 348/711] 10.222.0.85 () {56 vars in 1112 bytes} [Tue Aug 2 09:58:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:18.927291 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd465923-8fe2-4202-90cc-84e61ba9c95e None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:18.944387 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340c949-985f-4d83-afa3-7869e1162546 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:18.981234 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a7a8c-6257-485e-9596-119e1e06d948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:18.982904 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a7a8c-6257-485e-9596-119e1e06d948 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:18.983400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a7a8c-6257-485e-9596-119e1e06d948 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:18.983868 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a7a8c-6257-485e-9596-119e1e06d948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:18.995588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a7a8c-6257-485e-9596-119e1e06d948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:18.997502 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a7a8c-6257-485e-9596-119e1e06d948 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:19.012775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-b88a7a8c-6257-485e-9596-119e1e06d948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:19.012775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:19.012775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:19.012775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:19.012775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:19.012775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:19.012775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:19.012775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:19.012775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:19.012775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:19.012775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:19.012775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:19.012775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:19.012775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:19.012775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:19.013836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:19.013836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:19.013836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:19.013836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:19.013836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:19.013836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:19.013836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:19.013836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:19.013836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:19.013836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:19.013836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:19.013836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:19.013836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:19.013836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:19.013836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:19.013836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:19.013836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:19.014775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:19.014775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:19.014775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:19.014775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:19.017028 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 364/712] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:19.018044 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a7a8c-6257-485e-9596-119e1e06d948 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:19.036777 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:19.062790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd465923-8fe2-4202-90cc-84e61ba9c95e None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:19.101101 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be1749-3079-4015-b0e5-169bb16857a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:19.102118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be1749-3079-4015-b0e5-169bb16857a9 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:19.102601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be1749-3079-4015-b0e5-169bb16857a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:19.103097 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be1749-3079-4015-b0e5-169bb16857a9 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:19.104171 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be1749-3079-4015-b0e5-169bb16857a9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:19.104888 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be1749-3079-4015-b0e5-169bb16857a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:19.106741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be1749-3079-4015-b0e5-169bb16857a9 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:19.112722 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 349/713] 10.222.0.85 () {56 vars in 1124 bytes} [Tue Aug 2 09:58:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:19.113842 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be1749-3079-4015-b0e5-169bb16857a9 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:19.148345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a7a8c-6257-485e-9596-119e1e06d948 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:19.168063 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:19.189133 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17dbe7-c484-4e89-a129-f9c12e1c54ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:19.190143 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17dbe7-c484-4e89-a129-f9c12e1c54ed None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:19.190622 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17dbe7-c484-4e89-a129-f9c12e1c54ed None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:19.191120 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17dbe7-c484-4e89-a129-f9c12e1c54ed None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:19.192002 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17dbe7-c484-4e89-a129-f9c12e1c54ed None admin] RBAC: Adding query filter params (type=network) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:19.192556 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17dbe7-c484-4e89-a129-f9c12e1c54ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:19.194340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17dbe7-c484-4e89-a129-f9c12e1c54ed None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:19.200937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 365/714] 10.222.0.85 () {56 vars in 1112 bytes} [Tue Aug 2 09:58:19 2022] GET /identity/v3/services?type=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:19.202154 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17dbe7-c484-4e89-a129-f9c12e1c54ed None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:19.257445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be1749-3079-4015-b0e5-169bb16857a9 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:19.313851 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22192350-4b00-4a55-9836-01bc76c57cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:19.314487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192350-4b00-4a55-9836-01bc76c57cfb None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:19.314772 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192350-4b00-4a55-9836-01bc76c57cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:19.315047 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22192350-4b00-4a55-9836-01bc76c57cfb None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:19.316499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22192350-4b00-4a55-9836-01bc76c57cfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:19.316809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22192350-4b00-4a55-9836-01bc76c57cfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:19.318222 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22192350-4b00-4a55-9836-01bc76c57cfb None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:19.336577 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 350/715] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:19.339064 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd7d4-be1f-4786-bebb-6d209faab42f None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:19.339686 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd7d4-be1f-4786-bebb-6d209faab42f None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:19.340241 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd7d4-be1f-4786-bebb-6d209faab42f None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:19.342682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 351/716] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:19.343690 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bd7d4-be1f-4786-bebb-6d209faab42f None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:19.356160 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:19.374515 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17dbe7-c484-4e89-a129-f9c12e1c54ed None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:19.434244 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef8f3a-0d52-4043-85c8-b01599047677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:19.435154 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef8f3a-0d52-4043-85c8-b01599047677 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:19.435455 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef8f3a-0d52-4043-85c8-b01599047677 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:19.435814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef8f3a-0d52-4043-85c8-b01599047677 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:19.437643 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef8f3a-0d52-4043-85c8-b01599047677 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:19.437955 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef8f3a-0d52-4043-85c8-b01599047677 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:19.440553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef8f3a-0d52-4043-85c8-b01599047677 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:19.447373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 366/717] 10.222.0.85 () {56 vars in 1124 bytes} [Tue Aug 2 09:58:19 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:19.449586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff6154-6ed2-4b7b-9e87-fb46cf6c03a2 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:19.450890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff6154-6ed2-4b7b-9e87-fb46cf6c03a2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:19.451392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff6154-6ed2-4b7b-9e87-fb46cf6c03a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:19.482481 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b2ff6154-6ed2-4b7b-9e87-fb46cf6c03a2 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:19.483080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b2ff6154-6ed2-4b7b-9e87-fb46cf6c03a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:19.511116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bd7d4-be1f-4786-bebb-6d209faab42f None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:19.566328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:19.593851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 367/718] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:58:19.617602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff6154-6ed2-4b7b-9e87-fb46cf6c03a2 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:19.618983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724cc1e-803e-4000-b033-0e5835101269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:19.619636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724cc1e-803e-4000-b033-0e5835101269 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:19.619916 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724cc1e-803e-4000-b033-0e5835101269 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:19.620188 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724cc1e-803e-4000-b033-0e5835101269 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:19.637484 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7724cc1e-803e-4000-b033-0e5835101269 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:19.640016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7724cc1e-803e-4000-b033-0e5835101269 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:19.655034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-7724cc1e-803e-4000-b033-0e5835101269 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:19.655034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:19.655034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:19.655034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:19.655034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:19.655034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:19.655034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:19.655034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:19.655034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:19.655034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:19.655034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:19.655034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:19.655034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:19.655034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:19.655034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:19.655983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:19.655983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:19.655983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:19.655983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:19.655983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:19.655983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:19.655983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:19.655983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:19.655983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:19.655983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:19.655983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:19.655983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:19.655983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:19.655983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:19.655983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:19.655983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:19.655983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:19.656905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:19.656905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:19.656905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:19.656905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:19.656905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:19.656905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:19.656905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:19.656905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:19.659600 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 352/719] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:19.664744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724cc1e-803e-4000-b033-0e5835101269 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:19.728692 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff6154-6ed2-4b7b-9e87-fb46cf6c03a2 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:19.743057 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:19.771842 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1e4e9-5ce7-433f-afd4-8ba35d41ca07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:19.772523 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1e4e9-5ce7-433f-afd4-8ba35d41ca07 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:19.772813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1e4e9-5ce7-433f-afd4-8ba35d41ca07 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:19.773094 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1e4e9-5ce7-433f-afd4-8ba35d41ca07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:19.785118 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1e4e9-5ce7-433f-afd4-8ba35d41ca07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:19.790119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-cbe1e4e9-5ce7-433f-afd4-8ba35d41ca07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:19.790119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:19.790119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:19.790119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:19.790119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:19.790119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:19.790119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:19.790119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:19.790119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:19.790119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:19.790119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:19.790119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:19.790119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:19.790119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:19.790119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:19.790119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:19.791043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:19.791043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:19.791043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:19.791043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:19.791043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:19.791043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:19.791043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:19.791043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:19.791043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:19.791043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:19.791043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:19.791043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:19.791043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:19.791043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:19.791043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:19.791043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:19.791886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:19.791886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:19.791886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:19.791886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:19.791886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:19.791886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:19.791886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:19.791886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:19.791886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:19.791886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:19.791886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:19.791886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:19.793050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724cc1e-803e-4000-b033-0e5835101269 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:19.793452 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 368/720] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:58:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:19.793452 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02c46a-a508-443f-ae06-24e0dab7311c None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:19.793452 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02c46a-a508-443f-ae06-24e0dab7311c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:19.793629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02c46a-a508-443f-ae06-24e0dab7311c None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:19.799341 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 369/721] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:19.800483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02c46a-a508-443f-ae06-24e0dab7311c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:19.834574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a7a3a-5c04-4f2f-8761-1b68834fbbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:19.835513 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a7a3a-5c04-4f2f-8761-1b68834fbbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:19.835797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a7a3a-5c04-4f2f-8761-1b68834fbbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:19.836328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a7a3a-5c04-4f2f-8761-1b68834fbbe5 None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:19.837215 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a7a3a-5c04-4f2f-8761-1b68834fbbe5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:19.837523 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a7a3a-5c04-4f2f-8761-1b68834fbbe5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:19.839147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7a7a3a-5c04-4f2f-8761-1b68834fbbe5 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:19.842367 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:19.857055 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 353/722] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:19.861677 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744770e-f951-4cf9-92e8-f103c2b02afa None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:19.862056 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744770e-f951-4cf9-92e8-f103c2b02afa None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:19.862342 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744770e-f951-4cf9-92e8-f103c2b02afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:19.882110 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-2744770e-f951-4cf9-92e8-f103c2b02afa None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:19.883623 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2744770e-f951-4cf9-92e8-f103c2b02afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:19.933791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02c46a-a508-443f-ae06-24e0dab7311c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:19.959678 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 354/723] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:58:19.960580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744770e-f951-4cf9-92e8-f103c2b02afa None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:19.999938 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c2996-1eb3-4652-bc83-6354fe98279d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:20.000696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c2996-1eb3-4652-bc83-6354fe98279d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:20.001056 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c2996-1eb3-4652-bc83-6354fe98279d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:20.001404 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c2996-1eb3-4652-bc83-6354fe98279d None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:20.002227 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c2996-1eb3-4652-bc83-6354fe98279d None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:20.002614 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c2996-1eb3-4652-bc83-6354fe98279d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:20.004052 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c2996-1eb3-4652-bc83-6354fe98279d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:20.013576 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 370/724] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 09:58:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:20.014623 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c2996-1eb3-4652-bc83-6354fe98279d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:20.024333 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:20.074713 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744770e-f951-4cf9-92e8-f103c2b02afa None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:20.116801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301dabe-1ca6-4d9d-b34c-cdf05b49dbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:20.117912 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301dabe-1ca6-4d9d-b34c-cdf05b49dbee None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:20.118716 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301dabe-1ca6-4d9d-b34c-cdf05b49dbee None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:20.119247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301dabe-1ca6-4d9d-b34c-cdf05b49dbee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:20.120271 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301dabe-1ca6-4d9d-b34c-cdf05b49dbee None admin] RBAC: Adding query filter params (role.id=c15ca78eb3c9472f94e15e2d28c7f403, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=310867deefd34a598cfef2f3e4245ace) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:20.120974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:20.122967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301dabe-1ca6-4d9d-b34c-cdf05b49dbee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:20.125079 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301dabe-1ca6-4d9d-b34c-cdf05b49dbee None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:20.126358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c2996-1eb3-4652-bc83-6354fe98279d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:20.136564 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 355/725] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:58:19 2022] GET /identity/v3/role_assignments?user.id=310867deefd34a598cfef2f3e4245ace&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=c15ca78eb3c9472f94e15e2d28c7f403 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:20.137619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301dabe-1ca6-4d9d-b34c-cdf05b49dbee None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:20.185412 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc45738-866f-48a8-ae8f-5d3957405ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:20.186411 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc45738-866f-48a8-ae8f-5d3957405ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:20.186762 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc45738-866f-48a8-ae8f-5d3957405ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:20.187109 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc45738-866f-48a8-ae8f-5d3957405ef5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:20.205122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc45738-866f-48a8-ae8f-5d3957405ef5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:20.210667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-3dc45738-866f-48a8-ae8f-5d3957405ef5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:58:20.210667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:20.210667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:20.210667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:20.210667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:20.210667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:20.210667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:20.210667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:20.210667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:20.210667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:20.210667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:20.210667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:20.210667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:20.210667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:20.210667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:20.210667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:20.211604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:20.211604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:20.211604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:20.211604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:20.211604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:20.211604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:20.211604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:20.211604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:20.211604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:20.211604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:20.211604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:20.211604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:20.211604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:20.211604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:20.211604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:20.211604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:20.212483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:20.212483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:20.212483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:20.212483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:20.212483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:20.212483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:20.212483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:20.212483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:20.212483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:20.212483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:20.212483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:58:20.212483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:20.212483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 371/726] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:58:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:20.218858 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc45738-866f-48a8-ae8f-5d3957405ef5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:20.363663 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301dabe-1ca6-4d9d-b34c-cdf05b49dbee None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:20.388547 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:20.406802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873c3ee-0620-4b1e-9c67-3f799873e2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:20.407726 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873c3ee-0620-4b1e-9c67-3f799873e2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:20.408005 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873c3ee-0620-4b1e-9c67-3f799873e2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:20.408278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873c3ee-0620-4b1e-9c67-3f799873e2a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:20.421891 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873c3ee-0620-4b1e-9c67-3f799873e2a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:20.423482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873c3ee-0620-4b1e-9c67-3f799873e2a3 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:20.426686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc45738-866f-48a8-ae8f-5d3957405ef5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:20.440116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-0873c3ee-0620-4b1e-9c67-3f799873e2a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:20.440116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:20.440116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:20.440116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:20.440116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:20.440116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:20.440116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:20.440116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:20.440116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:20.440116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:20.440116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:20.440116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:20.440116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:20.440116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:20.440116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:20.441105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:20.441105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:20.441105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:20.441105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:20.441105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:20.441105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:20.441105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:20.441105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:20.441105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:20.441105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:20.441105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:20.441105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:20.441105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:20.441105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:20.441105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:20.441105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:20.441105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:20.441980 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:20.441980 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:20.441980 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:20.441980 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:20.441980 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 356/727] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:20.447263 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873c3ee-0620-4b1e-9c67-3f799873e2a3 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:20.499756 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40143082-ff3c-4d4d-98af-81cda65c7e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:20.500377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40143082-ff3c-4d4d-98af-81cda65c7e34 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:20.500686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40143082-ff3c-4d4d-98af-81cda65c7e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:20.500960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40143082-ff3c-4d4d-98af-81cda65c7e34 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:20.501677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40143082-ff3c-4d4d-98af-81cda65c7e34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:20.501978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40143082-ff3c-4d4d-98af-81cda65c7e34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:20.503342 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40143082-ff3c-4d4d-98af-81cda65c7e34 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:20.525094 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 372/728] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:58:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:20.531867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40143082-ff3c-4d4d-98af-81cda65c7e34 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:20.569973 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:20.610607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873c3ee-0620-4b1e-9c67-3f799873e2a3 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:20.644617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa420403-917b-463d-a7b2-871dbeb27c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:20.645160 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa420403-917b-463d-a7b2-871dbeb27c26 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:20.645446 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa420403-917b-463d-a7b2-871dbeb27c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:20.645739 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa420403-917b-463d-a7b2-871dbeb27c26 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:20.646433 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa420403-917b-463d-a7b2-871dbeb27c26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:20.646743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa420403-917b-463d-a7b2-871dbeb27c26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:20.652613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa420403-917b-463d-a7b2-871dbeb27c26 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:20.666417 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 357/729] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:20.673620 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa420403-917b-463d-a7b2-871dbeb27c26 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:20.696620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40143082-ff3c-4d4d-98af-81cda65c7e34 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:20.732993 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e92614-cc97-4f99-8a0d-f4d42c9fc937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:20.734113 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e92614-cc97-4f99-8a0d-f4d42c9fc937 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:20.734604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e92614-cc97-4f99-8a0d-f4d42c9fc937 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:20.735173 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e92614-cc97-4f99-8a0d-f4d42c9fc937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:20.746580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e92614-cc97-4f99-8a0d-f4d42c9fc937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:20.748966 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e92614-cc97-4f99-8a0d-f4d42c9fc937 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:20.749470 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:20.766941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-03e92614-cc97-4f99-8a0d-f4d42c9fc937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:20.766941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:20.766941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:20.766941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:20.766941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:20.766941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:20.766941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:20.766941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:20.766941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:20.766941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:20.766941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:20.766941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:20.766941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:20.766941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:20.766941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:20.767871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:20.767871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:20.767871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:20.767871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:20.767871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:20.767871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:20.767871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:20.767871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:20.767871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:20.767871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:20.767871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:20.767871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:20.767871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:20.767871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:20.767871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:20.767871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:20.767871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:20.768803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:20.768803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:20.768803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:20.768803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:20.771337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 373/730] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:20.777262 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e92614-cc97-4f99-8a0d-f4d42c9fc937 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:20.890530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:20.897021 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa420403-917b-463d-a7b2-871dbeb27c26 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:20.946974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e92614-cc97-4f99-8a0d-f4d42c9fc937 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:20.966057 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a182e6-6a2f-47c6-910f-3dbb6f227c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:20.966765 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a182e6-6a2f-47c6-910f-3dbb6f227c17 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:20.967124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a182e6-6a2f-47c6-910f-3dbb6f227c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:20.967397 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a182e6-6a2f-47c6-910f-3dbb6f227c17 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:20.980249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a182e6-6a2f-47c6-910f-3dbb6f227c17 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:20.982458 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a182e6-6a2f-47c6-910f-3dbb6f227c17 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:21.002703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-05a182e6-6a2f-47c6-910f-3dbb6f227c17 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:58:21.002703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:21.002703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:21.002703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:21.002703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:21.002703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:21.002703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:21.002703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:21.002703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:21.002703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:21.002703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:21.002703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:21.002703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:21.002703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:21.002703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:21.002703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:21.003687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:21.003687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:21.003687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:21.003687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:21.003687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:21.003687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:21.003687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:21.003687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:21.003687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:21.003687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:21.003687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:21.003687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:21.003687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:21.003687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:21.003687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:21.003687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:21.003687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:21.003687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:21.004653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:21.004653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:21.004653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:21.004653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:21.004653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:21.004653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:21.004653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:21.004653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:21.004653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:58:21.004653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:21.004653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 358/731] 10.222.0.85 () {56 vars in 1117 bytes} [Tue Aug 2 09:58:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:21.009798 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a182e6-6a2f-47c6-910f-3dbb6f227c17 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:21.032738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2ab9a-57ec-4b0b-b525-6d423b72eda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:21.033360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2ab9a-57ec-4b0b-b525-6d423b72eda0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:21.033638 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2ab9a-57ec-4b0b-b525-6d423b72eda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:21.033910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db2ab9a-57ec-4b0b-b525-6d423b72eda0 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:21.034607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2ab9a-57ec-4b0b-b525-6d423b72eda0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:21.034911 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2ab9a-57ec-4b0b-b525-6d423b72eda0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:21.036273 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db2ab9a-57ec-4b0b-b525-6d423b72eda0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:21.063458 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 374/732] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:21.067686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2ab9a-57ec-4b0b-b525-6d423b72eda0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:21.172545 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:21.181863 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a182e6-6a2f-47c6-910f-3dbb6f227c17 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:21.223663 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b548e6-2121-4098-956b-eedd2dc96b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:21.224280 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b548e6-2121-4098-956b-eedd2dc96b19 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:21.224581 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b548e6-2121-4098-956b-eedd2dc96b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:21.224851 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b548e6-2121-4098-956b-eedd2dc96b19 None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:21.225647 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b548e6-2121-4098-956b-eedd2dc96b19 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:21.225952 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b548e6-2121-4098-956b-eedd2dc96b19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:21.227373 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b548e6-2121-4098-956b-eedd2dc96b19 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:21.258641 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db2ab9a-57ec-4b0b-b525-6d423b72eda0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:21.261997 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 359/733] 10.222.0.85 () {56 vars in 1149 bytes} [Tue Aug 2 09:58:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:21.272052 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b548e6-2121-4098-956b-eedd2dc96b19 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:21.324848 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:21.334171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497c25c-2c9d-48b0-8d2b-8b5a84d574b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:21.334919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497c25c-2c9d-48b0-8d2b-8b5a84d574b1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:21.335279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497c25c-2c9d-48b0-8d2b-8b5a84d574b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:21.335629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497c25c-2c9d-48b0-8d2b-8b5a84d574b1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:21.347502 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497c25c-2c9d-48b0-8d2b-8b5a84d574b1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:21.354057 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497c25c-2c9d-48b0-8d2b-8b5a84d574b1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:21.384069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5497c25c-2c9d-48b0-8d2b-8b5a84d574b1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:58:21.384069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:21.384069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:21.384069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:21.384069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:21.384069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:21.384069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:21.384069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:21.384069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:21.384069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:21.384069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:21.384069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:21.384069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:21.384069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:21.384069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:21.384069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:21.385098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:21.385098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:21.385098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:21.385098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:21.385098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:21.385098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:21.385098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:21.385098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:21.385098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:21.385098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:21.385098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:21.385098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:21.385098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:21.385098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:21.385098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:21.385098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:21.385098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:21.385098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:21.386050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:21.386050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:21.386050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:21.386050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:21.386050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:21.386050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:21.386050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:21.386050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:21.386050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:58:21.386050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:21.386585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 375/734] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:58:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:21.392141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497c25c-2c9d-48b0-8d2b-8b5a84d574b1 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:21.403865 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b548e6-2121-4098-956b-eedd2dc96b19 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:21.440031 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee842bc-d28d-4c4b-8a59-7f8509d90439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:21.440601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee842bc-d28d-4c4b-8a59-7f8509d90439 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:21.440882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee842bc-d28d-4c4b-8a59-7f8509d90439 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:21.441201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee842bc-d28d-4c4b-8a59-7f8509d90439 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:21.460730 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:21.517661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee842bc-d28d-4c4b-8a59-7f8509d90439 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:21.517857 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497c25c-2c9d-48b0-8d2b-8b5a84d574b1 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:21.519292 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee842bc-d28d-4c4b-8a59-7f8509d90439 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:21.554884 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53136294-70b4-4d1c-a3c5-fdd21c97107d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:21.555608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53136294-70b4-4d1c-a3c5-fdd21c97107d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:21.555896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53136294-70b4-4d1c-a3c5-fdd21c97107d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:21.556171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53136294-70b4-4d1c-a3c5-fdd21c97107d None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:21.557000 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53136294-70b4-4d1c-a3c5-fdd21c97107d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:21.557308 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53136294-70b4-4d1c-a3c5-fdd21c97107d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:21.558734 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53136294-70b4-4d1c-a3c5-fdd21c97107d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:21.579925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 376/735] 10.222.0.85 () {56 vars in 1135 bytes} [Tue Aug 2 09:58:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:21.581347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6cde7-ec18-4646-8255-914907177f45 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:21.581640 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6cde7-ec18-4646-8255-914907177f45 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:21.581919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6cde7-ec18-4646-8255-914907177f45 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:21.583388 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 377/736] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:21.586476 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6cde7-ec18-4646-8255-914907177f45 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:21.631988 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 360/737] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 09:58:21.633851 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a850d-257d-4020-a229-4c992c04164c None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:21.634141 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a850d-257d-4020-a229-4c992c04164c None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:21.634418 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a850d-257d-4020-a229-4c992c04164c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:21.646017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:21.657802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-c36a850d-257d-4020-a229-4c992c04164c None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:21.659323 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-c36a850d-257d-4020-a229-4c992c04164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:21.702103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6cde7-ec18-4646-8255-914907177f45 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:21.710634 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:21.735890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 361/738] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:58:21.737139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a850d-257d-4020-a229-4c992c04164c None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:21.741380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13072dcb-54ab-4b89-b922-b060587fe4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:21.741998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13072dcb-54ab-4b89-b922-b060587fe4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:21.742287 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13072dcb-54ab-4b89-b922-b060587fe4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:21.742563 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13072dcb-54ab-4b89-b922-b060587fe4f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:21.818451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13072dcb-54ab-4b89-b922-b060587fe4f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:21.820188 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13072dcb-54ab-4b89-b922-b060587fe4f2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:21.847559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a850d-257d-4020-a229-4c992c04164c None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:21.874159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:21.887124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe952f5-32dd-4de0-ae2b-699290044837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:21.888798 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe952f5-32dd-4de0-ae2b-699290044837 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:21.889673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe952f5-32dd-4de0-ae2b-699290044837 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:21.890345 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe952f5-32dd-4de0-ae2b-699290044837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:21.903107 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe952f5-32dd-4de0-ae2b-699290044837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:21.906043 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe952f5-32dd-4de0-ae2b-699290044837 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:21.926112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-2fe952f5-32dd-4de0-ae2b-699290044837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:21.926112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:21.926112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:21.926112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:21.926112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:21.926112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:21.926112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:21.926112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:21.926112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:21.926112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:21.926112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:21.926112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:21.926112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:21.926112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:21.926112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:21.927070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:21.927070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:21.927070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:21.927070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:21.927070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:21.927070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:21.927070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:21.927070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:21.927070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:21.927070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:21.927070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:21.927070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:21.927070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:21.927070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:21.927070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:21.927070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:21.927070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:21.927974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:21.927974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:21.927974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:21.927974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:21.927974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 362/739] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:21.928246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe952f5-32dd-4de0-ae2b-699290044837 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:21.942482 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 378/740] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 09:58:21.944633 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21fb32-76ba-4f35-b87a-e95230fd5368 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:21.944927 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21fb32-76ba-4f35-b87a-e95230fd5368 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:21.945206 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21fb32-76ba-4f35-b87a-e95230fd5368 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:21.946564 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 379/741] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:21.947153 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21fb32-76ba-4f35-b87a-e95230fd5368 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:21.962748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:22.039948 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe952f5-32dd-4de0-ae2b-699290044837 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:22.067298 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21fb32-76ba-4f35-b87a-e95230fd5368 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:22.079943 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059194bd-f535-4856-ac6c-39e58a1922cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:22.080586 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059194bd-f535-4856-ac6c-39e58a1922cd None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:22.081037 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059194bd-f535-4856-ac6c-39e58a1922cd None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:22.081321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059194bd-f535-4856-ac6c-39e58a1922cd None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:22.082393 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059194bd-f535-4856-ac6c-39e58a1922cd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:22.084198 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059194bd-f535-4856-ac6c-39e58a1922cd None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:22.103525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 363/742] 10.222.0.85 () {60 vars in 1141 bytes} [Tue Aug 2 09:58:21 2022] POST /identity/v3/services => generated 240 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:58:22.104356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059194bd-f535-4856-ac6c-39e58a1922cd None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:22.127857 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d2ef4-1319-4583-b477-95fc94d8b1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:22.129564 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d2ef4-1319-4583-b477-95fc94d8b1bb None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:22.130309 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d2ef4-1319-4583-b477-95fc94d8b1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:22.130764 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d2ef4-1319-4583-b477-95fc94d8b1bb None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:22.131972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d2ef4-1319-4583-b477-95fc94d8b1bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:22.133169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d2ef4-1319-4583-b477-95fc94d8b1bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:22.135105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d2ef4-1319-4583-b477-95fc94d8b1bb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:22.154389 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 380/743] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:22.157067 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9efed0-842d-4ab0-b6bf-9e9a76d5e7d6 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:22.157560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9efed0-842d-4ab0-b6bf-9e9a76d5e7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:22.158100 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9efed0-842d-4ab0-b6bf-9e9a76d5e7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:22.176492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:22.185760 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ce9efed0-842d-4ab0-b6bf-9e9a76d5e7d6 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:22.188054 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ce9efed0-842d-4ab0-b6bf-9e9a76d5e7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:22.241523 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:22.258416 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059194bd-f535-4856-ac6c-39e58a1922cd None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:22.288483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 381/744] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:22 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 09:58:22.288483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9efed0-842d-4ab0-b6bf-9e9a76d5e7d6 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:22.320428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd67134-6230-4f8f-959e-884d09baadde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:22.321121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd67134-6230-4f8f-959e-884d09baadde None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:22.321408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd67134-6230-4f8f-959e-884d09baadde None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:22.321686 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd67134-6230-4f8f-959e-884d09baadde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:22.335795 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd67134-6230-4f8f-959e-884d09baadde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:22.336317 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd67134-6230-4f8f-959e-884d09baadde None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:22.353019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-bcd67134-6230-4f8f-959e-884d09baadde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:22.353019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:22.353019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:22.353019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:22.353019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:22.353019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:22.353019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:22.353019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:22.353019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:22.353019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:22.353019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:22.353019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:22.353019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:22.353019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:22.353019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:22.353972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:22.353972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:22.353972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:22.353972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:22.353972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:22.353972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:22.353972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:22.353972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:22.353972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:22.353972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:22.353972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:22.353972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:22.353972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:22.353972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:22.353972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:22.353972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:22.353972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:22.354847 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:22.354847 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:22.354847 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:22.354847 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:22.354847 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 364/745] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:22.355296 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd67134-6230-4f8f-959e-884d09baadde None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:22.409526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9efed0-842d-4ab0-b6bf-9e9a76d5e7d6 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:22.447207 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4d059-e1e0-473e-a76e-c79a97b9642a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:22.448129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4d059-e1e0-473e-a76e-c79a97b9642a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:22.448583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4d059-e1e0-473e-a76e-c79a97b9642a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:22.449117 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4d059-e1e0-473e-a76e-c79a97b9642a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:22.452532 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:22.459271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4d059-e1e0-473e-a76e-c79a97b9642a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:22.461242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4d059-e1e0-473e-a76e-c79a97b9642a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:22.474826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-59c4d059-e1e0-473e-a76e-c79a97b9642a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:22.474826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:22.474826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:22.474826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:22.474826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:22.474826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:22.474826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:22.474826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:22.474826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:22.474826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:22.474826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:22.474826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:22.474826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:22.474826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:22.474826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:22.475919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:22.475919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:22.475919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:22.475919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:22.475919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:22.475919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:22.475919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:22.475919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:22.475919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:22.475919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:22.475919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:22.475919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:22.475919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:22.475919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:22.475919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:22.475919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:22.475919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:22.476989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:22.476989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:22.476989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:22.476989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:22.476989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:22.476989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:22.476989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:22.476989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:22.478911 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 382/746] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:22.479863 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4d059-e1e0-473e-a76e-c79a97b9642a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:22.504877 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd67134-6230-4f8f-959e-884d09baadde None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:22.540880 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ee700-9a3e-4a87-8f02-8fb6b7cad59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:22.541602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ee700-9a3e-4a87-8f02-8fb6b7cad59a None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:22.541946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ee700-9a3e-4a87-8f02-8fb6b7cad59a None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:22.542230 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ee700-9a3e-4a87-8f02-8fb6b7cad59a None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:22.542977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ee700-9a3e-4a87-8f02-8fb6b7cad59a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:22.544917 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ee700-9a3e-4a87-8f02-8fb6b7cad59a None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:22.568560 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 365/747] 10.222.0.85 () {60 vars in 1141 bytes} [Tue Aug 2 09:58:22 2022] POST /identity/v3/services => generated 251 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:58:22.568560 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ee700-9a3e-4a87-8f02-8fb6b7cad59a None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:22.570310 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:22.629173 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4d059-e1e0-473e-a76e-c79a97b9642a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:22.677479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f795c-b309-4dc3-b96c-92fae57bd870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:22.678508 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f795c-b309-4dc3-b96c-92fae57bd870 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:22.678984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f795c-b309-4dc3-b96c-92fae57bd870 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:22.679450 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f795c-b309-4dc3-b96c-92fae57bd870 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:22.680372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f795c-b309-4dc3-b96c-92fae57bd870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:22.680904 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f795c-b309-4dc3-b96c-92fae57bd870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:22.682504 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0f795c-b309-4dc3-b96c-92fae57bd870 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:22.696810 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 383/748] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:22.698513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e1cce-2351-44e2-90d1-6624db5776bf None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:22.699007 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e1cce-2351-44e2-90d1-6624db5776bf None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:22.699508 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e1cce-2351-44e2-90d1-6624db5776bf None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:22.701294 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ee700-9a3e-4a87-8f02-8fb6b7cad59a None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:22.702323 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 384/749] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:22.703275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e1cce-2351-44e2-90d1-6624db5776bf None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:22.740333 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e18009-48df-4675-beba-cbaa2ccf2e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:22.741072 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e18009-48df-4675-beba-cbaa2ccf2e6d None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:22.741438 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e18009-48df-4675-beba-cbaa2ccf2e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:22.741741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e18009-48df-4675-beba-cbaa2ccf2e6d None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:22.742521 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e18009-48df-4675-beba-cbaa2ccf2e6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:22.742831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e18009-48df-4675-beba-cbaa2ccf2e6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:22.744440 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e18009-48df-4675-beba-cbaa2ccf2e6d None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:22.760075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 366/750] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:22.761348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586d33b-951d-4f5e-8317-274045ca1a57 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:22.761635 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586d33b-951d-4f5e-8317-274045ca1a57 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:22.761910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586d33b-951d-4f5e-8317-274045ca1a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:22.769529 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:22.782656 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-6586d33b-951d-4f5e-8317-274045ca1a57 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:22.783859 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-6586d33b-951d-4f5e-8317-274045ca1a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:22.833136 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e1cce-2351-44e2-90d1-6624db5776bf None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:22.856209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:22.868775 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 367/751] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:22.873131 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da857267-e98c-455e-b119-26dd27087314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:22.873852 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da857267-e98c-455e-b119-26dd27087314 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:22.874201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da857267-e98c-455e-b119-26dd27087314 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:22.874538 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da857267-e98c-455e-b119-26dd27087314 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:22.877192 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586d33b-951d-4f5e-8317-274045ca1a57 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:22.882590 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da857267-e98c-455e-b119-26dd27087314 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:22.884365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da857267-e98c-455e-b119-26dd27087314 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:22.896855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-da857267-e98c-455e-b119-26dd27087314 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:22.896855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:22.896855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:22.896855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:22.896855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:22.896855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:22.896855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:22.896855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:22.896855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:22.896855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:22.896855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:22.896855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:22.896855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:22.896855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:22.896855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:22.897776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:22.897776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:22.897776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:22.897776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:22.897776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:22.897776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:22.897776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:22.897776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:22.897776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:22.897776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:22.897776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:22.897776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:22.897776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:22.897776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:22.897776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:22.897776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:22.897776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:22.898646 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:22.898646 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:22.898646 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:22.898646 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:22.898646 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:22.898646 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:22.898646 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:22.898646 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:22.898646 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 385/752] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:22.909786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da857267-e98c-455e-b119-26dd27087314 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:23.000061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586d33b-951d-4f5e-8317-274045ca1a57 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:23.023297 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da857267-e98c-455e-b119-26dd27087314 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:23.036439 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3757954-9e03-47e6-96f1-2775b35a7aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:23.037078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3757954-9e03-47e6-96f1-2775b35a7aff None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:23.037357 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3757954-9e03-47e6-96f1-2775b35a7aff None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:23.037541 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:23.037694 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3757954-9e03-47e6-96f1-2775b35a7aff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:23.038416 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3757954-9e03-47e6-96f1-2775b35a7aff None admin] RBAC: Adding query filter params (role.id=e30f587367384737a72bbcc2e35d62ad, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=f43a16e2dcab4872963222c557853d32) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:23.038719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3757954-9e03-47e6-96f1-2775b35a7aff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:23.040134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3757954-9e03-47e6-96f1-2775b35a7aff None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:23.046288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 368/753] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:58:22 2022] GET /identity/v3/role_assignments?user.id=f43a16e2dcab4872963222c557853d32&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=e30f587367384737a72bbcc2e35d62ad => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:23.047156 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3757954-9e03-47e6-96f1-2775b35a7aff None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:23.063764 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a45098-3cb7-46d5-a9f7-d14519f6d54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:23.065117 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a45098-3cb7-46d5-a9f7-d14519f6d54d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:23.065398 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a45098-3cb7-46d5-a9f7-d14519f6d54d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:23.065940 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a45098-3cb7-46d5-a9f7-d14519f6d54d None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:23.066711 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a45098-3cb7-46d5-a9f7-d14519f6d54d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:23.067307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a45098-3cb7-46d5-a9f7-d14519f6d54d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:23.069298 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a45098-3cb7-46d5-a9f7-d14519f6d54d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:23.085171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 386/754] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:23.091699 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a45098-3cb7-46d5-a9f7-d14519f6d54d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:23.117053 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:23.165806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3757954-9e03-47e6-96f1-2775b35a7aff None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:23.203841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d250c1-61b4-48e5-867c-b28e9df80d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:23.204763 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d250c1-61b4-48e5-867c-b28e9df80d9b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:23.205152 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d250c1-61b4-48e5-867c-b28e9df80d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:23.205544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d250c1-61b4-48e5-867c-b28e9df80d9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:23.218018 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d250c1-61b4-48e5-867c-b28e9df80d9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:23.223733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-73d250c1-61b4-48e5-867c-b28e9df80d9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:58:23.223733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:23.223733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:23.223733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:23.223733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:23.223733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:23.223733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:23.223733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:23.223733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:23.223733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:23.223733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:23.223733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:23.223733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:23.223733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:23.223733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:23.223733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:23.224883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:23.224883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:23.224883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:23.224883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:23.224883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:23.224883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:23.224883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:23.224883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:23.224883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:23.224883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:23.224883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:23.224883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:23.224883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:23.224883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:23.224883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:23.224883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:23.225882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:23.225882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:23.225882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:23.225882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:23.225882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:23.225882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:23.225882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:23.225882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:23.225882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:23.225882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:23.225882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:58:23.225882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:23.227000 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 369/755] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:58:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:23.227539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a45098-3cb7-46d5-a9f7-d14519f6d54d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:23.240751 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d250c1-61b4-48e5-867c-b28e9df80d9b None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:23.281555 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2ba6d-a90a-422d-a361-2e75e49f8301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:23.285519 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2ba6d-a90a-422d-a361-2e75e49f8301 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:23.285838 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2ba6d-a90a-422d-a361-2e75e49f8301 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:23.286115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2ba6d-a90a-422d-a361-2e75e49f8301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:23.286951 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2ba6d-a90a-422d-a361-2e75e49f8301 None admin] RBAC: Adding query filter params (role.id=c15ca78eb3c9472f94e15e2d28c7f403, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=e9cfed2469a7419f8fcbe09d25cb896e) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:23.287261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2ba6d-a90a-422d-a361-2e75e49f8301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:23.290538 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2ba6d-a90a-422d-a361-2e75e49f8301 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:23.305619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 387/756] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:58:23 2022] GET /identity/v3/role_assignments?user.id=e9cfed2469a7419f8fcbe09d25cb896e&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=c15ca78eb3c9472f94e15e2d28c7f403 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:23.388747 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d250c1-61b4-48e5-867c-b28e9df80d9b None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:23.407772 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:23.427012 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9d391-dd2b-43ab-91eb-566c1ddb8710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:23.427680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9d391-dd2b-43ab-91eb-566c1ddb8710 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:23.427957 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9d391-dd2b-43ab-91eb-566c1ddb8710 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:23.428232 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9d391-dd2b-43ab-91eb-566c1ddb8710 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:23.428984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9d391-dd2b-43ab-91eb-566c1ddb8710 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:23.429287 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9d391-dd2b-43ab-91eb-566c1ddb8710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:23.430648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9d391-dd2b-43ab-91eb-566c1ddb8710 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:23.442423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 370/757] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:58:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:23.453647 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2ba6d-a90a-422d-a361-2e75e49f8301 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:23.506895 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:23.584575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2ba6d-a90a-422d-a361-2e75e49f8301 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:23.621121 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924e0e1-12ad-4a1f-a2a5-94ed7f2b5009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:23.622320 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e0e1-12ad-4a1f-a2a5-94ed7f2b5009 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:23.622609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e0e1-12ad-4a1f-a2a5-94ed7f2b5009 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:23.622888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e0e1-12ad-4a1f-a2a5-94ed7f2b5009 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:23.634227 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924e0e1-12ad-4a1f-a2a5-94ed7f2b5009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:23.635683 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924e0e1-12ad-4a1f-a2a5-94ed7f2b5009 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:23.650588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-6924e0e1-12ad-4a1f-a2a5-94ed7f2b5009 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:23.650588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:23.650588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:23.650588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:23.650588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:23.650588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:23.650588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:23.650588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:23.650588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:23.650588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:23.650588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:23.650588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:23.650588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:23.650588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:23.650588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:23.651456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:23.651456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:23.651456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:23.651456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:23.651456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:23.651456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:23.651456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:23.651456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:23.651456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:23.651456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:23.651456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:23.651456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:23.651456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:23.651456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:23.651456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:23.651456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:23.651456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:23.652331 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:23.652331 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:23.652331 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:23.652331 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:23.652331 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 388/758] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:23.661717 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9d391-dd2b-43ab-91eb-566c1ddb8710 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:23.811286 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9d391-dd2b-43ab-91eb-566c1ddb8710 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:23.846732 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed847a4-0e8a-4c66-9c92-11297fce6670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:23.847268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed847a4-0e8a-4c66-9c92-11297fce6670 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:23.847546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed847a4-0e8a-4c66-9c92-11297fce6670 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:23.847820 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed847a4-0e8a-4c66-9c92-11297fce6670 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:23.848536 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed847a4-0e8a-4c66-9c92-11297fce6670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:23.848839 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed847a4-0e8a-4c66-9c92-11297fce6670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:23.850206 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed847a4-0e8a-4c66-9c92-11297fce6670 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:23.862704 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 371/759] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:23.867990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924e0e1-12ad-4a1f-a2a5-94ed7f2b5009 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:23.995468 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:24.010536 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924e0e1-12ad-4a1f-a2a5-94ed7f2b5009 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:24.054351 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9932f-cc6b-4223-a983-c713272ef4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:24.054987 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9932f-cc6b-4223-a983-c713272ef4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:24.055264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9932f-cc6b-4223-a983-c713272ef4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:24.055533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9932f-cc6b-4223-a983-c713272ef4e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:24.063957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9932f-cc6b-4223-a983-c713272ef4e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:24.065418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9932f-cc6b-4223-a983-c713272ef4e0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:24.077603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-f3c9932f-cc6b-4223-a983-c713272ef4e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:58:24.077603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:24.077603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:24.077603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:24.077603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:24.077603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:24.077603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:24.077603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:24.077603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:24.077603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:24.077603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:24.077603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:24.077603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:24.077603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:24.077603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:24.077603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:24.078585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:24.078585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:24.078585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:24.078585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:24.078585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:24.078585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:24.078585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:24.078585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:24.078585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:24.078585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:24.078585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:24.078585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:24.078585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:24.078585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:24.078585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:24.078585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:24.078585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:24.078585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:24.079505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:24.079505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:24.079505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:24.079505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:24.079505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:24.079505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:24.079505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:24.079505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:24.079505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:58:24.079505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:24.079505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 389/760] 10.222.0.85 () {56 vars in 1093 bytes} [Tue Aug 2 09:58:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:24.084737 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed847a4-0e8a-4c66-9c92-11297fce6670 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:24.162522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:24.258636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed847a4-0e8a-4c66-9c92-11297fce6670 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:24.313190 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed51c02-8f8f-4036-872b-7c50d1203d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:24.313829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed51c02-8f8f-4036-872b-7c50d1203d0c None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:24.314118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed51c02-8f8f-4036-872b-7c50d1203d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:24.314396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed51c02-8f8f-4036-872b-7c50d1203d0c None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:24.315208 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed51c02-8f8f-4036-872b-7c50d1203d0c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:24.315521 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed51c02-8f8f-4036-872b-7c50d1203d0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:24.317025 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed51c02-8f8f-4036-872b-7c50d1203d0c None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:24.344608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 372/761] 10.222.0.85 () {56 vars in 1133 bytes} [Tue Aug 2 09:58:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:24.349765 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9932f-cc6b-4223-a983-c713272ef4e0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:24.479860 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9932f-cc6b-4223-a983-c713272ef4e0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:24.522350 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80ae6c-6236-4419-91d0-e9d8f4d33b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:24.522991 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80ae6c-6236-4419-91d0-e9d8f4d33b2b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:24.523269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80ae6c-6236-4419-91d0-e9d8f4d33b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:24.523539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80ae6c-6236-4419-91d0-e9d8f4d33b2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:24.542488 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80ae6c-6236-4419-91d0-e9d8f4d33b2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:24.544682 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80ae6c-6236-4419-91d0-e9d8f4d33b2b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:24.553422 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:24.565413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-6e80ae6c-6236-4419-91d0-e9d8f4d33b2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:24.565413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:24.565413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:24.565413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:24.565413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:24.565413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:24.565413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:24.565413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:24.565413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:24.565413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:24.565413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:24.565413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:24.565413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:24.565413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:24.565413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:24.566332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:24.566332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:24.566332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:24.566332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:24.566332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:24.566332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:24.566332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:24.566332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:24.566332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:24.566332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:24.566332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:24.566332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:24.566332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:24.566332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:24.566332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:24.566332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:24.566332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:24.567638 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:24.567638 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:24.567638 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:24.567638 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:24.567638 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 390/762] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:24.573029 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed51c02-8f8f-4036-872b-7c50d1203d0c None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:24.616224 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35089ea-c7ba-4bba-a93e-66d20d9481ed None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:24.616589 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35089ea-c7ba-4bba-a93e-66d20d9481ed None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:24.616870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35089ea-c7ba-4bba-a93e-66d20d9481ed None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:24.618423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 391/763] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:24.624472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdee85-ed05-4ce9-8181-89a6d4461389 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:24.624766 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdee85-ed05-4ce9-8181-89a6d4461389 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:24.625042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdee85-ed05-4ce9-8181-89a6d4461389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:24.644797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-62fdee85-ed05-4ce9-8181-89a6d4461389 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:24.645987 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-62fdee85-ed05-4ce9-8181-89a6d4461389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:24.785389 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 392/764] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:58:24.787532 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed51c02-8f8f-4036-872b-7c50d1203d0c None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:24.795409 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:24.823593 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdee85-ed05-4ce9-8181-89a6d4461389 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:24.881008 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cf3ba-6fea-40d2-a01e-e0cfff43b1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:24.881639 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cf3ba-6fea-40d2-a01e-e0cfff43b1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:24.881925 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cf3ba-6fea-40d2-a01e-e0cfff43b1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:24.883816 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4cf3ba-6fea-40d2-a01e-e0cfff43b1b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:24.884597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cf3ba-6fea-40d2-a01e-e0cfff43b1b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:24.886606 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cf3ba-6fea-40d2-a01e-e0cfff43b1b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:24.888357 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4cf3ba-6fea-40d2-a01e-e0cfff43b1b2 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:24.930675 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 373/765] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:24.935993 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cf3ba-6fea-40d2-a01e-e0cfff43b1b2 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:25.023678 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdee85-ed05-4ce9-8181-89a6d4461389 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:25.056388 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:25.063602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993648a-5c40-4f22-bd25-d7ea6e01c2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:25.064544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993648a-5c40-4f22-bd25-d7ea6e01c2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:25.065042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993648a-5c40-4f22-bd25-d7ea6e01c2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:25.065592 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993648a-5c40-4f22-bd25-d7ea6e01c2c9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:25.066503 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993648a-5c40-4f22-bd25-d7ea6e01c2c9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:25.068049 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993648a-5c40-4f22-bd25-d7ea6e01c2c9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:25.072251 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4cf3ba-6fea-40d2-a01e-e0cfff43b1b2 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:25.077961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-2993648a-5c40-4f22-bd25-d7ea6e01c2c9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 09:58:25.077961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:25.077961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:25.077961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:25.077961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:25.077961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:25.077961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:25.077961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:25.077961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 09:58:25.077961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:25.077961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:25.077961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:25.077961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:25.077961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:25.077961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:25.077961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:25.077961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:25.078902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:25.078902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:25.078902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:25.078902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:25.078902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:25.078902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:25.078902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:25.078902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:25.078902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:25.078902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:25.078902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:25.078902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:25.078902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:25.078902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:25.078902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:25.078902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:25.079817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:25.079817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:25.079817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:25.079817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:25.079817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:25.079817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:25.079817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:25.079817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:25.079817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:25.079817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:25.079817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:25.079817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:25.079817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 09:58:25.079817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:25.082693 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 393/766] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:24 2022] GET /identity/v3/services/network => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:25.084112 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e26e67-02e8-47ce-b53b-57acf072e42d None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:25.084689 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e26e67-02e8-47ce-b53b-57acf072e42d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:25.085254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e26e67-02e8-47ce-b53b-57acf072e42d None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:25.091364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 394/767] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:25.092831 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e26e67-02e8-47ce-b53b-57acf072e42d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:25.107648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886bc9e-9a5e-4166-9c2f-a6d426358566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:25.108293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886bc9e-9a5e-4166-9c2f-a6d426358566 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:25.108662 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886bc9e-9a5e-4166-9c2f-a6d426358566 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:25.108944 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886bc9e-9a5e-4166-9c2f-a6d426358566 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:25.116054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886bc9e-9a5e-4166-9c2f-a6d426358566 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:25.117605 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886bc9e-9a5e-4166-9c2f-a6d426358566 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:25.130181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-5886bc9e-9a5e-4166-9c2f-a6d426358566 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:25.130181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:25.130181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:25.130181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:25.130181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:25.130181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:25.130181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:25.130181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:25.130181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:25.130181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:25.130181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:25.130181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:25.130181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:25.130181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:25.130181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:25.131061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:25.131061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:25.131061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:25.131061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:25.131061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:25.131061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:25.131061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:25.131061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:25.131061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:25.131061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:25.131061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:25.131061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:25.131061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:25.131061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:25.131061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:25.131061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:25.131061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:25.132526 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:25.132526 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:25.132526 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:25.132526 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:25.132526 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:25.132526 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:25.132526 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:25.132526 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:25.132526 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 374/768] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:25.133292 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65777a-d746-46ab-9461-f040214e7cb6 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:25.133587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65777a-d746-46ab-9461-f040214e7cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:25.133740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65777a-d746-46ab-9461-f040214e7cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:25.152817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-6f65777a-d746-46ab-9461-f040214e7cb6 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:25.154771 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-6f65777a-d746-46ab-9461-f040214e7cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:25.169384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:25.216360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e26e67-02e8-47ce-b53b-57acf072e42d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:25.227789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 375/769] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:25.228914 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65777a-d746-46ab-9461-f040214e7cb6 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:25.279849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56faf0f3-2c27-4658-9be0-53a9d1a28ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:25.280800 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faf0f3-2c27-4658-9be0-53a9d1a28ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:25.281216 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faf0f3-2c27-4658-9be0-53a9d1a28ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:25.281629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faf0f3-2c27-4658-9be0-53a9d1a28ea4 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:25.282555 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56faf0f3-2c27-4658-9be0-53a9d1a28ea4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:25.282996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56faf0f3-2c27-4658-9be0-53a9d1a28ea4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:25.284643 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56faf0f3-2c27-4658-9be0-53a9d1a28ea4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:25.290304 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 395/770] 10.222.0.85 () {56 vars in 1112 bytes} [Tue Aug 2 09:58:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:25.291356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56faf0f3-2c27-4658-9be0-53a9d1a28ea4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:25.350011 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65777a-d746-46ab-9461-f040214e7cb6 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:25.361155 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:25.391510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd0cd9-e8a2-4b7d-a439-1530966e7979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:25.392140 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd0cd9-e8a2-4b7d-a439-1530966e7979 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:25.392425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd0cd9-e8a2-4b7d-a439-1530966e7979 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:25.392750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd0cd9-e8a2-4b7d-a439-1530966e7979 None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:25.393517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd0cd9-e8a2-4b7d-a439-1530966e7979 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:25.393827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd0cd9-e8a2-4b7d-a439-1530966e7979 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:25.395600 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd0cd9-e8a2-4b7d-a439-1530966e7979 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:25.408808 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56faf0f3-2c27-4658-9be0-53a9d1a28ea4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:25.409198 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 376/771] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:25.410050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd0cd9-e8a2-4b7d-a439-1530966e7979 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:25.423517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:25.449143 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f6c2c-61f2-4716-aa94-a5c0e30ba672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:25.450908 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f6c2c-61f2-4716-aa94-a5c0e30ba672 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:25.451389 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f6c2c-61f2-4716-aa94-a5c0e30ba672 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:25.452805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f6c2c-61f2-4716-aa94-a5c0e30ba672 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:25.453670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f6c2c-61f2-4716-aa94-a5c0e30ba672 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:25.455300 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f6c2c-61f2-4716-aa94-a5c0e30ba672 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:25.468807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-056f6c2c-61f2-4716-aa94-a5c0e30ba672 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 09:58:25.468807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:25.468807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:25.468807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:25.468807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:25.468807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:25.468807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:25.468807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:25.468807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 09:58:25.468807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:25.468807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:25.468807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:25.468807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:25.468807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:25.468807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:25.468807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:25.469747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:25.469747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:25.469747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:25.469747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:25.469747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:25.469747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:25.469747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:25.469747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:25.469747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:25.469747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:25.469747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:25.469747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:25.469747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:25.469747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:25.469747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:25.469747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:25.470560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:25.470560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:25.470560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:25.470560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:25.470560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:25.470560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:25.470560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:25.470560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:25.470560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:25.470560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:25.470560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:25.470560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:25.470560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:25.470560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 09:58:25.470560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:25.479089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 396/772] 10.222.0.85 () {56 vars in 1129 bytes} [Tue Aug 2 09:58:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:25.479089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f6c2c-61f2-4716-aa94-a5c0e30ba672 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:25.537092 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd0cd9-e8a2-4b7d-a439-1530966e7979 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:25.573061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b214ea-435f-4336-9673-3c92375b9c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:25.573601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b214ea-435f-4336-9673-3c92375b9c75 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:25.573887 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b214ea-435f-4336-9673-3c92375b9c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:25.574165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b214ea-435f-4336-9673-3c92375b9c75 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:25.575456 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b214ea-435f-4336-9673-3c92375b9c75 None admin] RBAC: Adding query filter params (type=network) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:25.575812 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b214ea-435f-4336-9673-3c92375b9c75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:25.577396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b214ea-435f-4336-9673-3c92375b9c75 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:25.584653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 377/773] 10.222.0.85 () {56 vars in 1112 bytes} [Tue Aug 2 09:58:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:25.585578 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b214ea-435f-4336-9673-3c92375b9c75 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:25.606170 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f6c2c-61f2-4716-aa94-a5c0e30ba672 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:25.632356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:25.646271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2ea8c-5b99-4486-9f9c-dea91f3730a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:25.648317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2ea8c-5b99-4486-9f9c-dea91f3730a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:25.648825 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2ea8c-5b99-4486-9f9c-dea91f3730a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:25.649295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2ea8c-5b99-4486-9f9c-dea91f3730a4 None admin] PATH_INFO: `/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/310867deefd34a598cfef2f3e4245ace/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:25.651994 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2ea8c-5b99-4486-9f9c-dea91f3730a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=701d7ad0b7594984885e7bfe8a236937, user_id=310867deefd34a598cfef2f3e4245ace, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:25.654804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2ea8c-5b99-4486-9f9c-dea91f3730a4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:25.672564 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:25.674880 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 397/774] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:58:25 2022] PUT /identity/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/310867deefd34a598cfef2f3e4245ace/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:58:25.676072 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2ea8c-5b99-4486-9f9c-dea91f3730a4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:25.710844 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b214ea-435f-4336-9673-3c92375b9c75 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:25.759807 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b472ba2-4e7c-4c34-975b-807a5fa44e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:25.761102 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b472ba2-4e7c-4c34-975b-807a5fa44e92 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:25.761886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b472ba2-4e7c-4c34-975b-807a5fa44e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:25.763457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b472ba2-4e7c-4c34-975b-807a5fa44e92 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:25.764690 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b472ba2-4e7c-4c34-975b-807a5fa44e92 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:25.765269 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b472ba2-4e7c-4c34-975b-807a5fa44e92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:25.767254 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b472ba2-4e7c-4c34-975b-807a5fa44e92 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:25.780348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 378/775] 10.222.0.85 () {56 vars in 1124 bytes} [Tue Aug 2 09:58:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:25.781978 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b472ba2-4e7c-4c34-975b-807a5fa44e92 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:25.808726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2ea8c-5b99-4486-9f9c-dea91f3730a4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:25.850619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9804b80-af7f-40d2-932b-f4668b573eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:25.851184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9804b80-af7f-40d2-932b-f4668b573eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:25.851516 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9804b80-af7f-40d2-932b-f4668b573eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:25.851805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9804b80-af7f-40d2-932b-f4668b573eb1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:25.852613 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9804b80-af7f-40d2-932b-f4668b573eb1 None admin] RBAC: Adding query filter params (interface=public, service_id=f0c8ae5210e54d26b94404b9c67eac04, region_id=RegionOne) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:25.852933 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9804b80-af7f-40d2-932b-f4668b573eb1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:25.854655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9804b80-af7f-40d2-932b-f4668b573eb1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:25.864843 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 398/776] 10.222.0.85 () {56 vars in 1251 bytes} [Tue Aug 2 09:58:25 2022] GET /identity/v3/endpoints?service_id=f0c8ae5210e54d26b94404b9c67eac04&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:25.865820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b2891-facd-4261-87c3-1909f47b4283 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:25.866036 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b2891-facd-4261-87c3-1909f47b4283 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:25.866317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b2891-facd-4261-87c3-1909f47b4283 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:25.868017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 399/777] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:25.869387 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3c45e-4a8a-4e68-a863-f9b2a244fa5e None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:25.869679 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3c45e-4a8a-4e68-a863-f9b2a244fa5e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:25.869957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3c45e-4a8a-4e68-a863-f9b2a244fa5e None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:25.872184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 400/778] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:25.873658 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3c45e-4a8a-4e68-a863-f9b2a244fa5e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:25.918079 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b472ba2-4e7c-4c34-975b-807a5fa44e92 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:25.935297 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:25.958261 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd921906-47de-414d-8421-d1369f9bf9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:25.959020 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd921906-47de-414d-8421-d1369f9bf9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:25.959312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd921906-47de-414d-8421-d1369f9bf9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:25.959592 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd921906-47de-414d-8421-d1369f9bf9f9 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:25.960280 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd921906-47de-414d-8421-d1369f9bf9f9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:25.960632 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd921906-47de-414d-8421-d1369f9bf9f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:25.962009 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd921906-47de-414d-8421-d1369f9bf9f9 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:25.964983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:25.969557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 379/779] 10.222.0.85 () {56 vars in 1124 bytes} [Tue Aug 2 09:58:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:25.970784 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef607167-0066-4911-bf9a-7b8fbcf194bd None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:25.971078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef607167-0066-4911-bf9a-7b8fbcf194bd None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:25.971359 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef607167-0066-4911-bf9a-7b8fbcf194bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:25.990273 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-ef607167-0066-4911-bf9a-7b8fbcf194bd None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:25.991471 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ef607167-0066-4911-bf9a-7b8fbcf194bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:26.004149 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3c45e-4a8a-4e68-a863-f9b2a244fa5e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:26.041904 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f62a69-92e5-4d4d-bf2e-59b4d84928e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:26.042521 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f62a69-92e5-4d4d-bf2e-59b4d84928e0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:26.042806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f62a69-92e5-4d4d-bf2e-59b4d84928e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:26.043086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f62a69-92e5-4d4d-bf2e-59b4d84928e0 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:26.044294 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f62a69-92e5-4d4d-bf2e-59b4d84928e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:26.045702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f62a69-92e5-4d4d-bf2e-59b4d84928e0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:26.050845 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 401/780] 10.222.0.85 () {56 vars in 1087 bytes} [Tue Aug 2 09:58:25 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:26.052033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1485f-cf14-4322-a1eb-0e08140295ea None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:26.052322 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1485f-cf14-4322-a1eb-0e08140295ea None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:26.052631 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1485f-cf14-4322-a1eb-0e08140295ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:26.072021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-02d1485f-cf14-4322-a1eb-0e08140295ea None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:26.080495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-02d1485f-cf14-4322-a1eb-0e08140295ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:26.081136 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 380/781] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:26.082324 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef607167-0066-4911-bf9a-7b8fbcf194bd None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:26.180773 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 402/782] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:26.182166 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1485f-cf14-4322-a1eb-0e08140295ea None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:26.239460 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef607167-0066-4911-bf9a-7b8fbcf194bd None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:26.242380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:26.279034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:26.289095 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d5d87-2f52-4bce-93af-a9518bda6a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:26.289821 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d5d87-2f52-4bce-93af-a9518bda6a42 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:26.290117 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d5d87-2f52-4bce-93af-a9518bda6a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:26.290518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d5d87-2f52-4bce-93af-a9518bda6a42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:26.291286 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d5d87-2f52-4bce-93af-a9518bda6a42 None admin] RBAC: Adding query filter params (interface=public, service_id=55f84abc4b8b4ccea0b84c3fc454fdc8, region_id=RegionOne) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:26.291598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d5d87-2f52-4bce-93af-a9518bda6a42 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:26.293010 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d5d87-2f52-4bce-93af-a9518bda6a42 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:26.306007 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 381/783] 10.222.0.85 () {56 vars in 1251 bytes} [Tue Aug 2 09:58:26 2022] GET /identity/v3/endpoints?service_id=55f84abc4b8b4ccea0b84c3fc454fdc8&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:26.307014 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d5d87-2f52-4bce-93af-a9518bda6a42 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:26.327315 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1485f-cf14-4322-a1eb-0e08140295ea None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:26.363555 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015690e4-a745-4759-95b0-057b4e371235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:26.364205 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015690e4-a745-4759-95b0-057b4e371235 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:26.364506 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015690e4-a745-4759-95b0-057b4e371235 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:26.364786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015690e4-a745-4759-95b0-057b4e371235 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:26.375665 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015690e4-a745-4759-95b0-057b4e371235 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:26.380664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-015690e4-a745-4759-95b0-057b4e371235 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:58:26.380664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:26.380664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:26.380664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:26.380664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:26.380664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:26.380664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:26.380664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:26.380664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:26.380664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:26.380664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:26.380664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:26.380664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:26.380664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:26.380664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:26.380664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:26.381591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:26.381591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:26.381591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:26.381591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:26.381591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:26.381591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:26.381591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:26.381591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:26.381591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:26.381591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:26.381591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:26.381591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:26.381591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:26.381591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:26.381591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:26.381591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:26.382469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:26.382469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:26.382469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:26.382469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:26.382469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:26.382469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:26.382469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:26.382469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:26.382469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:26.382469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:26.382469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:58:26.382469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:26.382469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 403/784] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:58:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:26.383422 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015690e4-a745-4759-95b0-057b4e371235 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:26.420913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d5d87-2f52-4bce-93af-a9518bda6a42 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:26.460271 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6649b9-f8bd-4c13-8632-8641de524306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:26.460967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6649b9-f8bd-4c13-8632-8641de524306 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:26.461252 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6649b9-f8bd-4c13-8632-8641de524306 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:26.461527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6649b9-f8bd-4c13-8632-8641de524306 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:26.474323 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6649b9-f8bd-4c13-8632-8641de524306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:26.480247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-ee6649b9-f8bd-4c13-8632-8641de524306 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:26.480247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:26.480247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:26.480247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:26.480247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:26.480247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:26.480247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:26.480247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:26.480247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:26.480247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:26.480247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:26.480247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:26.480247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:26.480247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:26.480247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:26.480247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:26.482900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:26.482900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:26.482900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:26.482900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:26.482900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:26.482900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:26.482900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:26.482900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:26.482900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:26.482900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:26.482900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:26.482900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:26.482900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:26.482900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:26.482900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:26.482900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:26.484906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:26.484906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:26.484906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:26.484906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:26.484906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:26.484906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:26.484906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:26.484906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:26.484906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:26.484906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:26.484906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:26.484906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:26.484906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 382/785] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:58:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:26.484906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6649b9-f8bd-4c13-8632-8641de524306 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:26.499500 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:26.502787 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015690e4-a745-4759-95b0-057b4e371235 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:26.539209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b397f-ba22-4eee-9cb6-4a123dbe8234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:26.539991 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b397f-ba22-4eee-9cb6-4a123dbe8234 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:26.540378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b397f-ba22-4eee-9cb6-4a123dbe8234 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:26.540779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b397f-ba22-4eee-9cb6-4a123dbe8234 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:26.541545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b397f-ba22-4eee-9cb6-4a123dbe8234 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:26.543049 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b397f-ba22-4eee-9cb6-4a123dbe8234 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:26.552613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:26.556769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 404/786] 10.222.0.85 () {56 vars in 1087 bytes} [Tue Aug 2 09:58:26 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:26.557784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b397f-ba22-4eee-9cb6-4a123dbe8234 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:26.605458 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6649b9-f8bd-4c13-8632-8641de524306 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:26.646271 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bcc10-0f4c-4148-b1ea-5b2377ffc3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:26.646895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bcc10-0f4c-4148-b1ea-5b2377ffc3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:26.647178 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bcc10-0f4c-4148-b1ea-5b2377ffc3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:26.647451 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bcc10-0f4c-4148-b1ea-5b2377ffc3c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:26.648182 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bcc10-0f4c-4148-b1ea-5b2377ffc3c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:26.648508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bcc10-0f4c-4148-b1ea-5b2377ffc3c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:26.649984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bcc10-0f4c-4148-b1ea-5b2377ffc3c9 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:26.661110 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 383/787] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:58:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:26.671705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bcc10-0f4c-4148-b1ea-5b2377ffc3c9 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:26.796519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bcc10-0f4c-4148-b1ea-5b2377ffc3c9 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:26.803003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b397f-ba22-4eee-9cb6-4a123dbe8234 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:26.819061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:26.844675 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2cca3-05f6-4c11-bdea-f5f84dd9e503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:26.845577 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2cca3-05f6-4c11-bdea-f5f84dd9e503 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:26.845858 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2cca3-05f6-4c11-bdea-f5f84dd9e503 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:26.846531 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2cca3-05f6-4c11-bdea-f5f84dd9e503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:26.859617 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa72dc-5462-4d42-9494-926e085fd770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:26.860626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa72dc-5462-4d42-9494-926e085fd770 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:26.861104 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa72dc-5462-4d42-9494-926e085fd770 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:26.861593 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa72dc-5462-4d42-9494-926e085fd770 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:26.862507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa72dc-5462-4d42-9494-926e085fd770 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:26.863029 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa72dc-5462-4d42-9494-926e085fd770 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:26.863810 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2cca3-05f6-4c11-bdea-f5f84dd9e503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:26.868492 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2cca3-05f6-4c11-bdea-f5f84dd9e503 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:26.869023 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa72dc-5462-4d42-9494-926e085fd770 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:26.888557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-bea2cca3-05f6-4c11-bdea-f5f84dd9e503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:26.888557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:26.888557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:26.888557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:26.888557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:26.888557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:26.888557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:26.888557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:26.888557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:26.888557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:26.888557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:26.888557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:26.888557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:26.888557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:26.888557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:26.889680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:26.889680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:26.889680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:26.889680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:26.889680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:26.889680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:26.889680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:26.889680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:26.889680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:26.889680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:26.889680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:26.889680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:26.889680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:26.889680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:26.889680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:26.889680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:26.889680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:26.890597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:26.890597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:26.890597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:26.890597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:26.890597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 384/788] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:26.890597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2cca3-05f6-4c11-bdea-f5f84dd9e503 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:26.893310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 405/789] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 09:58:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:26.899042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa72dc-5462-4d42-9494-926e085fd770 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:26.953972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:27.003476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2cca3-05f6-4c11-bdea-f5f84dd9e503 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:27.040284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06aea4d-9e6d-45d8-afcc-ce8e7ae9b961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:27.040973 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aea4d-9e6d-45d8-afcc-ce8e7ae9b961 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:27.041307 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aea4d-9e6d-45d8-afcc-ce8e7ae9b961 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:27.041586 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06aea4d-9e6d-45d8-afcc-ce8e7ae9b961 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:27.042293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06aea4d-9e6d-45d8-afcc-ce8e7ae9b961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:27.042598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06aea4d-9e6d-45d8-afcc-ce8e7ae9b961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:27.045135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06aea4d-9e6d-45d8-afcc-ce8e7ae9b961 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:27.072568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 385/790] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:27.072568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06aea4d-9e6d-45d8-afcc-ce8e7ae9b961 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:27.090847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa72dc-5462-4d42-9494-926e085fd770 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:27.104488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:27.179025 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06aea4d-9e6d-45d8-afcc-ce8e7ae9b961 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:27.185149 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d2ef0-1416-40a3-96b7-167d48b127e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:27.185808 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2ef0-1416-40a3-96b7-167d48b127e5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:27.186100 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2ef0-1416-40a3-96b7-167d48b127e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:27.186377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2ef0-1416-40a3-96b7-167d48b127e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:27.205119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d2ef0-1416-40a3-96b7-167d48b127e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:27.206688 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d2ef0-1416-40a3-96b7-167d48b127e5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:27.216420 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a120c56-f78a-427e-b018-2a7b255b0f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:27.216792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a120c56-f78a-427e-b018-2a7b255b0f3c None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:27.217071 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a120c56-f78a-427e-b018-2a7b255b0f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:27.217461 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a120c56-f78a-427e-b018-2a7b255b0f3c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:27.225073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a120c56-f78a-427e-b018-2a7b255b0f3c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:27.226572 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a120c56-f78a-427e-b018-2a7b255b0f3c None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:27.237073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-989d2ef0-1416-40a3-96b7-167d48b127e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:27.237073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:27.237073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:27.237073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:27.237073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:27.237073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:27.237073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:27.237073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:27.237073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:27.237073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:27.237073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:27.237073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:27.237073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:27.237073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:27.237073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:27.238005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:27.238005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:27.238005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:27.238005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:27.238005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:27.238005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:27.238005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:27.238005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:27.238005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:27.238005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:27.238005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:27.238005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:27.238005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:27.238005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:27.238005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:27.238005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:27.238005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:27.238874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:27.238874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:27.238874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:27.238874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:27.238874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 406/791] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:27.241352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-9a120c56-f78a-427e-b018-2a7b255b0f3c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:58:27.241352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:27.241352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:27.241352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:27.241352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:27.241352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:27.241352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:27.241352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:27.241352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:27.241352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:27.241352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:27.241352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:27.241352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:27.241352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:27.241352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:27.241352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:27.243032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:27.243032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:27.243032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:27.243032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:27.243032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:27.243032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:27.243032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:27.243032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:27.243032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:27.243032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:27.243032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:27.243032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:27.243032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:27.243032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:27.243032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:27.243032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:27.243032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:27.243032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:27.245281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:27.245281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:27.245281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:27.245281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:27.245281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:27.245281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:27.245281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:27.245281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:27.245281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:58:27.245281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:27.247215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d2ef0-1416-40a3-96b7-167d48b127e5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:27.247889 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 386/792] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:58:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:27.253441 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a120c56-f78a-427e-b018-2a7b255b0f3c None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:27.338697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:27.363292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d2ef0-1416-40a3-96b7-167d48b127e5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:27.399990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a58cbf-9580-4ab6-b86d-b903332ea47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:27.400649 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a58cbf-9580-4ab6-b86d-b903332ea47a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:27.400925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a58cbf-9580-4ab6-b86d-b903332ea47a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:27.401197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a58cbf-9580-4ab6-b86d-b903332ea47a None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:27.401894 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a58cbf-9580-4ab6-b86d-b903332ea47a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:27.402194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a58cbf-9580-4ab6-b86d-b903332ea47a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:27.404327 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a58cbf-9580-4ab6-b86d-b903332ea47a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:27.418138 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 407/793] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:27.424380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a58cbf-9580-4ab6-b86d-b903332ea47a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:27.472216 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:27.499325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a120c56-f78a-427e-b018-2a7b255b0f3c None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:27.577939 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7eaa8-79ab-4e80-a0aa-9fb743e64055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:27.578591 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7eaa8-79ab-4e80-a0aa-9fb743e64055 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:27.578880 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7eaa8-79ab-4e80-a0aa-9fb743e64055 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:27.579159 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7eaa8-79ab-4e80-a0aa-9fb743e64055 None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:27.579979 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7eaa8-79ab-4e80-a0aa-9fb743e64055 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:27.580292 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7eaa8-79ab-4e80-a0aa-9fb743e64055 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:27.581764 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7eaa8-79ab-4e80-a0aa-9fb743e64055 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:27.600558 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a58cbf-9580-4ab6-b86d-b903332ea47a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:27.619152 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 387/794] 10.222.0.85 () {56 vars in 1135 bytes} [Tue Aug 2 09:58:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:27.632784 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7eaa8-79ab-4e80-a0aa-9fb743e64055 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:27.642547 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2955c-181e-4c67-877e-74b0e793b451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:27.643195 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2955c-181e-4c67-877e-74b0e793b451 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:27.643471 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2955c-181e-4c67-877e-74b0e793b451 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:27.643799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2955c-181e-4c67-877e-74b0e793b451 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:27.651374 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2955c-181e-4c67-877e-74b0e793b451 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:27.653601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2955c-181e-4c67-877e-74b0e793b451 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:27.655388 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:27.667814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e8b2955c-181e-4c67-877e-74b0e793b451 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:58:27.667814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:27.667814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:27.667814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:27.667814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:27.667814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:27.667814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:27.667814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:27.667814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:27.667814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:27.667814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:27.667814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:27.667814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:27.667814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:27.667814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:27.667814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:27.670672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:27.670672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:27.670672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:27.670672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:27.670672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:27.670672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:27.670672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:27.670672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:27.670672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:27.670672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:27.670672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:27.670672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:27.670672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:27.670672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:27.670672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:27.670672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:27.670672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:27.670672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:27.672910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:27.672910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:27.672910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:27.672910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:27.672910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:27.672910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:27.672910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:27.672910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:27.672910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:58:27.672910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:27.672910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 408/795] 10.222.0.85 () {56 vars in 1117 bytes} [Tue Aug 2 09:58:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:27.680482 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2955c-181e-4c67-877e-74b0e793b451 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:27.800548 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7eaa8-79ab-4e80-a0aa-9fb743e64055 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:27.851139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53f92f-4bbf-458b-b3cc-5986293888c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:27.851702 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53f92f-4bbf-458b-b3cc-5986293888c7 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:27.851983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53f92f-4bbf-458b-b3cc-5986293888c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:27.852267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53f92f-4bbf-458b-b3cc-5986293888c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:27.877222 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53f92f-4bbf-458b-b3cc-5986293888c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:27.878788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53f92f-4bbf-458b-b3cc-5986293888c7 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:27.900883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:27.901836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2955c-181e-4c67-877e-74b0e793b451 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:27.913519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-8b53f92f-4bbf-458b-b3cc-5986293888c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:27.913519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:27.913519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:27.913519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:27.913519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:27.913519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:27.913519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:27.913519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:27.913519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:27.913519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:27.913519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:27.913519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:27.913519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:27.913519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:27.913519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:27.914455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:27.914455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:27.914455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:27.914455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:27.914455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:27.914455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:27.914455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:27.914455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:27.914455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:27.914455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:27.914455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:27.914455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:27.914455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:27.914455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:27.914455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:27.914455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:27.914455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:27.915727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:27.915727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:27.915727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:27.915727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:27.915727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 388/796] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:27.926477 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53f92f-4bbf-458b-b3cc-5986293888c7 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:27.966478 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5ddfd-f59d-4bed-a7e4-b8a074329f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:27.967036 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5ddfd-f59d-4bed-a7e4-b8a074329f71 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:27.967318 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5ddfd-f59d-4bed-a7e4-b8a074329f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:27.967590 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5ddfd-f59d-4bed-a7e4-b8a074329f71 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:27.968766 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5ddfd-f59d-4bed-a7e4-b8a074329f71 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:27.969074 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5ddfd-f59d-4bed-a7e4-b8a074329f71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:27.970939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5ddfd-f59d-4bed-a7e4-b8a074329f71 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:27.999531 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 409/797] 10.222.0.85 () {56 vars in 1149 bytes} [Tue Aug 2 09:58:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:27.999531 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac359a4-c650-4912-95c1-40a5ec62c39a None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:27.999531 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac359a4-c650-4912-95c1-40a5ec62c39a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:27.999531 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac359a4-c650-4912-95c1-40a5ec62c39a None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:27.999531 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 410/798] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:28.003512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac359a4-c650-4912-95c1-40a5ec62c39a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:28.063198 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53f92f-4bbf-458b-b3cc-5986293888c7 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:28.086845 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:28.118364 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e65491-110b-4e0d-bdc1-012480cfa2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:28.118918 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e65491-110b-4e0d-bdc1-012480cfa2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:28.119207 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e65491-110b-4e0d-bdc1-012480cfa2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:28.119489 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e65491-110b-4e0d-bdc1-012480cfa2e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:28.120199 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e65491-110b-4e0d-bdc1-012480cfa2e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:28.120527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e65491-110b-4e0d-bdc1-012480cfa2e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:28.123053 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e65491-110b-4e0d-bdc1-012480cfa2e8 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:28.144493 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 389/799] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:28.144493 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc950653-cc7c-4d86-ab62-c65a0abb8e34 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:28.144493 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc950653-cc7c-4d86-ab62-c65a0abb8e34 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:28.144493 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc950653-cc7c-4d86-ab62-c65a0abb8e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:28.159219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac359a4-c650-4912-95c1-40a5ec62c39a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:28.168193 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-fc950653-cc7c-4d86-ab62-c65a0abb8e34 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:28.170637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-fc950653-cc7c-4d86-ab62-c65a0abb8e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:28.207272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b04c3-06c7-4de4-9eb1-dffaa276182d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:28.208614 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b04c3-06c7-4de4-9eb1-dffaa276182d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:28.209348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b04c3-06c7-4de4-9eb1-dffaa276182d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:28.210225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b04c3-06c7-4de4-9eb1-dffaa276182d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:28.224489 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b04c3-06c7-4de4-9eb1-dffaa276182d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:28.226268 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b04c3-06c7-4de4-9eb1-dffaa276182d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:28.245893 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:28.251719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-426b04c3-06c7-4de4-9eb1-dffaa276182d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:28.251719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:28.251719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:28.251719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:28.251719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:28.251719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:28.251719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:28.251719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:28.251719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:28.251719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:28.251719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:28.251719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:28.251719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:28.251719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:28.251719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:28.252609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:28.252609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:28.252609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:28.252609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:28.252609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:28.252609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:28.252609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:28.252609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:28.252609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:28.252609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:28.252609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:28.252609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:28.252609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:28.252609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:28.252609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:28.252609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:28.252609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:28.253504 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:28.253504 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:28.253504 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:28.253504 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:28.260324 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 411/800] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:28.260324 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b04c3-06c7-4de4-9eb1-dffaa276182d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:28.268743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 390/801] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:28.269601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc950653-cc7c-4d86-ab62-c65a0abb8e34 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:28.389089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b04c3-06c7-4de4-9eb1-dffaa276182d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:28.399115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:28.426545 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc950653-cc7c-4d86-ab62-c65a0abb8e34 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:28.427178 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5384d2-abda-4686-9f8f-b68744d741a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:28.427889 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5384d2-abda-4686-9f8f-b68744d741a6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:28.428226 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5384d2-abda-4686-9f8f-b68744d741a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:28.428527 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5384d2-abda-4686-9f8f-b68744d741a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:28.436493 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5384d2-abda-4686-9f8f-b68744d741a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:28.437973 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5384d2-abda-4686-9f8f-b68744d741a6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:28.452428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5d5384d2-abda-4686-9f8f-b68744d741a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:28.452428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:28.452428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:28.452428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:28.452428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:28.452428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:28.452428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:28.452428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:28.452428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:28.452428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:28.452428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:28.452428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:28.452428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:28.452428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:28.452428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:28.453381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:28.453381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:28.453381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:28.453381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:28.453381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:28.453381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:28.453381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:28.453381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:28.453381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:28.453381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:28.453381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:28.453381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:28.453381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:28.453381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:28.453381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:28.453381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:28.453381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:28.454850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:28.454850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:28.454850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:28.454850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:28.454850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:28.454850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:28.454850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:28.454850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:28.454850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 412/802] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:28.454850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5384d2-abda-4686-9f8f-b68744d741a6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:28.474070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaa720-add9-45c7-9474-de6f92d4d3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:28.475185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaa720-add9-45c7-9474-de6f92d4d3db None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:28.475636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaa720-add9-45c7-9474-de6f92d4d3db None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:28.476210 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eaa720-add9-45c7-9474-de6f92d4d3db None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:28.477374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eaa720-add9-45c7-9474-de6f92d4d3db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:28.477826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eaa720-add9-45c7-9474-de6f92d4d3db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:28.479335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eaa720-add9-45c7-9474-de6f92d4d3db None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:28.497138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 391/803] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:28.502355 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaa720-add9-45c7-9474-de6f92d4d3db None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:28.561234 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:28.571517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5384d2-abda-4686-9f8f-b68744d741a6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:28.607217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94d1d7-e262-4acf-80f2-75f1ed9eb079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:28.608125 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94d1d7-e262-4acf-80f2-75f1ed9eb079 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:28.608618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94d1d7-e262-4acf-80f2-75f1ed9eb079 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:28.608898 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94d1d7-e262-4acf-80f2-75f1ed9eb079 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:28.617434 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eaa720-add9-45c7-9474-de6f92d4d3db None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:28.619131 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94d1d7-e262-4acf-80f2-75f1ed9eb079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:28.625243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-aa94d1d7-e262-4acf-80f2-75f1ed9eb079 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:58:28.625243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:28.625243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:28.625243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:28.625243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:28.625243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:28.625243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:28.625243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:28.625243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:28.625243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:28.625243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:28.625243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:28.625243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:28.625243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:28.625243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:28.625243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:28.626356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:28.626356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:28.626356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:28.626356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:28.626356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:28.626356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:28.626356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:28.626356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:28.626356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:28.626356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:28.626356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:28.626356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:28.626356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:28.626356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:28.626356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:28.626356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:28.627193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:28.627193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:28.627193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:28.627193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:28.627193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:28.627193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:28.627193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:28.627193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:28.627193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:28.627193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:28.627193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:58:28.627193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:28.627193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 413/804] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:58:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:28.627193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94d1d7-e262-4acf-80f2-75f1ed9eb079 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:28.660661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:28.662122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60d450f-499d-4245-8422-0bbb9a771315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:28.663274 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d450f-499d-4245-8422-0bbb9a771315 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:28.663786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d450f-499d-4245-8422-0bbb9a771315 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:28.664212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d450f-499d-4245-8422-0bbb9a771315 None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:28.665145 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d450f-499d-4245-8422-0bbb9a771315 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:28.665602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d450f-499d-4245-8422-0bbb9a771315 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:28.667206 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60d450f-499d-4245-8422-0bbb9a771315 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:28.686676 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 392/805] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:28.688331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4779da4-443d-44c2-84a4-071d69329977 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:28.688647 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4779da4-443d-44c2-84a4-071d69329977 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:28.688928 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4779da4-443d-44c2-84a4-071d69329977 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:28.690524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 393/806] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:28.693258 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4779da4-443d-44c2-84a4-071d69329977 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:28.742709 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94d1d7-e262-4acf-80f2-75f1ed9eb079 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:28.782289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7b85f-4a58-4315-a115-c8d71394b451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:28.783551 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7b85f-4a58-4315-a115-c8d71394b451 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:28.784051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7b85f-4a58-4315-a115-c8d71394b451 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:28.784536 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7b85f-4a58-4315-a115-c8d71394b451 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:28.791806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7b85f-4a58-4315-a115-c8d71394b451 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:28.793585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7b85f-4a58-4315-a115-c8d71394b451 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:28.805357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-58c7b85f-4a58-4315-a115-c8d71394b451 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:28.805357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:28.805357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:28.805357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:28.805357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:28.805357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:28.805357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:28.805357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:28.805357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:28.805357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:28.805357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:28.805357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:28.805357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:28.805357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:28.805357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:28.806292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:28.806292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:28.806292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:28.806292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:28.806292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:28.806292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:28.806292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:28.806292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:28.806292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:28.806292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:28.806292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:28.806292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:28.806292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:28.806292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:28.806292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:28.806292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:28.806292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:28.807201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:28.807201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:28.807201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:28.807201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:28.807201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:28.807201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:28.807201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:28.807201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:28.808360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4779da4-443d-44c2-84a4-071d69329977 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:28.811871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 414/807] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:28.812784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7b85f-4a58-4315-a115-c8d71394b451 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:28.817934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:28.845597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a478e0e-5a70-42bf-9d30-77cd6e95919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:28.846213 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a478e0e-5a70-42bf-9d30-77cd6e95919e None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:28.846499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a478e0e-5a70-42bf-9d30-77cd6e95919e None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:28.846776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a478e0e-5a70-42bf-9d30-77cd6e95919e None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:28.847490 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a478e0e-5a70-42bf-9d30-77cd6e95919e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:28.847796 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a478e0e-5a70-42bf-9d30-77cd6e95919e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:28.849194 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a478e0e-5a70-42bf-9d30-77cd6e95919e None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:28.858580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 394/808] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:58:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:28.859613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e41503-1610-4a39-9e2d-fd2e4b5f5a86 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:28.859903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e41503-1610-4a39-9e2d-fd2e4b5f5a86 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:28.860183 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e41503-1610-4a39-9e2d-fd2e4b5f5a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:28.881833 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-d9e41503-1610-4a39-9e2d-fd2e4b5f5a86 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:28.883845 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-d9e41503-1610-4a39-9e2d-fd2e4b5f5a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:28.918159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:28.931168 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7b85f-4a58-4315-a115-c8d71394b451 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:28.958339 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 395/809] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:28.958979 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e41503-1610-4a39-9e2d-fd2e4b5f5a86 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:28.976730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa07eb-3db9-43c4-b799-20b28ef75faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:28.977897 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa07eb-3db9-43c4-b799-20b28ef75faf None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:28.978723 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa07eb-3db9-43c4-b799-20b28ef75faf None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:28.979151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa07eb-3db9-43c4-b799-20b28ef75faf None admin] PATH_INFO: `/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/e9cfed2469a7419f8fcbe09d25cb896e/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:28.982014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa07eb-3db9-43c4-b799-20b28ef75faf None admin] RBAC: Authorizing `identity:create_grant(project_id=701d7ad0b7594984885e7bfe8a236937, user_id=e9cfed2469a7419f8fcbe09d25cb896e, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:28.983928 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa07eb-3db9-43c4-b799-20b28ef75faf None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:29.001378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 415/810] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:58:28 2022] PUT /identity/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/e9cfed2469a7419f8fcbe09d25cb896e/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:58:29.002509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa07eb-3db9-43c4-b799-20b28ef75faf None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:29.082800 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:29.086464 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e41503-1610-4a39-9e2d-fd2e4b5f5a86 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:29.130068 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f3487-4d23-4363-8b79-da17865c79d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:29.131048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f3487-4d23-4363-8b79-da17865c79d9 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:29.131334 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f3487-4d23-4363-8b79-da17865c79d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:29.131898 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f3487-4d23-4363-8b79-da17865c79d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:29.132967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f3487-4d23-4363-8b79-da17865c79d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:29.133282 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f3487-4d23-4363-8b79-da17865c79d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:29.134035 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa07eb-3db9-43c4-b799-20b28ef75faf None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:29.134917 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f3487-4d23-4363-8b79-da17865c79d9 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:29.150191 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 396/811] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:29.151172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f3487-4d23-4363-8b79-da17865c79d9 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:29.183346 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6105d8-c967-48bb-be73-9839dc823cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:29.184977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6105d8-c967-48bb-be73-9839dc823cbd None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:29.185280 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6105d8-c967-48bb-be73-9839dc823cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:29.185743 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6105d8-c967-48bb-be73-9839dc823cbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:29.198573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6105d8-c967-48bb-be73-9839dc823cbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:29.200755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6105d8-c967-48bb-be73-9839dc823cbd None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:29.211064 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:29.220400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-1f6105d8-c967-48bb-be73-9839dc823cbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:29.220400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:29.220400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:29.220400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:29.220400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:29.220400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:29.220400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:29.220400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:29.220400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:29.220400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:29.220400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:29.220400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:29.220400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:29.220400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:29.220400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:29.221655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:29.221655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:29.221655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:29.221655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:29.221655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:29.221655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:29.221655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:29.221655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:29.221655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:29.221655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:29.221655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:29.221655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:29.221655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:29.221655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:29.221655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:29.221655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:29.221655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:29.222743 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:29.222743 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:29.222743 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:29.222743 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:29.228498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 416/812] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:29.228498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b35e9c-f555-4b9b-8982-0fd86a4c2f5d None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:29.228498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b35e9c-f555-4b9b-8982-0fd86a4c2f5d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:29.228498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b35e9c-f555-4b9b-8982-0fd86a4c2f5d None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:29.231589 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 417/813] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:29.232607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b35e9c-f555-4b9b-8982-0fd86a4c2f5d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:29.274321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f3487-4d23-4363-8b79-da17865c79d9 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:29.313933 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca930d4-bcab-4367-80b8-8f500fd8aab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:29.314582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca930d4-bcab-4367-80b8-8f500fd8aab3 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:29.314869 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca930d4-bcab-4367-80b8-8f500fd8aab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:29.315145 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca930d4-bcab-4367-80b8-8f500fd8aab3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:29.315777 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca930d4-bcab-4367-80b8-8f500fd8aab3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:29.317222 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca930d4-bcab-4367-80b8-8f500fd8aab3 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:29.329466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-fca930d4-bcab-4367-80b8-8f500fd8aab3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 09:58:29.329466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:29.329466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:29.329466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:29.329466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:29.329466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:29.329466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:29.329466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:29.329466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 09:58:29.329466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:29.329466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:29.329466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:29.329466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:29.329466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:29.329466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:29.329466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:29.329466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:29.330487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:29.330487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:29.330487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:29.330487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:29.330487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:29.330487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:29.330487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:29.330487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:29.330487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:29.330487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:29.330487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:29.330487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:29.330487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:29.330487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:29.330487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:29.330487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:29.331407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:29.331407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:29.331407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:29.331407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:29.331407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:29.331407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:29.331407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:29.331407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:29.331407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:29.331407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:29.331407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:29.331407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:29.331407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 09:58:29.331407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:29.331407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 397/814] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:29 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:29.332192 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca930d4-bcab-4367-80b8-8f500fd8aab3 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:29.359599 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b35e9c-f555-4b9b-8982-0fd86a4c2f5d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:29.361783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:29.398452 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1f0a4-d37d-4ce6-a359-f6f33b697273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:29.399313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1f0a4-d37d-4ce6-a359-f6f33b697273 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:29.399594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1f0a4-d37d-4ce6-a359-f6f33b697273 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:29.399866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1f0a4-d37d-4ce6-a359-f6f33b697273 None admin] PATH_INFO: `/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/f43a16e2dcab4872963222c557853d32/roles/e30f587367384737a72bbcc2e35d62ad` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:29.415553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1f0a4-d37d-4ce6-a359-f6f33b697273 None admin] RBAC: Authorizing `identity:create_grant(project_id=701d7ad0b7594984885e7bfe8a236937, user_id=f43a16e2dcab4872963222c557853d32, role_id=e30f587367384737a72bbcc2e35d62ad)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:29.417027 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1f0a4-d37d-4ce6-a359-f6f33b697273 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:29.434019 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 418/815] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:58:29 2022] PUT /identity/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/f43a16e2dcab4872963222c557853d32/roles/e30f587367384737a72bbcc2e35d62ad => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:58:29.436859 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3704fdb-4447-45f6-9973-711d2dfbfcee None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:29.437411 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3704fdb-4447-45f6-9973-711d2dfbfcee None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:29.438130 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3704fdb-4447-45f6-9973-711d2dfbfcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:29.450189 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca930d4-bcab-4367-80b8-8f500fd8aab3 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:29.464438 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b3704fdb-4447-45f6-9973-711d2dfbfcee None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:29.467546 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b3704fdb-4447-45f6-9973-711d2dfbfcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:29.495619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62da8c1-2d04-497d-b5dc-4c4e1e703f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:29.497343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62da8c1-2d04-497d-b5dc-4c4e1e703f3a None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:29.498609 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62da8c1-2d04-497d-b5dc-4c4e1e703f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:29.499119 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62da8c1-2d04-497d-b5dc-4c4e1e703f3a None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:29.500413 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62da8c1-2d04-497d-b5dc-4c4e1e703f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:29.501384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62da8c1-2d04-497d-b5dc-4c4e1e703f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:29.503902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62da8c1-2d04-497d-b5dc-4c4e1e703f3a None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:29.523134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 398/816] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:29.524998 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62da8c1-2d04-497d-b5dc-4c4e1e703f3a None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:29.533027 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:29.564505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 419/817] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:29.564505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3704fdb-4447-45f6-9973-711d2dfbfcee None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:29.659416 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:29.678477 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62da8c1-2d04-497d-b5dc-4c4e1e703f3a None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:29.708521 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3704fdb-4447-45f6-9973-711d2dfbfcee None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:29.716108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61215e2-70ab-4c11-ab37-a19cd12707b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:29.717086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61215e2-70ab-4c11-ab37-a19cd12707b0 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:29.717572 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61215e2-70ab-4c11-ab37-a19cd12707b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:29.718073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61215e2-70ab-4c11-ab37-a19cd12707b0 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:29.718956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61215e2-70ab-4c11-ab37-a19cd12707b0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:29.719461 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61215e2-70ab-4c11-ab37-a19cd12707b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:29.721074 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61215e2-70ab-4c11-ab37-a19cd12707b0 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:29.726820 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 399/818] 10.222.0.85 () {56 vars in 1112 bytes} [Tue Aug 2 09:58:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:29.728006 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61215e2-70ab-4c11-ab37-a19cd12707b0 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:29.755964 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153dca8-caf9-4ce9-9369-d7efeab1c70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:29.756697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153dca8-caf9-4ce9-9369-d7efeab1c70f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:29.756983 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153dca8-caf9-4ce9-9369-d7efeab1c70f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:29.757498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153dca8-caf9-4ce9-9369-d7efeab1c70f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:29.766066 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153dca8-caf9-4ce9-9369-d7efeab1c70f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:29.767552 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153dca8-caf9-4ce9-9369-d7efeab1c70f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:29.780115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-f153dca8-caf9-4ce9-9369-d7efeab1c70f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:58:29.780115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:29.780115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:29.780115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:29.780115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:29.780115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:29.780115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:29.780115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:29.780115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:29.780115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:29.780115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:29.780115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:29.780115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:29.780115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:29.780115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:29.780115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:29.781126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:29.781126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:29.781126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:29.781126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:29.781126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:29.781126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:29.781126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:29.781126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:29.781126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:29.781126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:29.781126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:29.781126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:29.781126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:29.781126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:29.781126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:29.781126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:29.781126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:29.781126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:29.782042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:29.782042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:29.782042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:29.782042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:29.782042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:29.782042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:29.782042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:29.782042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:29.782042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:58:29.782042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:29.786248 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 420/819] 10.222.0.85 () {56 vars in 1093 bytes} [Tue Aug 2 09:58:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:29.787115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153dca8-caf9-4ce9-9369-d7efeab1c70f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:29.836495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:29.867530 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61215e2-70ab-4c11-ab37-a19cd12707b0 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:29.898664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153dca8-caf9-4ce9-9369-d7efeab1c70f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:29.906294 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a1477-bbc5-46bb-83c1-f9d5b53f6862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:29.906947 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a1477-bbc5-46bb-83c1-f9d5b53f6862 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:29.907232 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a1477-bbc5-46bb-83c1-f9d5b53f6862 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:29.907512 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a1477-bbc5-46bb-83c1-f9d5b53f6862 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:29.908321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a1477-bbc5-46bb-83c1-f9d5b53f6862 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:29.909843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a1477-bbc5-46bb-83c1-f9d5b53f6862 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:29.920131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-cf4a1477-bbc5-46bb-83c1-f9d5b53f6862 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 09:58:29.920131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:29.920131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:29.920131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:29.920131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:29.920131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:29.920131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:29.920131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:29.920131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 09:58:29.920131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:29.920131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:29.920131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:29.920131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:29.920131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:29.920131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:29.920131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:29.921106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:29.921106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:29.921106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:29.921106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:29.921106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:29.921106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:29.921106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:29.921106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:29.921106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:29.921106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:29.921106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:29.921106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:29.921106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:29.921106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:29.921106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:29.921106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:29.921950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:29.921950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:29.921950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:29.921950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:29.921950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:29.921950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:29.921950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:29.921950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:29.921950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:29.921950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:29.921950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:29.921950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:29.921950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:29.921950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 09:58:29.921950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:29.926325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 400/820] 10.222.0.85 () {56 vars in 1129 bytes} [Tue Aug 2 09:58:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:29.927269 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a1477-bbc5-46bb-83c1-f9d5b53f6862 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:29.935538 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805ddda-9708-4c5f-a82a-93062b5abfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:29.936156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805ddda-9708-4c5f-a82a-93062b5abfa5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:29.936435 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805ddda-9708-4c5f-a82a-93062b5abfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:29.936738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805ddda-9708-4c5f-a82a-93062b5abfa5 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:29.937417 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805ddda-9708-4c5f-a82a-93062b5abfa5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:29.937719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805ddda-9708-4c5f-a82a-93062b5abfa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:29.939147 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805ddda-9708-4c5f-a82a-93062b5abfa5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:29.944796 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:29.949000 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 421/821] 10.222.0.85 () {56 vars in 1112 bytes} [Tue Aug 2 09:58:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:29.949946 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805ddda-9708-4c5f-a82a-93062b5abfa5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:30.034306 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a1477-bbc5-46bb-83c1-f9d5b53f6862 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:30.055390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805ddda-9708-4c5f-a82a-93062b5abfa5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:30.057783 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:30.073692 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5defdde-8373-4249-b73f-88d680ef73f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:30.075331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5defdde-8373-4249-b73f-88d680ef73f8 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:30.075777 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5defdde-8373-4249-b73f-88d680ef73f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:30.076198 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5defdde-8373-4249-b73f-88d680ef73f8 None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:30.077176 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5defdde-8373-4249-b73f-88d680ef73f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:30.077640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5defdde-8373-4249-b73f-88d680ef73f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:30.079293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5defdde-8373-4249-b73f-88d680ef73f8 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:30.093138 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b9044-a9dd-4ee3-ae44-27731eeb7971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:30.093754 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b9044-a9dd-4ee3-ae44-27731eeb7971 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:30.094030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b9044-a9dd-4ee3-ae44-27731eeb7971 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:30.094300 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b9044-a9dd-4ee3-ae44-27731eeb7971 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:30.094977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b9044-a9dd-4ee3-ae44-27731eeb7971 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:30.095278 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b9044-a9dd-4ee3-ae44-27731eeb7971 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:30.096761 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b9044-a9dd-4ee3-ae44-27731eeb7971 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:30.100150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 401/822] 10.222.0.85 () {56 vars in 1133 bytes} [Tue Aug 2 09:58:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:30.101162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5defdde-8373-4249-b73f-88d680ef73f8 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:30.111027 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 422/823] 10.222.0.85 () {56 vars in 1124 bytes} [Tue Aug 2 09:58:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:30.113057 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b9044-a9dd-4ee3-ae44-27731eeb7971 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:30.183487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:30.219096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5defdde-8373-4249-b73f-88d680ef73f8 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:30.232497 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b9044-a9dd-4ee3-ae44-27731eeb7971 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:30.257755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb286ae4-d1a8-4508-b947-0a23828e0c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:30.258915 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb286ae4-d1a8-4508-b947-0a23828e0c73 None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:30.259451 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb286ae4-d1a8-4508-b947-0a23828e0c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:30.260094 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb286ae4-d1a8-4508-b947-0a23828e0c73 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:30.261051 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb286ae4-d1a8-4508-b947-0a23828e0c73 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:30.263622 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb286ae4-d1a8-4508-b947-0a23828e0c73 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:30.270951 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbb672-4574-42d5-b888-306b11920da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:30.271570 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbb672-4574-42d5-b888-306b11920da1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:30.271887 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbb672-4574-42d5-b888-306b11920da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:30.272339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbb672-4574-42d5-b888-306b11920da1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:30.300983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 402/824] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 09:58:30 2022] POST /identity/v3/endpoints => generated 337 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:58:30.302806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb286ae4-d1a8-4508-b947-0a23828e0c73 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:30.331684 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:30.395350 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbb672-4574-42d5-b888-306b11920da1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:30.396826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbb672-4574-42d5-b888-306b11920da1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:30.454945 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb286ae4-d1a8-4508-b947-0a23828e0c73 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:30.511034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:30.524612 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 423/825] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:58:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 09:58:30.526492 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddeac33-81c1-4153-ac03-a116fbb000eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:30.526861 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbb672-4574-42d5-b888-306b11920da1 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:30.527810 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeac33-81c1-4153-ac03-a116fbb000eb None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:30.528091 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeac33-81c1-4153-ac03-a116fbb000eb None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:30.528543 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddeac33-81c1-4153-ac03-a116fbb000eb None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:30.529334 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddeac33-81c1-4153-ac03-a116fbb000eb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:30.529818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddeac33-81c1-4153-ac03-a116fbb000eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:30.531454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddeac33-81c1-4153-ac03-a116fbb000eb None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:30.537544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 403/826] 10.222.0.85 () {56 vars in 1124 bytes} [Tue Aug 2 09:58:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:30.543526 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddeac33-81c1-4153-ac03-a116fbb000eb None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:30.624032 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:30.669081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbb672-4574-42d5-b888-306b11920da1 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:30.676663 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddeac33-81c1-4153-ac03-a116fbb000eb None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:30.710441 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696970c-18e5-4be5-9c24-d96fdf212fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:30.711142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696970c-18e5-4be5-9c24-d96fdf212fbe None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:30.711427 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696970c-18e5-4be5-9c24-d96fdf212fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:30.711791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696970c-18e5-4be5-9c24-d96fdf212fbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:30.716220 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6802a01-b44d-4d4b-8a02-7143eef1cf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:30.716878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6802a01-b44d-4d4b-8a02-7143eef1cf2c None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:30.717158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6802a01-b44d-4d4b-8a02-7143eef1cf2c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:30.717432 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6802a01-b44d-4d4b-8a02-7143eef1cf2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:30.718159 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6802a01-b44d-4d4b-8a02-7143eef1cf2c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:30.719542 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6802a01-b44d-4d4b-8a02-7143eef1cf2c None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:30.725920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696970c-18e5-4be5-9c24-d96fdf212fbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:30.727580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696970c-18e5-4be5-9c24-d96fdf212fbe None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:30.743392 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 404/827] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 09:58:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:58:30.750733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5696970c-18e5-4be5-9c24-d96fdf212fbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:30.750733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:30.750733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:30.750733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:30.750733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:30.750733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:30.750733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:30.750733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:30.750733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:30.750733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:30.750733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:30.750733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:30.750733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:30.750733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:30.750733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:30.751718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:30.751718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:30.751718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:30.751718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:30.751718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:30.751718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:30.751718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:30.751718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:30.751718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:30.751718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:30.751718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:30.751718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:30.751718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:30.751718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:30.751718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:30.751718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:30.751718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:30.754074 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:30.754074 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:30.754074 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:30.754074 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:30.754074 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 424/828] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:30.759958 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6802a01-b44d-4d4b-8a02-7143eef1cf2c None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:30.815963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:30.895541 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6802a01-b44d-4d4b-8a02-7143eef1cf2c None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:30.933310 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d29c27-1481-46ad-bd5d-f6c2bd7b0151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:30.934634 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d29c27-1481-46ad-bd5d-f6c2bd7b0151 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:30.935316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d29c27-1481-46ad-bd5d-f6c2bd7b0151 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:30.935816 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d29c27-1481-46ad-bd5d-f6c2bd7b0151 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:30.937136 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d29c27-1481-46ad-bd5d-f6c2bd7b0151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:30.937682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d29c27-1481-46ad-bd5d-f6c2bd7b0151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:30.940231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d29c27-1481-46ad-bd5d-f6c2bd7b0151 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:30.960167 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 405/829] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:30.962230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696970c-18e5-4be5-9c24-d96fdf212fbe None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:31.073208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696970c-18e5-4be5-9c24-d96fdf212fbe None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:31.096568 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:31.111964 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf584ad-9121-409b-a49a-15a13078d3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:31.112867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf584ad-9121-409b-a49a-15a13078d3fe None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:31.113214 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf584ad-9121-409b-a49a-15a13078d3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:31.113648 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf584ad-9121-409b-a49a-15a13078d3fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:31.120769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf584ad-9121-409b-a49a-15a13078d3fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:31.123022 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf584ad-9121-409b-a49a-15a13078d3fe None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:31.135539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-9cf584ad-9121-409b-a49a-15a13078d3fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:31.135539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:31.135539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:31.135539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:31.135539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:31.135539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:31.135539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:31.135539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:31.135539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:31.135539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:31.135539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:31.135539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:31.135539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:31.135539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:31.135539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:31.136653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:31.136653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:31.136653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:31.136653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:31.136653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:31.136653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:31.136653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:31.136653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:31.136653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:31.136653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:31.136653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:31.136653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:31.136653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:31.136653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:31.136653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:31.136653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:31.136653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:31.138588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:31.138588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:31.138588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:31.138588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:31.138588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:31.138588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:31.138588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:31.138588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:31.138588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 425/830] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:31.144888 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d29c27-1481-46ad-bd5d-f6c2bd7b0151 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:31.205054 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ea04d-717a-4f80-8632-09a00d61785a None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:31.205481 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ea04d-717a-4f80-8632-09a00d61785a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:31.205776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ea04d-717a-4f80-8632-09a00d61785a None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:31.207654 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 426/831] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:31.212942 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549893fa-fecc-43db-852c-7ff901425d96 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:31.213351 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549893fa-fecc-43db-852c-7ff901425d96 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:31.213727 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549893fa-fecc-43db-852c-7ff901425d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:31.237301 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-549893fa-fecc-43db-852c-7ff901425d96 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:31.238920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-549893fa-fecc-43db-852c-7ff901425d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:31.252769 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:31.258531 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d29c27-1481-46ad-bd5d-f6c2bd7b0151 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:31.316908 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a74cd7-018f-4bc4-8884-3c27a93da0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:31.318925 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a74cd7-018f-4bc4-8884-3c27a93da0cf None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:31.319554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a74cd7-018f-4bc4-8884-3c27a93da0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:31.320118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a74cd7-018f-4bc4-8884-3c27a93da0cf None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:31.321101 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a74cd7-018f-4bc4-8884-3c27a93da0cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:31.321596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a74cd7-018f-4bc4-8884-3c27a93da0cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:31.323329 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a74cd7-018f-4bc4-8884-3c27a93da0cf None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:31.323859 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 427/832] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:58:31.344279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 406/833] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:31.350234 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549893fa-fecc-43db-852c-7ff901425d96 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:31.351366 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a74cd7-018f-4bc4-8884-3c27a93da0cf None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:31.457701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549893fa-fecc-43db-852c-7ff901425d96 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:31.468992 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a74cd7-018f-4bc4-8884-3c27a93da0cf None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:31.470668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:31.495532 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a3edb-7b05-4fce-982d-b63e3695d93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:31.496412 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a3edb-7b05-4fce-982d-b63e3695d93a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:31.496922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a3edb-7b05-4fce-982d-b63e3695d93a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:31.497206 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a3edb-7b05-4fce-982d-b63e3695d93a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:31.508225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a3edb-7b05-4fce-982d-b63e3695d93a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:31.510959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a72987-7225-4846-8d69-444733f788c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:31.512337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a72987-7225-4846-8d69-444733f788c4 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:31.512876 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a72987-7225-4846-8d69-444733f788c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:31.513463 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a72987-7225-4846-8d69-444733f788c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:31.514235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-f16a3edb-7b05-4fce-982d-b63e3695d93a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:58:31.514235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:31.514235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:31.514235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:31.514235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:31.514235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:31.514235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:31.514235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:31.514235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:31.514235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:31.514235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:31.514235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:31.514235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:31.514235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:31.514235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:31.514235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:31.515144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:31.515144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:31.515144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:31.515144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:31.515144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:31.515144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:31.515144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:31.515144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:31.515144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:31.515144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:31.515144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:31.515144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:31.515144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:31.515144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:31.515144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:31.515144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:31.516005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:31.516005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:31.516005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:31.516005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:31.516005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:31.516005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:31.516005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:31.516005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:31.516005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:31.516005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:31.516005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:58:31.516005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:31.517635 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a72987-7225-4846-8d69-444733f788c4 None admin] RBAC: Adding query filter params (role.id=c15ca78eb3c9472f94e15e2d28c7f403, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=310867deefd34a598cfef2f3e4245ace) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:31.518153 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a72987-7225-4846-8d69-444733f788c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:31.519827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a72987-7225-4846-8d69-444733f788c4 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:31.520603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 428/834] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:58:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:31.521493 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a3edb-7b05-4fce-982d-b63e3695d93a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:31.532628 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 407/835] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:58:31 2022] GET /identity/v3/role_assignments?user.id=310867deefd34a598cfef2f3e4245ace&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=c15ca78eb3c9472f94e15e2d28c7f403 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:31.640492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a3edb-7b05-4fce-982d-b63e3695d93a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:31.680047 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3c0e6-149f-4931-bdf1-4d5e2bc8c6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:31.680705 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3c0e6-149f-4931-bdf1-4d5e2bc8c6ce None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:31.680986 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3c0e6-149f-4931-bdf1-4d5e2bc8c6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:31.681260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3c0e6-149f-4931-bdf1-4d5e2bc8c6ce None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:31.681995 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3c0e6-149f-4931-bdf1-4d5e2bc8c6ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:31.682299 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3c0e6-149f-4931-bdf1-4d5e2bc8c6ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:31.684084 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3c0e6-149f-4931-bdf1-4d5e2bc8c6ce None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:31.694349 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 429/836] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:58:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:31.701154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a72987-7225-4846-8d69-444733f788c4 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:31.701317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8955045-c5de-49c8-8669-2cff3f8851b4 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:31.701512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8955045-c5de-49c8-8669-2cff3f8851b4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:31.701776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8955045-c5de-49c8-8669-2cff3f8851b4 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:31.703311 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 430/837] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:31.708444 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af963ca-21b2-4150-a201-f9e55da1fcdf None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:31.708611 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af963ca-21b2-4150-a201-f9e55da1fcdf None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:31.708806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af963ca-21b2-4150-a201-f9e55da1fcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:31.731129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4af963ca-21b2-4150-a201-f9e55da1fcdf None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:31.732391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4af963ca-21b2-4150-a201-f9e55da1fcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:31.734751 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:31.764555 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:31.827143 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 431/838] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:58:31.836351 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a72987-7225-4846-8d69-444733f788c4 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:31.851570 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af963ca-21b2-4150-a201-f9e55da1fcdf None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:31.878942 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d9245-e172-4643-ab5b-8a2ac9dc1b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:31.880088 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d9245-e172-4643-ab5b-8a2ac9dc1b46 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:31.880569 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d9245-e172-4643-ab5b-8a2ac9dc1b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:31.881131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d9245-e172-4643-ab5b-8a2ac9dc1b46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:31.895553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d9245-e172-4643-ab5b-8a2ac9dc1b46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:31.897619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d9245-e172-4643-ab5b-8a2ac9dc1b46 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:31.919243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-494d9245-e172-4643-ab5b-8a2ac9dc1b46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:31.919243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:31.919243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:31.919243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:31.919243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:31.919243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:31.919243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:31.919243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:31.919243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:31.919243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:31.919243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:31.919243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:31.919243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:31.919243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:31.919243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:31.920449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:31.920449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:31.920449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:31.920449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:31.920449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:31.920449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:31.920449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:31.920449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:31.920449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:31.920449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:31.920449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:31.920449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:31.920449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:31.920449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:31.920449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:31.920449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:31.920449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:31.921482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:31.921482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:31.921482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:31.921482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:31.923932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 408/839] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:31.929130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d9245-e172-4643-ab5b-8a2ac9dc1b46 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:31.958296 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af963ca-21b2-4150-a201-f9e55da1fcdf None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:31.996999 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674593e-95b6-48c4-9148-824693106fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:31.998020 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674593e-95b6-48c4-9148-824693106fbf None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:31.998020 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674593e-95b6-48c4-9148-824693106fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:31.998308 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674593e-95b6-48c4-9148-824693106fbf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:32.010407 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674593e-95b6-48c4-9148-824693106fbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:32.015862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-6674593e-95b6-48c4-9148-824693106fbf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:32.015862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:32.015862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:32.015862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:32.015862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:32.015862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:32.015862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:32.015862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:32.015862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:32.015862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:32.015862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:32.015862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:32.015862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:32.015862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:32.015862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:32.015862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:32.017003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:32.017003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:32.017003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:32.017003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:32.017003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:32.017003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:32.017003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:32.017003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:32.017003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:32.017003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:32.017003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:32.017003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:32.017003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:32.017003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:32.017003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:32.017003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:32.018156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:32.018156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:32.018156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:32.018156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:32.018156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:32.018156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:32.018156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:32.018156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:32.018156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:32.018156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:32.018156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 09:58:32.018156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:32.021948 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:32.022343 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 432/840] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 09:58:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:32.023372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674593e-95b6-48c4-9148-824693106fbf None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:32.051179 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:32.052057 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d9245-e172-4643-ab5b-8a2ac9dc1b46 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:32.091809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49aa40a-6ebe-4f4e-a76e-b3f2f8482055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:32.092744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49aa40a-6ebe-4f4e-a76e-b3f2f8482055 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:32.093179 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49aa40a-6ebe-4f4e-a76e-b3f2f8482055 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:32.093591 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49aa40a-6ebe-4f4e-a76e-b3f2f8482055 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:32.094440 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49aa40a-6ebe-4f4e-a76e-b3f2f8482055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:32.094884 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49aa40a-6ebe-4f4e-a76e-b3f2f8482055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:32.096381 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49aa40a-6ebe-4f4e-a76e-b3f2f8482055 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:32.110675 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 409/841] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:32.116569 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49aa40a-6ebe-4f4e-a76e-b3f2f8482055 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:32.139690 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674593e-95b6-48c4-9148-824693106fbf None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:32.174824 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34438f43-3922-4351-a301-a4595f381cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:32.175627 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34438f43-3922-4351-a301-a4595f381cec None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:32.176017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34438f43-3922-4351-a301-a4595f381cec None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:32.176396 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34438f43-3922-4351-a301-a4595f381cec None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:32.177278 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34438f43-3922-4351-a301-a4595f381cec None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:32.177688 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34438f43-3922-4351-a301-a4595f381cec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:32.179191 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34438f43-3922-4351-a301-a4595f381cec None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:32.192810 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 433/842] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 09:58:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:32.193792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34438f43-3922-4351-a301-a4595f381cec None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:32.246619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49aa40a-6ebe-4f4e-a76e-b3f2f8482055 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:32.285491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db7d38-e684-4b85-8bb1-b1af3629ce2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:32.286055 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db7d38-e684-4b85-8bb1-b1af3629ce2a None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:32.286332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db7d38-e684-4b85-8bb1-b1af3629ce2a None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:32.286607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db7d38-e684-4b85-8bb1-b1af3629ce2a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:32.297667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db7d38-e684-4b85-8bb1-b1af3629ce2a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:32.298344 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:32.300232 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db7d38-e684-4b85-8bb1-b1af3629ce2a None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:32.301726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:32.317078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-31db7d38-e684-4b85-8bb1-b1af3629ce2a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:58:32.317078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:32.317078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:32.317078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:32.317078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:32.317078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:32.317078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:32.317078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:32.317078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:32.317078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:32.317078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:32.317078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:32.317078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:32.317078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:32.317078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:32.317078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:32.318587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:32.318587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:32.318587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:32.318587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:32.318587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:32.318587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:32.318587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:32.318587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:32.318587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:32.318587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:32.318587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:32.318587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:32.318587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:32.318587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:32.318587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:32.318587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:32.318587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:32.318587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:32.319748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:32.319748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:32.319748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:32.319748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:32.319748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:32.319748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:32.319748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:32.319748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:32.319748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 09:58:32.319748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:32.321130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 410/843] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:58:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:32.326641 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db7d38-e684-4b85-8bb1-b1af3629ce2a None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:32.330904 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34438f43-3922-4351-a301-a4595f381cec None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:32.368657 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f0934-fdbc-4437-acb1-80b7aed61e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:32.369486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f0934-fdbc-4437-acb1-80b7aed61e43 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:32.369864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f0934-fdbc-4437-acb1-80b7aed61e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:32.370217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f0934-fdbc-4437-acb1-80b7aed61e43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:32.382996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f0934-fdbc-4437-acb1-80b7aed61e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:32.384751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f0934-fdbc-4437-acb1-80b7aed61e43 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:32.401051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-739f0934-fdbc-4437-acb1-80b7aed61e43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:32.401051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:32.401051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:32.401051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:32.401051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:32.401051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:32.401051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:32.401051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:32.401051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:32.401051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:32.401051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:32.401051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:32.401051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:32.401051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:32.401051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:32.401984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:32.401984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:32.401984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:32.401984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:32.401984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:32.401984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:32.401984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:32.401984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:32.401984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:32.401984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:32.401984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:32.401984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:32.401984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:32.401984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:32.401984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:32.401984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:32.401984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:32.403971 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:32.403971 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:32.403971 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:32.403971 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:32.403971 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 434/844] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:32.408278 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f0934-fdbc-4437-acb1-80b7aed61e43 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:32.450337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db7d38-e684-4b85-8bb1-b1af3629ce2a None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:32.505802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24693b62-ebad-4452-99d4-89f6a4ef4308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:32.506430 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24693b62-ebad-4452-99d4-89f6a4ef4308 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:32.506712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24693b62-ebad-4452-99d4-89f6a4ef4308 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:32.506987 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24693b62-ebad-4452-99d4-89f6a4ef4308 None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:32.508050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24693b62-ebad-4452-99d4-89f6a4ef4308 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:32.508363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24693b62-ebad-4452-99d4-89f6a4ef4308 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:32.509829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24693b62-ebad-4452-99d4-89f6a4ef4308 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:32.537309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 411/845] 10.222.0.85 () {56 vars in 1135 bytes} [Tue Aug 2 09:58:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:32.542079 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24693b62-ebad-4452-99d4-89f6a4ef4308 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:32.560750 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f0934-fdbc-4437-acb1-80b7aed61e43 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:32.607878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b4ca4-8140-4884-b518-efc31c5f1052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:32.608580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b4ca4-8140-4884-b518-efc31c5f1052 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:32.608865 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b4ca4-8140-4884-b518-efc31c5f1052 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:32.609147 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b4ca4-8140-4884-b518-efc31c5f1052 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:32.610017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b4ca4-8140-4884-b518-efc31c5f1052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:32.610327 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b4ca4-8140-4884-b518-efc31c5f1052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:32.612023 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b4ca4-8140-4884-b518-efc31c5f1052 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:32.614971 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:32.621785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:32.632047 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 435/846] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:32.637443 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b4ca4-8140-4884-b518-efc31c5f1052 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:32.683120 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24693b62-ebad-4452-99d4-89f6a4ef4308 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:32.733135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc242a7b-5e6f-4436-8317-73c4d60ae15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:32.734404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc242a7b-5e6f-4436-8317-73c4d60ae15d None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:32.734833 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc242a7b-5e6f-4436-8317-73c4d60ae15d None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:32.735273 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc242a7b-5e6f-4436-8317-73c4d60ae15d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:32.752162 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b4ca4-8140-4884-b518-efc31c5f1052 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:32.790637 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb22164-e396-4e2a-9a24-d47816991c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:32.791367 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb22164-e396-4e2a-9a24-d47816991c35 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:32.791721 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb22164-e396-4e2a-9a24-d47816991c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:32.792048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb22164-e396-4e2a-9a24-d47816991c35 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:32.801219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb22164-e396-4e2a-9a24-d47816991c35 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:32.802707 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb22164-e396-4e2a-9a24-d47816991c35 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:32.815091 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc242a7b-5e6f-4436-8317-73c4d60ae15d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:32.816734 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc242a7b-5e6f-4436-8317-73c4d60ae15d None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:32.817630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-2cb22164-e396-4e2a-9a24-d47816991c35 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:58:32.817630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:32.817630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:32.817630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:32.817630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:32.817630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:32.817630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:32.817630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:32.817630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:32.817630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:32.817630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:32.817630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:32.817630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:32.817630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:32.817630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:32.817630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:32.818580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:32.818580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:32.818580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:32.818580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:32.818580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:32.818580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:32.818580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:32.818580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:32.818580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:32.818580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:32.818580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:32.818580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:32.818580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:32.818580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:32.818580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:32.818580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:32.818580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:32.818580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:32.819507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:32.819507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:32.819507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:32.819507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:32.819507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:32.819507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:32.819507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:32.819507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:32.819507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:58:32.819507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:32.819507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 436/847] 10.222.0.85 () {56 vars in 1117 bytes} [Tue Aug 2 09:58:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:32.825060 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb22164-e396-4e2a-9a24-d47816991c35 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:32.886867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:32.901073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:32.934875 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb22164-e396-4e2a-9a24-d47816991c35 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:32.935467 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 412/848] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:58:32 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 09:58:32.944519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc242a7b-5e6f-4436-8317-73c4d60ae15d None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:32.974140 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60eb538-42b6-4116-997c-0eb03d223ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:32.974864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eb538-42b6-4116-997c-0eb03d223ccc None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:32.975047 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eb538-42b6-4116-997c-0eb03d223ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:32.975310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60eb538-42b6-4116-997c-0eb03d223ccc None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:32.976212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60eb538-42b6-4116-997c-0eb03d223ccc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:32.976433 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60eb538-42b6-4116-997c-0eb03d223ccc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:32.977918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60eb538-42b6-4116-997c-0eb03d223ccc None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:32.996328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 437/849] 10.222.0.85 () {56 vars in 1149 bytes} [Tue Aug 2 09:58:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:32.997474 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53688a5d-a3e2-4236-8748-ce0334e5de97 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:32.998007 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53688a5d-a3e2-4236-8748-ce0334e5de97 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:32.998007 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53688a5d-a3e2-4236-8748-ce0334e5de97 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:32.999378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 438/850] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:33.004102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53688a5d-a3e2-4236-8748-ce0334e5de97 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:33.055420 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc242a7b-5e6f-4436-8317-73c4d60ae15d None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:33.094570 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cae7e0-95de-4693-bd27-e09c7617f5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:33.095214 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cae7e0-95de-4693-bd27-e09c7617f5ba None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:33.095499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cae7e0-95de-4693-bd27-e09c7617f5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:33.095777 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cae7e0-95de-4693-bd27-e09c7617f5ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:33.106393 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cae7e0-95de-4693-bd27-e09c7617f5ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:33.107856 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cae7e0-95de-4693-bd27-e09c7617f5ba None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:33.118794 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53688a5d-a3e2-4236-8748-ce0334e5de97 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:33.123705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-c0cae7e0-95de-4693-bd27-e09c7617f5ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:33.123705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:33.123705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:33.123705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:33.123705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:33.123705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:33.123705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:33.123705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:33.123705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:33.123705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:33.123705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:33.123705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:33.123705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:33.123705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:33.123705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:33.124612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:33.124612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:33.124612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:33.124612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:33.124612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:33.124612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:33.124612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:33.124612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:33.124612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:33.124612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:33.124612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:33.124612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:33.124612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:33.124612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:33.124612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:33.124612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:33.124612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:33.125653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:33.125653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:33.125653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:33.125653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:33.127422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 413/851] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:33.128870 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dd471-2b79-4725-baad-6d5f90219cc2 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:33.129147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dd471-2b79-4725-baad-6d5f90219cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:33.129421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dd471-2b79-4725-baad-6d5f90219cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:33.138338 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:33.139499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:33.153057 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-6e4dd471-2b79-4725-baad-6d5f90219cc2 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:33.154475 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-6e4dd471-2b79-4725-baad-6d5f90219cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:33.162120 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909a8ee-2619-44ec-8ead-36ce4fd434c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:33.162741 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909a8ee-2619-44ec-8ead-36ce4fd434c0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:33.163021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909a8ee-2619-44ec-8ead-36ce4fd434c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:33.163294 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909a8ee-2619-44ec-8ead-36ce4fd434c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:33.230890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 414/852] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:33.231738 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4dd471-2b79-4725-baad-6d5f90219cc2 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:33.246199 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909a8ee-2619-44ec-8ead-36ce4fd434c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:33.249462 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909a8ee-2619-44ec-8ead-36ce4fd434c0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:33.347770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4dd471-2b79-4725-baad-6d5f90219cc2 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:33.362996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 439/853] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:58:33 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:58:33.363784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909a8ee-2619-44ec-8ead-36ce4fd434c0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:33.381275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:33.390156 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cea7d-84b9-4f43-8580-960711e5015a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:33.390769 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cea7d-84b9-4f43-8580-960711e5015a None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:33.391051 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cea7d-84b9-4f43-8580-960711e5015a None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:33.391323 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4cea7d-84b9-4f43-8580-960711e5015a None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:33.392016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cea7d-84b9-4f43-8580-960711e5015a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:33.392329 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cea7d-84b9-4f43-8580-960711e5015a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:33.393736 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4cea7d-84b9-4f43-8580-960711e5015a None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:33.395391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:33.406644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 415/854] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:33.407358 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cea7d-84b9-4f43-8580-960711e5015a None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:33.486516 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909a8ee-2619-44ec-8ead-36ce4fd434c0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:33.519785 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4cea7d-84b9-4f43-8580-960711e5015a None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:33.525186 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba566f-97d8-40b0-860e-cdb66381d2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:33.525827 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba566f-97d8-40b0-860e-cdb66381d2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:33.526108 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba566f-97d8-40b0-860e-cdb66381d2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:33.526387 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba566f-97d8-40b0-860e-cdb66381d2f9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:33.527710 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba566f-97d8-40b0-860e-cdb66381d2f9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:33.529073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba566f-97d8-40b0-860e-cdb66381d2f9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:33.538215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-7fba566f-97d8-40b0-860e-cdb66381d2f9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 09:58:33.538215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:33.538215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:33.538215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:33.538215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:33.538215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:33.538215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:33.538215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:33.538215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 09:58:33.538215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:33.538215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:33.538215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:33.538215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:33.538215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:33.538215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:33.538215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:33.538215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:33.539246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:33.539246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:33.539246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:33.539246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:33.539246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:33.539246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:33.539246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:33.539246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:33.539246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:33.539246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:33.539246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:33.539246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:33.539246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:33.539246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:33.539246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:33.539246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:33.540095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:33.540095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:33.540095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:33.540095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:33.540095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:33.540095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:33.540095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:33.540095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:33.540095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:33.540095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:33.540095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:33.540095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:33.540095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 09:58:33.540095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:33.540095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 440/855] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:58:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:33.540923 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba566f-97d8-40b0-860e-cdb66381d2f9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:33.562468 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff424a-6dda-4c39-beef-350c44a687ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:33.563109 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff424a-6dda-4c39-beef-350c44a687ea None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:33.563393 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff424a-6dda-4c39-beef-350c44a687ea None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:33.563984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff424a-6dda-4c39-beef-350c44a687ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:33.574712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff424a-6dda-4c39-beef-350c44a687ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:33.576178 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ff424a-6dda-4c39-beef-350c44a687ea None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:33.594931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-30ff424a-6dda-4c39-beef-350c44a687ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:33.594931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:33.594931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:33.594931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:33.594931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:33.594931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:33.594931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:33.594931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:33.594931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:33.594931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:33.594931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:33.594931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:33.594931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:33.594931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:33.594931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:33.595881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:33.595881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:33.595881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:33.595881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:33.595881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:33.595881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:33.595881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:33.595881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:33.595881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:33.595881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:33.595881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:33.595881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:33.595881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:33.595881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:33.595881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:33.595881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:33.595881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:33.596826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:33.596826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:33.596826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:33.596826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:33.602487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 416/856] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:33.602487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff424a-6dda-4c39-beef-350c44a687ea None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:33.629834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:33.649773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:33.657885 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba566f-97d8-40b0-860e-cdb66381d2f9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:33.693100 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3d8f4-6d7d-4875-99fd-0c049f8a21e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:33.693735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3d8f4-6d7d-4875-99fd-0c049f8a21e9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:33.694013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3d8f4-6d7d-4875-99fd-0c049f8a21e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:33.694282 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3d8f4-6d7d-4875-99fd-0c049f8a21e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:33.701954 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3d8f4-6d7d-4875-99fd-0c049f8a21e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:33.703385 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3d8f4-6d7d-4875-99fd-0c049f8a21e9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:33.713389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff424a-6dda-4c39-beef-350c44a687ea None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:33.715565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-88e3d8f4-6d7d-4875-99fd-0c049f8a21e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:33.715565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:33.715565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:33.715565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:33.715565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:33.715565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:33.715565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:33.715565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:33.715565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:33.715565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:33.715565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:33.715565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:33.715565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:33.715565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:33.715565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:33.716746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:33.716746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:33.716746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:33.716746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:33.716746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:33.716746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:33.716746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:33.716746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:33.716746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:33.716746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:33.716746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:33.716746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:33.716746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:33.716746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:33.716746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:33.716746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:33.716746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:33.717668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:33.717668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:33.717668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:33.717668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:33.717668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:33.717668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:33.717668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:33.717668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:33.717668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 441/857] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:33.718178 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3d8f4-6d7d-4875-99fd-0c049f8a21e9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:33.753103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bd782-d2c3-47f5-bc06-725802ae84de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:33.753722 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bd782-d2c3-47f5-bc06-725802ae84de None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:33.754013 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bd782-d2c3-47f5-bc06-725802ae84de None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:33.754293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bd782-d2c3-47f5-bc06-725802ae84de None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:33.754972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bd782-d2c3-47f5-bc06-725802ae84de None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:33.755282 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bd782-d2c3-47f5-bc06-725802ae84de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:33.756687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bd782-d2c3-47f5-bc06-725802ae84de None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:33.762211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 417/858] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:58:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:33.763160 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bd782-d2c3-47f5-bc06-725802ae84de None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:33.822308 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3d8f4-6d7d-4875-99fd-0c049f8a21e9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:33.856926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b53c8-0299-4d13-916f-941c1cd41ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:33.857454 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b53c8-0299-4d13-916f-941c1cd41ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:33.857734 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b53c8-0299-4d13-916f-941c1cd41ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:33.858001 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b53c8-0299-4d13-916f-941c1cd41ab5 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:33.858682 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b53c8-0299-4d13-916f-941c1cd41ab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:33.858981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b53c8-0299-4d13-916f-941c1cd41ab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:33.860335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b53c8-0299-4d13-916f-941c1cd41ab5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:33.861226 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bd782-d2c3-47f5-bc06-725802ae84de None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:33.867114 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:33.872284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:33.872926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 442/859] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:33.874120 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fd406-6e9a-4044-9441-8e2bae8badfa None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:33.874401 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fd406-6e9a-4044-9441-8e2bae8badfa None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:33.874670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fd406-6e9a-4044-9441-8e2bae8badfa None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:33.875997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 443/860] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:33.876566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fd406-6e9a-4044-9441-8e2bae8badfa None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:33.899595 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae40ea-979b-4703-b2b7-34a5ca1abeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:33.900314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae40ea-979b-4703-b2b7-34a5ca1abeb8 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:33.900633 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae40ea-979b-4703-b2b7-34a5ca1abeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:33.900955 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae40ea-979b-4703-b2b7-34a5ca1abeb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:33.901779 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae40ea-979b-4703-b2b7-34a5ca1abeb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:33.902698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae40ea-979b-4703-b2b7-34a5ca1abeb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:33.904142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae40ea-979b-4703-b2b7-34a5ca1abeb8 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:33.916093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 418/861] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:33.917503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d94f1-c666-4c0d-a9d0-505a8121d714 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:33.918360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d94f1-c666-4c0d-a9d0-505a8121d714 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:33.918830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d94f1-c666-4c0d-a9d0-505a8121d714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:33.937066 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-261d94f1-c666-4c0d-a9d0-505a8121d714 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:33.938238 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-261d94f1-c666-4c0d-a9d0-505a8121d714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:33.983163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fd406-6e9a-4044-9441-8e2bae8badfa None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:34.004413 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 419/862] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:34.005254 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d94f1-c666-4c0d-a9d0-505a8121d714 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:34.017741 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f784ca-0937-476d-8756-26ac125ed750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:34.018355 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f784ca-0937-476d-8756-26ac125ed750 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:34.018644 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f784ca-0937-476d-8756-26ac125ed750 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:34.018917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f784ca-0937-476d-8756-26ac125ed750 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:34.019596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f784ca-0937-476d-8756-26ac125ed750 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:34.019903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f784ca-0937-476d-8756-26ac125ed750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:34.021294 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f784ca-0937-476d-8756-26ac125ed750 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:34.036592 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 444/863] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:58:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:34.036592 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f784ca-0937-476d-8756-26ac125ed750 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:34.110641 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:34.135493 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:34.140386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d94f1-c666-4c0d-a9d0-505a8121d714 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:34.157043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f784ca-0937-476d-8756-26ac125ed750 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:34.183678 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d32e9-3255-4d7a-98a0-ebd912249d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:34.184333 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d32e9-3255-4d7a-98a0-ebd912249d95 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:34.184646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d32e9-3255-4d7a-98a0-ebd912249d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:34.184923 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d32e9-3255-4d7a-98a0-ebd912249d95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:34.192718 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d32e9-3255-4d7a-98a0-ebd912249d95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:34.194175 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d32e9-3255-4d7a-98a0-ebd912249d95 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:34.202852 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35505ad-10b1-4833-be00-c60891ca6925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:34.203470 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35505ad-10b1-4833-be00-c60891ca6925 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:34.203748 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35505ad-10b1-4833-be00-c60891ca6925 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:34.204017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35505ad-10b1-4833-be00-c60891ca6925 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:34.204871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35505ad-10b1-4833-be00-c60891ca6925 None admin] RBAC: Adding query filter params (role.id=c15ca78eb3c9472f94e15e2d28c7f403, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=e9cfed2469a7419f8fcbe09d25cb896e) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:34.205179 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35505ad-10b1-4833-be00-c60891ca6925 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:34.206593 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35505ad-10b1-4833-be00-c60891ca6925 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:34.207048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-f33d32e9-3255-4d7a-98a0-ebd912249d95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:34.207048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:34.207048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:34.207048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:34.207048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:34.207048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:34.207048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:34.207048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:34.207048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:34.207048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:34.207048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:34.207048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:34.207048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:34.207048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:34.207048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:34.207907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:34.207907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:34.207907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:34.207907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:34.207907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:34.207907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:34.207907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:34.207907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:34.207907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:34.207907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:34.207907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:34.207907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:34.207907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:34.207907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:34.207907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:34.207907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:34.207907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:34.213672 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:34.213672 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:34.213672 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:34.213672 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:34.213672 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:34.213672 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:34.213672 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:34.213672 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:34.213672 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 420/864] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:34.213672 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d32e9-3255-4d7a-98a0-ebd912249d95 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:34.224725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 445/865] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:58:34 2022] GET /identity/v3/role_assignments?user.id=e9cfed2469a7419f8fcbe09d25cb896e&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=c15ca78eb3c9472f94e15e2d28c7f403 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:34.224725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35505ad-10b1-4833-be00-c60891ca6925 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:34.341975 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d32e9-3255-4d7a-98a0-ebd912249d95 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:34.373459 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35505ad-10b1-4833-be00-c60891ca6925 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:34.390821 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdd994-23f9-4ebd-ab51-9a81a373ad7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:34.391575 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdd994-23f9-4ebd-ab51-9a81a373ad7c None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:34.391933 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdd994-23f9-4ebd-ab51-9a81a373ad7c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:34.392291 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdd994-23f9-4ebd-ab51-9a81a373ad7c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:34.393031 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdd994-23f9-4ebd-ab51-9a81a373ad7c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:34.394595 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdd994-23f9-4ebd-ab51-9a81a373ad7c None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:34.405054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-a0fdd994-23f9-4ebd-ab51-9a81a373ad7c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 09:58:34.405054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:34.405054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:34.405054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:34.405054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:34.405054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:34.405054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:34.405054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:34.405054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 09:58:34.405054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:34.405054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:34.405054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:34.405054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:34.405054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:34.405054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:34.405054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:34.406054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:34.406054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:34.406054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:34.406054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:34.406054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:34.406054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:34.406054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:34.406054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:34.406054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:34.406054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:34.406054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:34.406054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:34.406054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:34.406054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:34.406054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:34.406054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:34.406903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:34.406903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:34.406903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:34.406903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:34.406903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:34.406903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:34.406903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:34.406903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:34.406903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:34.406903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:34.406903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:34.406903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:34.406903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:34.406903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 09:58:34.406903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:34.406903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 421/866] 10.222.0.85 () {56 vars in 1132 bytes} [Tue Aug 2 09:58:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:34.407730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:34.412449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdd994-23f9-4ebd-ab51-9a81a373ad7c None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:34.427435 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec01ee8-1eb5-46fb-8d08-ad0b3da54593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:34.428521 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec01ee8-1eb5-46fb-8d08-ad0b3da54593 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:34.428521 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec01ee8-1eb5-46fb-8d08-ad0b3da54593 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:34.429874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec01ee8-1eb5-46fb-8d08-ad0b3da54593 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:34.430635 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec01ee8-1eb5-46fb-8d08-ad0b3da54593 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:34.430944 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec01ee8-1eb5-46fb-8d08-ad0b3da54593 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:34.433452 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec01ee8-1eb5-46fb-8d08-ad0b3da54593 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:34.448338 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 446/867] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:34.449733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:34.455236 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec01ee8-1eb5-46fb-8d08-ad0b3da54593 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:34.545120 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdd994-23f9-4ebd-ab51-9a81a373ad7c None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:34.579693 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec01ee8-1eb5-46fb-8d08-ad0b3da54593 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:34.581098 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3616b8-2d68-45e5-a405-462796ebd86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:34.581789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3616b8-2d68-45e5-a405-462796ebd86a None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:34.582076 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3616b8-2d68-45e5-a405-462796ebd86a None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:34.582401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3616b8-2d68-45e5-a405-462796ebd86a None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:34.583094 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3616b8-2d68-45e5-a405-462796ebd86a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:34.583403 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3616b8-2d68-45e5-a405-462796ebd86a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:34.584806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3616b8-2d68-45e5-a405-462796ebd86a None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:34.590460 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 422/868] 10.222.0.85 () {56 vars in 1126 bytes} [Tue Aug 2 09:58:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:34.595961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3616b8-2d68-45e5-a405-462796ebd86a None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:34.627151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e438c2-c425-4400-abec-55f208708339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:34.628341 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e438c2-c425-4400-abec-55f208708339 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:34.628828 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e438c2-c425-4400-abec-55f208708339 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:34.629676 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e438c2-c425-4400-abec-55f208708339 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:34.631347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e438c2-c425-4400-abec-55f208708339 None admin] RBAC: Adding query filter params (role.id=e30f587367384737a72bbcc2e35d62ad, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=f43a16e2dcab4872963222c557853d32) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:34.631862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e438c2-c425-4400-abec-55f208708339 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:34.634050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e438c2-c425-4400-abec-55f208708339 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:34.643619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 447/869] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:58:34 2022] GET /identity/v3/role_assignments?user.id=f43a16e2dcab4872963222c557853d32&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=e30f587367384737a72bbcc2e35d62ad => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:34.703682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:34.718338 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3616b8-2d68-45e5-a405-462796ebd86a None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:34.763068 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8b44f-e4b1-408d-9238-356888617159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:34.763713 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8b44f-e4b1-408d-9238-356888617159 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:34.763995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8b44f-e4b1-408d-9238-356888617159 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:34.764271 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8b44f-e4b1-408d-9238-356888617159 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:34.765025 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8b44f-e4b1-408d-9238-356888617159 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:34.765336 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8b44f-e4b1-408d-9238-356888617159 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:34.766773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8b44f-e4b1-408d-9238-356888617159 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:34.772743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 423/870] 10.222.0.85 () {56 vars in 1126 bytes} [Tue Aug 2 09:58:34 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:36.128989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd1d7b-5356-408d-88bf-89569cad9111 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:36.129538 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd1d7b-5356-408d-88bf-89569cad9111 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:36.129538 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd1d7b-5356-408d-88bf-89569cad9111 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:36.131125 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 448/871] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:36.137294 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd7909-c16b-475f-a230-e658a8dce065 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:36.137690 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd7909-c16b-475f-a230-e658a8dce065 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:36.137855 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd7909-c16b-475f-a230-e658a8dce065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:36.157133 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-9cbd7909-c16b-475f-a230-e658a8dce065 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:36.158328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-9cbd7909-c16b-475f-a230-e658a8dce065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:36.232502 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 424/872] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:36.255942 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd1d7b-5356-408d-88bf-89569cad9111 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:36.347070 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:36.433248 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd1d7b-5356-408d-88bf-89569cad9111 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:36.490827 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6b81a-ef67-41ff-be82-74f7b1959c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:36.491890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6b81a-ef67-41ff-be82-74f7b1959c95 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:36.492393 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6b81a-ef67-41ff-be82-74f7b1959c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:36.492923 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6b81a-ef67-41ff-be82-74f7b1959c95 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:36.494226 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6b81a-ef67-41ff-be82-74f7b1959c95 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:36.496883 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c6b81a-ef67-41ff-be82-74f7b1959c95 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:36.524550 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 449/873] 10.222.0.85 () {60 vars in 1141 bytes} [Tue Aug 2 09:58:36 2022] POST /identity/v3/services => generated 251 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:58:36.818829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fc24a-7c47-4a2c-b27c-6eb1360fe316 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:36.819180 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fc24a-7c47-4a2c-b27c-6eb1360fe316 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:36.819359 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fc24a-7c47-4a2c-b27c-6eb1360fe316 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:36.820932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 425/874] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:36.826749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5319e93-ddf0-489d-b586-4ceb974af0d6 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:36.827037 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5319e93-ddf0-489d-b586-4ceb974af0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:36.827312 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5319e93-ddf0-489d-b586-4ceb974af0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:36.846472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a5319e93-ddf0-489d-b586-4ceb974af0d6 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:36.847662 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a5319e93-ddf0-489d-b586-4ceb974af0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:36.862538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef55596-0110-43f1-8d06-b4feb86f0df3 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:36.862538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef55596-0110-43f1-8d06-b4feb86f0df3 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:36.862538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef55596-0110-43f1-8d06-b4feb86f0df3 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:36.863177 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 426/875] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:58:36.868407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84865bd-7b33-4ac1-b328-754e066c5cb6 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:36.869045 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84865bd-7b33-4ac1-b328-754e066c5cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:36.869546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84865bd-7b33-4ac1-b328-754e066c5cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:36.894164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-a84865bd-7b33-4ac1-b328-754e066c5cb6 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:36.895721 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a84865bd-7b33-4ac1-b328-754e066c5cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:36.951573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 450/876] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:36 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:36.971527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 427/877] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:36 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:58:36.985339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5319e93-ddf0-489d-b586-4ceb974af0d6 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:36.997941 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84865bd-7b33-4ac1-b328-754e066c5cb6 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:37.012409 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:37.032074 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:37.107166 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5319e93-ddf0-489d-b586-4ceb974af0d6 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:37.108007 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84865bd-7b33-4ac1-b328-754e066c5cb6 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:37.145300 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8aae02-2194-45a0-985f-4d5432ce3d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:37.145827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d597a-c634-437b-98a8-4d884e336ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:37.146172 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8aae02-2194-45a0-985f-4d5432ce3d3f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:37.146284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d597a-c634-437b-98a8-4d884e336ebb None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:37.146284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d597a-c634-437b-98a8-4d884e336ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:37.146428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8aae02-2194-45a0-985f-4d5432ce3d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:37.146503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d597a-c634-437b-98a8-4d884e336ebb None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:37.146572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8aae02-2194-45a0-985f-4d5432ce3d3f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:37.147160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8aae02-2194-45a0-985f-4d5432ce3d3f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:37.147267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d597a-c634-437b-98a8-4d884e336ebb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:37.148549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d597a-c634-437b-98a8-4d884e336ebb None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:37.148660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8aae02-2194-45a0-985f-4d5432ce3d3f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:37.158772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-9c8aae02-2194-45a0-985f-4d5432ce3d3f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:58:37.158772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:37.158772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:37.158772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:37.158772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:37.158772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:37.158772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:37.158772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:37.158772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:58:37.158772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:37.158772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:37.158772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:37.158772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:37.158772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:37.158772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:37.158772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:37.158772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:37.159813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:37.159813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:37.159813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:37.159813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:37.159813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:37.159813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:37.159813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:37.159813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:37.159813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:37.159813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:37.159813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:37.159813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:37.159813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:37.159813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:37.159813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:37.159813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:37.160686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:37.160686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:37.160686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:37.160686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:37.160686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:37.160686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:37.160686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:37.160686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:37.160686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:37.160686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:37.160686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:37.160686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:37.160686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:58:37.160686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:37.160686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 451/878] 10.222.0.85 () {56 vars in 1126 bytes} [Tue Aug 2 09:58:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:37.161477 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3f8af-cfc5-4e4d-be3a-afc4881d57f1 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:37.161477 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3f8af-cfc5-4e4d-be3a-afc4881d57f1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:37.162199 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3f8af-cfc5-4e4d-be3a-afc4881d57f1 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:37.167080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 452/879] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:37.167080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3f8af-cfc5-4e4d-be3a-afc4881d57f1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:37.179812 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 428/880] 10.222.0.85 () {60 vars in 1141 bytes} [Tue Aug 2 09:58:36 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:58:37.181379 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b37e6e-1bb6-4dac-aa80-c6483669e7bd None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:37.181947 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b37e6e-1bb6-4dac-aa80-c6483669e7bd None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:37.182456 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b37e6e-1bb6-4dac-aa80-c6483669e7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:37.207396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-b0b37e6e-1bb6-4dac-aa80-c6483669e7bd None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:37.209025 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b0b37e6e-1bb6-4dac-aa80-c6483669e7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:37.298782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:37.306914 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 429/881] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:37.335533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3f8af-cfc5-4e4d-be3a-afc4881d57f1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:37.338204 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b37e6e-1bb6-4dac-aa80-c6483669e7bd None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:37.341075 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:37.382208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ac845-9f8f-41e4-906a-a5c64482ab51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:37.382761 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ac845-9f8f-41e4-906a-a5c64482ab51 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:37.383042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ac845-9f8f-41e4-906a-a5c64482ab51 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:37.383317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1ac845-9f8f-41e4-906a-a5c64482ab51 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:37.385206 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ac845-9f8f-41e4-906a-a5c64482ab51 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:37.385206 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ac845-9f8f-41e4-906a-a5c64482ab51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:37.388094 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1ac845-9f8f-41e4-906a-a5c64482ab51 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:37.392909 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 453/882] 10.222.0.85 () {56 vars in 1122 bytes} [Tue Aug 2 09:58:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:37.398546 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ac845-9f8f-41e4-906a-a5c64482ab51 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:37.469717 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b37e6e-1bb6-4dac-aa80-c6483669e7bd None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:37.512416 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9254e1-9c45-4d53-94f0-0b32ea72fb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:37.515284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9254e1-9c45-4d53-94f0-0b32ea72fb97 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:37.515776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9254e1-9c45-4d53-94f0-0b32ea72fb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:37.516265 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9254e1-9c45-4d53-94f0-0b32ea72fb97 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:37.527786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9254e1-9c45-4d53-94f0-0b32ea72fb97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:37.529715 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1ac845-9f8f-41e4-906a-a5c64482ab51 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:37.533599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-9c9254e1-9c45-4d53-94f0-0b32ea72fb97 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:58:37.533599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:37.533599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:37.533599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:37.533599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:37.533599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:37.533599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:37.533599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:37.533599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:37.533599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:37.533599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:37.533599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:37.533599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:37.533599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:37.533599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:37.533599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:37.534491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:37.534491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:37.534491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:37.534491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:37.534491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:37.534491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:37.534491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:37.534491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:37.534491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:37.534491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:37.534491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:37.534491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:37.534491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:37.534491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:37.534491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:37.534491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:37.535314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:37.535314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:37.535314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:37.535314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:37.535314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:37.535314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:37.535314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:37.535314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:37.535314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:37.535314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:37.535314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:58:37.535314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:37.538054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 430/883] 10.222.0.85 () {56 vars in 1120 bytes} [Tue Aug 2 09:58:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:37.544876 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9254e1-9c45-4d53-94f0-0b32ea72fb97 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:37.573208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f212ccd-14e6-4300-833a-cee09cfab862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:37.575251 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f212ccd-14e6-4300-833a-cee09cfab862 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:37.575540 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f212ccd-14e6-4300-833a-cee09cfab862 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:37.575820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f212ccd-14e6-4300-833a-cee09cfab862 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:37.576805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f212ccd-14e6-4300-833a-cee09cfab862 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:37.577117 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f212ccd-14e6-4300-833a-cee09cfab862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:37.578764 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f212ccd-14e6-4300-833a-cee09cfab862 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:37.585524 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 454/884] 10.222.0.85 () {56 vars in 1122 bytes} [Tue Aug 2 09:58:37 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:37.625416 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:37.676436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9254e1-9c45-4d53-94f0-0b32ea72fb97 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:37.722225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1f530-4ae3-4ea1-87f5-1ada0d2310dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:37.723311 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1f530-4ae3-4ea1-87f5-1ada0d2310dc None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:37.723791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1f530-4ae3-4ea1-87f5-1ada0d2310dc None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:37.724258 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1f530-4ae3-4ea1-87f5-1ada0d2310dc None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:37.725219 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1f530-4ae3-4ea1-87f5-1ada0d2310dc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:37.725726 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1f530-4ae3-4ea1-87f5-1ada0d2310dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:37.727337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1f530-4ae3-4ea1-87f5-1ada0d2310dc None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:37.738250 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 431/885] 10.222.0.85 () {56 vars in 1115 bytes} [Tue Aug 2 09:58:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:37.744218 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f212ccd-14e6-4300-833a-cee09cfab862 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:37.779048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:37.856982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f212ccd-14e6-4300-833a-cee09cfab862 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:37.894177 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b1e39-0e57-4e31-a22d-4ad7d21e849d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:37.894815 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b1e39-0e57-4e31-a22d-4ad7d21e849d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:37.895139 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b1e39-0e57-4e31-a22d-4ad7d21e849d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:37.895476 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b1e39-0e57-4e31-a22d-4ad7d21e849d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:37.906355 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b1e39-0e57-4e31-a22d-4ad7d21e849d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:37.907788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b1e39-0e57-4e31-a22d-4ad7d21e849d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:37.922864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-334b1e39-0e57-4e31-a22d-4ad7d21e849d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:37.922864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:37.922864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:37.922864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:37.922864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:37.922864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:37.922864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:37.922864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:37.922864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:37.922864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:37.922864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:37.922864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:37.922864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:37.922864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:37.922864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:37.923784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:37.923784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:37.923784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:37.923784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:37.923784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:37.923784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:37.923784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:37.923784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:37.923784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:37.923784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:37.923784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:37.923784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:37.923784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:37.923784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:37.923784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:37.923784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:37.923784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:37.924812 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:37.924812 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:37.924812 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:37.924812 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:37.924812 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 455/886] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:37.930076 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1f530-4ae3-4ea1-87f5-1ada0d2310dc None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:38.039482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1f530-4ae3-4ea1-87f5-1ada0d2310dc None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:38.060878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:38.076871 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cb535-4b98-4c75-b5e1-ca22ff27d3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:38.077491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cb535-4b98-4c75-b5e1-ca22ff27d3fe None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:38.077769 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cb535-4b98-4c75-b5e1-ca22ff27d3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:38.078042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cb535-4b98-4c75-b5e1-ca22ff27d3fe None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:38.078736 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cb535-4b98-4c75-b5e1-ca22ff27d3fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:38.079039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cb535-4b98-4c75-b5e1-ca22ff27d3fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:38.080409 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cb535-4b98-4c75-b5e1-ca22ff27d3fe None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:38.093058 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 432/887] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:38.098657 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b1e39-0e57-4e31-a22d-4ad7d21e849d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:38.186381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:38.207812 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b1e39-0e57-4e31-a22d-4ad7d21e849d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:38.243327 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c66c9-b236-4af6-8438-df9ebbcacd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:38.243965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c66c9-b236-4af6-8438-df9ebbcacd4b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:38.244242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c66c9-b236-4af6-8438-df9ebbcacd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:38.244537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c66c9-b236-4af6-8438-df9ebbcacd4b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:38.254127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c66c9-b236-4af6-8438-df9ebbcacd4b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:38.256032 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c66c9-b236-4af6-8438-df9ebbcacd4b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:38.268673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-639c66c9-b236-4af6-8438-df9ebbcacd4b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:58:38.268673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:38.268673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:38.268673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:38.268673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:38.268673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:38.268673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:38.268673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:38.268673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:38.268673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:38.268673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:38.268673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:38.268673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:38.268673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:38.268673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:38.268673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:38.269616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:38.269616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:38.269616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:38.269616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:38.269616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:38.269616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:38.269616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:38.269616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:38.269616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:38.269616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:38.269616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:38.269616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:38.269616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:38.269616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:38.269616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:38.269616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:38.269616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:38.269616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:38.270549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:38.270549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:38.270549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:38.270549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:38.270549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:38.270549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:38.270549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:38.270549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:38.270549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:58:38.270549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:38.273074 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 456/888] 10.222.0.85 () {56 vars in 1117 bytes} [Tue Aug 2 09:58:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:38.284480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cb535-4b98-4c75-b5e1-ca22ff27d3fe None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:38.396911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cb535-4b98-4c75-b5e1-ca22ff27d3fe None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:38.436698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd5eec-a9e6-44d1-a491-f33e51abd2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:38.437288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd5eec-a9e6-44d1-a491-f33e51abd2cf None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:38.437572 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd5eec-a9e6-44d1-a491-f33e51abd2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:38.437844 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd5eec-a9e6-44d1-a491-f33e51abd2cf None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:38.438653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd5eec-a9e6-44d1-a491-f33e51abd2cf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:38.438968 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd5eec-a9e6-44d1-a491-f33e51abd2cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:38.440485 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd5eec-a9e6-44d1-a491-f33e51abd2cf None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:38.459253 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 433/889] 10.222.0.85 () {56 vars in 1149 bytes} [Tue Aug 2 09:58:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:38.465570 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c66c9-b236-4af6-8438-df9ebbcacd4b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:38.576022 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c66c9-b236-4af6-8438-df9ebbcacd4b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:38.612417 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d9e52-e8e0-4b72-aa30-5b6b0b78eeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:38.613425 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d9e52-e8e0-4b72-aa30-5b6b0b78eeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:38.613903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d9e52-e8e0-4b72-aa30-5b6b0b78eeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:38.614370 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d9e52-e8e0-4b72-aa30-5b6b0b78eeb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:38.621182 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793634d-12a3-4b52-8e22-e216df4b44a8 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:38.621476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793634d-12a3-4b52-8e22-e216df4b44a8 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:38.621790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5793634d-12a3-4b52-8e22-e216df4b44a8 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:38.624304 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 434/890] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:38.628367 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6a77e-7c77-4a9b-8ebb-265846772001 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:38.628537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6a77e-7c77-4a9b-8ebb-265846772001 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:38.628826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6a77e-7c77-4a9b-8ebb-265846772001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:38.629299 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:38.649886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-43b6a77e-7c77-4a9b-8ebb-265846772001 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:38.651429 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-43b6a77e-7c77-4a9b-8ebb-265846772001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:38.690524 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d9e52-e8e0-4b72-aa30-5b6b0b78eeb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:38.690714 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:38.692000 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d9e52-e8e0-4b72-aa30-5b6b0b78eeb9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:38.741907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 435/891] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:38 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:58:38.764267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6a77e-7c77-4a9b-8ebb-265846772001 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:38.813740 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 457/892] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:58:38 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:58:38.821392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d9e52-e8e0-4b72-aa30-5b6b0b78eeb9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:38.877700 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:38.889578 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6a77e-7c77-4a9b-8ebb-265846772001 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:38.931323 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b382bb-c13b-47e0-8b8c-b4c0f81fc9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:38.931970 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b382bb-c13b-47e0-8b8c-b4c0f81fc9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:38.932253 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b382bb-c13b-47e0-8b8c-b4c0f81fc9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:38.932551 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b382bb-c13b-47e0-8b8c-b4c0f81fc9e8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:38.934132 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b382bb-c13b-47e0-8b8c-b4c0f81fc9e8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:38.935899 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b382bb-c13b-47e0-8b8c-b4c0f81fc9e8 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:38.948583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-a5b382bb-c13b-47e0-8b8c-b4c0f81fc9e8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 09:58:38.948583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:38.948583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:38.948583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:38.948583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:38.948583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:38.948583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:38.948583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:38.948583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 09:58:38.948583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:38.948583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:38.948583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:38.948583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:38.948583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:38.948583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:38.948583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:38.948583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:38.949583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:38.949583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:38.949583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:38.949583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:38.949583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:38.949583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:38.949583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:38.949583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:38.949583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:38.949583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:38.949583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:38.949583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:38.949583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:38.949583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:38.949583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:38.949583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:38.955568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:38.955568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:38.955568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:38.955568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:38.955568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:38.955568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:38.955568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:38.955568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:38.955568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:38.955568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:38.955568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:38.955568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:38.955568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 09:58:38.955568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:38.955568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 436/893] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:58:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:38.956382 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d9e52-e8e0-4b72-aa30-5b6b0b78eeb9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:38.961585 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b382bb-c13b-47e0-8b8c-b4c0f81fc9e8 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:38.993600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97ce85-f7e7-44a4-9366-d333b6f255a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:38.994380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97ce85-f7e7-44a4-9366-d333b6f255a3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:38.994770 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97ce85-f7e7-44a4-9366-d333b6f255a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:38.995053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97ce85-f7e7-44a4-9366-d333b6f255a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:38.997699 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:39.008069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97ce85-f7e7-44a4-9366-d333b6f255a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:39.009578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d97ce85-f7e7-44a4-9366-d333b6f255a3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:39.029204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-6d97ce85-f7e7-44a4-9366-d333b6f255a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:39.029204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:39.029204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:39.029204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:39.029204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:39.029204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:39.029204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:39.029204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:39.029204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:39.029204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:39.029204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:39.029204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:39.029204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:39.029204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:39.029204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:39.030141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:39.030141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:39.030141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:39.030141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:39.030141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:39.030141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:39.030141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:39.030141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:39.030141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:39.030141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:39.030141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:39.030141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:39.030141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:39.030141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:39.030141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:39.030141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:39.030141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:39.031057 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:39.031057 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:39.031057 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:39.031057 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:39.035141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 458/894] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:39.036023 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97ce85-f7e7-44a4-9366-d333b6f255a3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:39.083845 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b382bb-c13b-47e0-8b8c-b4c0f81fc9e8 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:39.127316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbaaf1-086d-470f-9bfa-206b12b75368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:39.127941 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbaaf1-086d-470f-9bfa-206b12b75368 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:39.128221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbaaf1-086d-470f-9bfa-206b12b75368 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:39.128510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbaaf1-086d-470f-9bfa-206b12b75368 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:39.129195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbaaf1-086d-470f-9bfa-206b12b75368 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:39.129499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbaaf1-086d-470f-9bfa-206b12b75368 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:39.131312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbaaf1-086d-470f-9bfa-206b12b75368 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:39.138879 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 437/895] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:58:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:39.144376 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbaaf1-086d-470f-9bfa-206b12b75368 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:39.150437 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:39.162981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d97ce85-f7e7-44a4-9366-d333b6f255a3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:39.204566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af5db6-a429-427b-bc60-e8c849a9f34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:39.205177 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af5db6-a429-427b-bc60-e8c849a9f34d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:39.205404 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af5db6-a429-427b-bc60-e8c849a9f34d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:39.205661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af5db6-a429-427b-bc60-e8c849a9f34d None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:39.206365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af5db6-a429-427b-bc60-e8c849a9f34d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:39.206733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af5db6-a429-427b-bc60-e8c849a9f34d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:39.208444 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af5db6-a429-427b-bc60-e8c849a9f34d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:39.227594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 459/896] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:39.229023 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af5db6-a429-427b-bc60-e8c849a9f34d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:39.272839 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:39.281088 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbaaf1-086d-470f-9bfa-206b12b75368 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:39.328268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6985ef-83fe-4940-8105-0f9383371477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:39.329834 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6985ef-83fe-4940-8105-0f9383371477 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:39.330341 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6985ef-83fe-4940-8105-0f9383371477 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:39.331536 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6985ef-83fe-4940-8105-0f9383371477 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:39.332389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6985ef-83fe-4940-8105-0f9383371477 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:39.332867 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6985ef-83fe-4940-8105-0f9383371477 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:39.334382 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6985ef-83fe-4940-8105-0f9383371477 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:39.342259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 438/897] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:58:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:39.348321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6985ef-83fe-4940-8105-0f9383371477 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:39.369161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af5db6-a429-427b-bc60-e8c849a9f34d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:39.408514 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a0a00-aa92-44bb-a7f5-6e70414e97b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:39.409151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a0a00-aa92-44bb-a7f5-6e70414e97b9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:39.409431 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a0a00-aa92-44bb-a7f5-6e70414e97b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:39.409700 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a0a00-aa92-44bb-a7f5-6e70414e97b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:39.417890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a0a00-aa92-44bb-a7f5-6e70414e97b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:39.419319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a0a00-aa92-44bb-a7f5-6e70414e97b9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:39.430870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-6e8a0a00-aa92-44bb-a7f5-6e70414e97b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:39.430870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:39.430870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:39.430870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:39.430870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:39.430870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:39.430870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:39.430870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:39.430870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:39.430870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:39.430870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:39.430870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:39.430870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:39.430870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:39.430870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:39.431769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:39.431769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:39.431769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:39.431769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:39.431769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:39.431769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:39.431769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:39.431769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:39.431769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:39.431769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:39.431769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:39.431769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:39.431769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:39.431769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:39.431769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:39.431769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:39.431769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:39.437608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:39.437608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:39.437608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:39.437608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:39.437608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:39.437608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:39.437608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:39.437608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:39.437608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 460/898] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:39.437608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257e9f8-a726-4c8a-96c8-206d309b6b06 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:39.437608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257e9f8-a726-4c8a-96c8-206d309b6b06 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:39.438317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257e9f8-a726-4c8a-96c8-206d309b6b06 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:39.438317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 461/899] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:39.440744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418e1a6-4c7c-4b9c-abcb-1e279f7ae1e0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:39.441030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418e1a6-4c7c-4b9c-abcb-1e279f7ae1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:39.441303 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418e1a6-4c7c-4b9c-abcb-1e279f7ae1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:39.459138 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2418e1a6-4c7c-4b9c-abcb-1e279f7ae1e0 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:39.460232 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2418e1a6-4c7c-4b9c-abcb-1e279f7ae1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:39.467167 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6985ef-83fe-4940-8105-0f9383371477 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:39.469080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:39.503904 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa256df-ddd2-4e06-9bf0-4bbe08726a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:39.504965 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa256df-ddd2-4e06-9bf0-4bbe08726a20 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:39.505249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa256df-ddd2-4e06-9bf0-4bbe08726a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:39.505578 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa256df-ddd2-4e06-9bf0-4bbe08726a20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:39.506695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa256df-ddd2-4e06-9bf0-4bbe08726a20 None admin] RBAC: Adding query filter params (interface=public, service_id=769ef0dd75c5448580d4587c7915b3e6, region_id=RegionOne) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:39.507268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa256df-ddd2-4e06-9bf0-4bbe08726a20 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:39.508967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa256df-ddd2-4e06-9bf0-4bbe08726a20 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:39.514959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 439/900] 10.222.0.85 () {56 vars in 1251 bytes} [Tue Aug 2 09:58:39 2022] GET /identity/v3/endpoints?service_id=769ef0dd75c5448580d4587c7915b3e6&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:39.515745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa256df-ddd2-4e06-9bf0-4bbe08726a20 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:39.540926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 462/901] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:58:39.541925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418e1a6-4c7c-4b9c-abcb-1e279f7ae1e0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:39.557110 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:39.641169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa256df-ddd2-4e06-9bf0-4bbe08726a20 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:39.656625 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418e1a6-4c7c-4b9c-abcb-1e279f7ae1e0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:39.682558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22ed48-9b8d-4ccf-a244-145d8a7e6342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:39.683567 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22ed48-9b8d-4ccf-a244-145d8a7e6342 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:39.683993 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22ed48-9b8d-4ccf-a244-145d8a7e6342 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:39.684420 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22ed48-9b8d-4ccf-a244-145d8a7e6342 None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:39.685632 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22ed48-9b8d-4ccf-a244-145d8a7e6342 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:39.685950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22ed48-9b8d-4ccf-a244-145d8a7e6342 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:39.687385 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a22ed48-9b8d-4ccf-a244-145d8a7e6342 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:39.693412 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85c998-6348-4a19-ac3c-aaf977c6b5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:39.694034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85c998-6348-4a19-ac3c-aaf977c6b5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:39.694335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85c998-6348-4a19-ac3c-aaf977c6b5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:39.694599 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85c998-6348-4a19-ac3c-aaf977c6b5b1 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:39.695246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85c998-6348-4a19-ac3c-aaf977c6b5b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:39.696620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85c998-6348-4a19-ac3c-aaf977c6b5b1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:39.708494 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 440/902] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:39.708494 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22ed48-9b8d-4ccf-a244-145d8a7e6342 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:39.708750 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 463/903] 10.222.0.85 () {56 vars in 1087 bytes} [Tue Aug 2 09:58:39 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:58:39.708750 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85c998-6348-4a19-ac3c-aaf977c6b5b1 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:39.723156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:39.827900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:39.841819 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85c998-6348-4a19-ac3c-aaf977c6b5b1 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:39.848170 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22ed48-9b8d-4ccf-a244-145d8a7e6342 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:39.885128 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d48a4-6c4f-495c-acca-b6e747eb0c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:39.885760 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d48a4-6c4f-495c-acca-b6e747eb0c9f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:39.886599 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d48a4-6c4f-495c-acca-b6e747eb0c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:39.886905 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d48a4-6c4f-495c-acca-b6e747eb0c9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:39.887689 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d48a4-6c4f-495c-acca-b6e747eb0c9f None admin] RBAC: Adding query filter params (role.id=142cbbffc00f4c1aa03655720f13107c, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=f43a16e2dcab4872963222c557853d32) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:39.888007 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d48a4-6c4f-495c-acca-b6e747eb0c9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:39.889464 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d48a4-6c4f-495c-acca-b6e747eb0c9f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:39.889572 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452172d-d447-40f7-9d8d-14bc6798ffbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:39.890121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452172d-d447-40f7-9d8d-14bc6798ffbe None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:39.890406 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452172d-d447-40f7-9d8d-14bc6798ffbe None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:39.890681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452172d-d447-40f7-9d8d-14bc6798ffbe None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:39.891437 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452172d-d447-40f7-9d8d-14bc6798ffbe None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:39.893004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452172d-d447-40f7-9d8d-14bc6798ffbe None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:39.895851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 464/904] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:58:39 2022] GET /identity/v3/role_assignments?user.id=f43a16e2dcab4872963222c557853d32&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=142cbbffc00f4c1aa03655720f13107c => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:39.897191 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313e483-f30c-4a72-a04c-dffd39a23652 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:39.897481 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313e483-f30c-4a72-a04c-dffd39a23652 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:39.897759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313e483-f30c-4a72-a04c-dffd39a23652 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:39.899161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 465/905] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:39.903504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-9452172d-d447-40f7-9d8d-14bc6798ffbe None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 09:58:39.903504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:39.903504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:39.903504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:39.903504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:39.903504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:39.903504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:39.903504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:39.903504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 09:58:39.903504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:39.903504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:39.903504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:39.903504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:39.903504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:39.903504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:39.903504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:39.904754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:39.904754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:39.904754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:39.904754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:39.904754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:39.904754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:39.904754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:39.904754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:39.904754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:39.904754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:39.904754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:39.904754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:39.904754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:39.904754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:39.904754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:39.904754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:39.905766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:39.905766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:39.905766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:39.905766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:39.905766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:39.905766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:39.905766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:39.905766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:39.905766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:39.905766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:39.905766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:39.905766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:39.905766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:39.905766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 09:58:39.905766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:39.905766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 441/906] 10.222.0.85 () {56 vars in 1132 bytes} [Tue Aug 2 09:58:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:39.906792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e14f53-4f82-43f5-b4fe-50ab569bfa18 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:39.906792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e14f53-4f82-43f5-b4fe-50ab569bfa18 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:39.906792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e14f53-4f82-43f5-b4fe-50ab569bfa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:39.913821 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452172d-d447-40f7-9d8d-14bc6798ffbe None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:39.930702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f2e14f53-4f82-43f5-b4fe-50ab569bfa18 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:39.932716 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f2e14f53-4f82-43f5-b4fe-50ab569bfa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:40.013275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:40.020560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 466/907] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:58:40.036126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e14f53-4f82-43f5-b4fe-50ab569bfa18 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:40.052411 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452172d-d447-40f7-9d8d-14bc6798ffbe None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:40.090761 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef18806-53d5-4eba-ae0c-4d633347e59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:40.092029 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef18806-53d5-4eba-ae0c-4d633347e59d None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:40.092545 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef18806-53d5-4eba-ae0c-4d633347e59d None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:40.093021 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef18806-53d5-4eba-ae0c-4d633347e59d None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:40.093924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef18806-53d5-4eba-ae0c-4d633347e59d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:40.094481 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef18806-53d5-4eba-ae0c-4d633347e59d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:40.096254 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef18806-53d5-4eba-ae0c-4d633347e59d None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:40.107694 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 442/908] 10.222.0.85 () {56 vars in 1126 bytes} [Tue Aug 2 09:58:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:40.109264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef18806-53d5-4eba-ae0c-4d633347e59d None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:40.135426 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:40.142956 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e14f53-4f82-43f5-b4fe-50ab569bfa18 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:40.179924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5227b6-cb5c-48bf-8a2e-69311cb2b10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:40.180589 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5227b6-cb5c-48bf-8a2e-69311cb2b10d None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:40.180884 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5227b6-cb5c-48bf-8a2e-69311cb2b10d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:40.181160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5227b6-cb5c-48bf-8a2e-69311cb2b10d None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:40.181867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5227b6-cb5c-48bf-8a2e-69311cb2b10d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:40.183938 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5227b6-cb5c-48bf-8a2e-69311cb2b10d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:40.208884 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 467/909] 10.222.0.85 () {60 vars in 1141 bytes} [Tue Aug 2 09:58:40 2022] POST /identity/v3/services => generated 241 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:58:40.231992 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef18806-53d5-4eba-ae0c-4d633347e59d None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:40.282151 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb954fae-fdcc-48fc-b00c-89dc9cbc7708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:40.283254 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb954fae-fdcc-48fc-b00c-89dc9cbc7708 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:40.283741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb954fae-fdcc-48fc-b00c-89dc9cbc7708 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:40.284213 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb954fae-fdcc-48fc-b00c-89dc9cbc7708 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:40.285173 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb954fae-fdcc-48fc-b00c-89dc9cbc7708 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:40.285731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb954fae-fdcc-48fc-b00c-89dc9cbc7708 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:40.287333 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb954fae-fdcc-48fc-b00c-89dc9cbc7708 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:40.299881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 443/910] 10.222.0.85 () {56 vars in 1126 bytes} [Tue Aug 2 09:58:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:40.311848 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5227b6-cb5c-48bf-8a2e-69311cb2b10d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:40.384905 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:40.438352 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5227b6-cb5c-48bf-8a2e-69311cb2b10d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:40.475806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3f80e-beca-4ad8-bced-fbc062ab76fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:40.476428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3f80e-beca-4ad8-bced-fbc062ab76fe None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:40.476733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3f80e-beca-4ad8-bced-fbc062ab76fe None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:40.477005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3f80e-beca-4ad8-bced-fbc062ab76fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:40.477760 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3f80e-beca-4ad8-bced-fbc062ab76fe None admin] RBAC: Adding query filter params (interface=public, service_id=4d6401f6a5f4412d879bbc7a7ad5b607, region_id=RegionOne) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:40.478066 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3f80e-beca-4ad8-bced-fbc062ab76fe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:40.479426 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3f80e-beca-4ad8-bced-fbc062ab76fe None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:40.485438 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 468/911] 10.222.0.85 () {56 vars in 1251 bytes} [Tue Aug 2 09:58:40 2022] GET /identity/v3/endpoints?service_id=4d6401f6a5f4412d879bbc7a7ad5b607&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:40.490988 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb954fae-fdcc-48fc-b00c-89dc9cbc7708 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:40.567667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:40.609833 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb954fae-fdcc-48fc-b00c-89dc9cbc7708 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:40.647241 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e05e98-8b7c-49f3-8e8e-473c6703b617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:40.647928 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e05e98-8b7c-49f3-8e8e-473c6703b617 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:40.648214 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e05e98-8b7c-49f3-8e8e-473c6703b617 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:40.648511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e05e98-8b7c-49f3-8e8e-473c6703b617 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:40.649189 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e05e98-8b7c-49f3-8e8e-473c6703b617 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:40.650555 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e05e98-8b7c-49f3-8e8e-473c6703b617 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:40.664611 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 444/912] 10.222.0.85 () {56 vars in 1087 bytes} [Tue Aug 2 09:58:40 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:58:41.795296 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ee03a-f0ed-4299-98c1-36e0ee62a144 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:41.795912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ee03a-f0ed-4299-98c1-36e0ee62a144 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:41.795912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ee03a-f0ed-4299-98c1-36e0ee62a144 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:41.797618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 469/913] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:41.803293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ff24a-6b20-4907-9f9e-06aa20161e2e None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:41.803831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ff24a-6b20-4907-9f9e-06aa20161e2e None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:41.803831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ff24a-6b20-4907-9f9e-06aa20161e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:41.822988 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-533ff24a-6b20-4907-9f9e-06aa20161e2e None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:41.824874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-533ff24a-6b20-4907-9f9e-06aa20161e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:41.895951 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 445/914] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:41.919376 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ee03a-f0ed-4299-98c1-36e0ee62a144 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:42.027518 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ee03a-f0ed-4299-98c1-36e0ee62a144 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:42.029067 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc0b59-96df-42a9-a527-30af8a9489c5 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:42.029355 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc0b59-96df-42a9-a527-30af8a9489c5 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:42.029628 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc0b59-96df-42a9-a527-30af8a9489c5 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:42.032323 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 446/915] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:58:42.037791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb61c5a-6bbf-4ca5-af18-e127b8448a59 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:42.038075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb61c5a-6bbf-4ca5-af18-e127b8448a59 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:42.038351 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb61c5a-6bbf-4ca5-af18-e127b8448a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:42.058610 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-fcb61c5a-6bbf-4ca5-af18-e127b8448a59 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:42.059790 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:42.060298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-fcb61c5a-6bbf-4ca5-af18-e127b8448a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:42.071906 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b83f55-c6df-49a3-bd06-05b03e5a6759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:42.072583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b83f55-c6df-49a3-bd06-05b03e5a6759 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:42.072866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b83f55-c6df-49a3-bd06-05b03e5a6759 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:42.073527 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b83f55-c6df-49a3-bd06-05b03e5a6759 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:42.074174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b83f55-c6df-49a3-bd06-05b03e5a6759 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:42.075544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b83f55-c6df-49a3-bd06-05b03e5a6759 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:42.089364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-e7b83f55-c6df-49a3-bd06-05b03e5a6759 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 09:58:42.089364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:42.089364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:42.089364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:42.089364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:42.089364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:42.089364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:42.089364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:42.089364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 09:58:42.089364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:42.089364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:42.089364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:42.089364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:42.089364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:42.089364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:42.089364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:42.089364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:42.090505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:42.090505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:42.090505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:42.090505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:42.090505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:42.090505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:42.090505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:42.090505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:42.090505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:42.090505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:42.090505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:42.090505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:42.090505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:42.090505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:42.090505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:42.090505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:42.092053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:42.092053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:42.092053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:42.092053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:42.092053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:42.092053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:42.092053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:42.092053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:42.092053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:42.092053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:42.092053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:42.092053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:42.092053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 09:58:42.092053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:42.092053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 470/916] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:58:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:42.100592 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b83f55-c6df-49a3-bd06-05b03e5a6759 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:42.148726 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:42.164510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 447/917] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:42.186235 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb61c5a-6bbf-4ca5-af18-e127b8448a59 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:42.238591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b83f55-c6df-49a3-bd06-05b03e5a6759 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:42.277718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a591ec9-acce-439e-9062-9aba3a8cb637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:42.278910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a591ec9-acce-439e-9062-9aba3a8cb637 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:42.279198 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a591ec9-acce-439e-9062-9aba3a8cb637 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:42.279475 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a591ec9-acce-439e-9062-9aba3a8cb637 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:42.280167 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a591ec9-acce-439e-9062-9aba3a8cb637 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:42.280498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a591ec9-acce-439e-9062-9aba3a8cb637 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:42.282325 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a591ec9-acce-439e-9062-9aba3a8cb637 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:42.296598 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 471/918] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:58:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:42.296598 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a591ec9-acce-439e-9062-9aba3a8cb637 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:42.318733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb61c5a-6bbf-4ca5-af18-e127b8448a59 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:42.358121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03152ce4-27ff-493c-ade9-01e0dbda1213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:42.359342 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03152ce4-27ff-493c-ade9-01e0dbda1213 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:42.359937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03152ce4-27ff-493c-ade9-01e0dbda1213 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:42.360431 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03152ce4-27ff-493c-ade9-01e0dbda1213 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:42.367643 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:42.375827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03152ce4-27ff-493c-ade9-01e0dbda1213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:42.381452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-03152ce4-27ff-493c-ade9-01e0dbda1213 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:58:42.381452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:42.381452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:42.381452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:42.381452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:42.381452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:42.381452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:42.381452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:42.381452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:42.381452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:42.381452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:42.381452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:42.381452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:42.381452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:42.381452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:42.381452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:42.383890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:42.383890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:42.383890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:42.383890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:42.383890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:42.383890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:42.383890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:42.383890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:42.383890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:42.383890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:42.383890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:42.383890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:42.383890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:42.383890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:42.383890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:42.383890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:42.385550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:42.385550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:42.385550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:42.385550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:42.385550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:42.385550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:42.385550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:42.385550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:42.385550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:42.385550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:42.385550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:58:42.385550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:42.385550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 448/919] 10.222.0.85 () {56 vars in 1120 bytes} [Tue Aug 2 09:58:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:42.385550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c08b3-f8f0-41e6-af39-4694669fbb40 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:42.388908 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c08b3-f8f0-41e6-af39-4694669fbb40 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:42.388908 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c08b3-f8f0-41e6-af39-4694669fbb40 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:42.388908 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 449/920] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:42.390018 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c08b3-f8f0-41e6-af39-4694669fbb40 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:42.431151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a591ec9-acce-439e-9062-9aba3a8cb637 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:42.451509 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:42.471214 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3164c-2fdb-4196-8cdc-914f0a46130f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:42.471925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3164c-2fdb-4196-8cdc-914f0a46130f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:42.472212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3164c-2fdb-4196-8cdc-914f0a46130f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:42.472928 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3164c-2fdb-4196-8cdc-914f0a46130f None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:42.473614 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3164c-2fdb-4196-8cdc-914f0a46130f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:42.473924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3164c-2fdb-4196-8cdc-914f0a46130f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:42.475653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3164c-2fdb-4196-8cdc-914f0a46130f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:42.487062 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 472/921] 10.222.0.85 () {56 vars in 1114 bytes} [Tue Aug 2 09:58:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:42.487062 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e69a23-0b46-4588-89d3-f46ac5a75bc0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:42.487062 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e69a23-0b46-4588-89d3-f46ac5a75bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:42.487062 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e69a23-0b46-4588-89d3-f46ac5a75bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:42.501030 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c08b3-f8f0-41e6-af39-4694669fbb40 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:42.505086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-74e69a23-0b46-4588-89d3-f46ac5a75bc0 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:42.506373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-74e69a23-0b46-4588-89d3-f46ac5a75bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:42.541072 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0f9f8-58fc-404e-b038-276c19640830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:42.541646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0f9f8-58fc-404e-b038-276c19640830 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:42.541961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0f9f8-58fc-404e-b038-276c19640830 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:42.542526 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0f9f8-58fc-404e-b038-276c19640830 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:42.543039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0f9f8-58fc-404e-b038-276c19640830 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:42.543348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0f9f8-58fc-404e-b038-276c19640830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:42.544744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0f9f8-58fc-404e-b038-276c19640830 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:42.557992 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 450/922] 10.222.0.85 () {56 vars in 1115 bytes} [Tue Aug 2 09:58:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:42.557992 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0f9f8-58fc-404e-b038-276c19640830 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:42.592671 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 473/923] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:42.592671 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e69a23-0b46-4588-89d3-f46ac5a75bc0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:42.649233 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:42.675962 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0f9f8-58fc-404e-b038-276c19640830 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:42.698255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:42.711084 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e69a23-0b46-4588-89d3-f46ac5a75bc0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:42.722337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b8270-355a-4416-a115-3f9294033a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:42.723289 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b8270-355a-4416-a115-3f9294033a53 None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:42.723587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b8270-355a-4416-a115-3f9294033a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:42.723865 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b8270-355a-4416-a115-3f9294033a53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:42.724638 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b8270-355a-4416-a115-3f9294033a53 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:42.726022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b8270-355a-4416-a115-3f9294033a53 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:42.749441 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 451/924] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 09:58:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:58:42.750952 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b8270-355a-4416-a115-3f9294033a53 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:42.758462 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f54d09-4e23-4de2-80c1-e515d5f58c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:42.759218 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f54d09-4e23-4de2-80c1-e515d5f58c8b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:42.759668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f54d09-4e23-4de2-80c1-e515d5f58c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:42.760004 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f54d09-4e23-4de2-80c1-e515d5f58c8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:42.772772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f54d09-4e23-4de2-80c1-e515d5f58c8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:42.774275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f54d09-4e23-4de2-80c1-e515d5f58c8b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:42.791391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-98f54d09-4e23-4de2-80c1-e515d5f58c8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:42.791391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:42.791391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:42.791391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:42.791391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:42.791391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:42.791391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:42.791391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:42.791391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:42.791391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:42.791391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:42.791391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:42.791391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:42.791391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:42.791391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:42.793963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:42.793963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:42.793963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:42.793963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:42.793963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:42.793963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:42.793963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:42.793963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:42.793963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:42.793963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:42.793963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:42.793963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:42.793963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:42.793963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:42.793963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:42.793963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:42.793963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:42.795153 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:42.795153 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:42.795153 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:42.795153 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:42.795153 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 474/925] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:42.795153 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c052f-c850-4908-acae-20de610a73a2 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:42.795153 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c052f-c850-4908-acae-20de610a73a2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:42.796088 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c052f-c850-4908-acae-20de610a73a2 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:42.796803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 475/926] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:42.801310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c052f-c850-4908-acae-20de610a73a2 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:42.879558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b8270-355a-4416-a115-3f9294033a53 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:42.917520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d0f91-6259-440d-90d4-274a399aaf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:42.918322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d0f91-6259-440d-90d4-274a399aaf60 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:42.918498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:42.918585 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d0f91-6259-440d-90d4-274a399aaf60 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:42.918860 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d0f91-6259-440d-90d4-274a399aaf60 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:42.919619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d0f91-6259-440d-90d4-274a399aaf60 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:42.921780 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d0f91-6259-440d-90d4-274a399aaf60 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:42.928576 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c052f-c850-4908-acae-20de610a73a2 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:42.931281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-0a2d0f91-6259-440d-90d4-274a399aaf60 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:58:42.931281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:42.931281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:42.931281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:42.931281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:42.931281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:42.931281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:42.931281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:42.931281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:58:42.931281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:42.931281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:42.931281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:42.931281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:42.931281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:42.931281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:42.931281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:42.931281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:42.932276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:42.932276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:42.932276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:42.932276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:42.932276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:42.932276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:42.932276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:42.932276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:42.932276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:42.932276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:42.932276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:42.932276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:42.932276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:42.932276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:42.932276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:42.932276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:42.933883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:42.933883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:42.933883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:42.933883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:42.933883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:42.933883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:42.933883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:42.933883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:42.933883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:42.933883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:42.933883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:42.933883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:42.933883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:58:42.933883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:42.933883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 452/927] 10.222.0.85 () {56 vars in 1126 bytes} [Tue Aug 2 09:58:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:42.935205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6593e9f-5652-44e9-bfee-d11a39400c8f None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:42.935493 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6593e9f-5652-44e9-bfee-d11a39400c8f None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:42.935767 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6593e9f-5652-44e9-bfee-d11a39400c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:42.956993 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-e6593e9f-5652-44e9-bfee-d11a39400c8f None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:42.958424 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e6593e9f-5652-44e9-bfee-d11a39400c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:42.972535 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972b1d0-e325-4bca-964d-5c27740bb350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:42.973209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972b1d0-e325-4bca-964d-5c27740bb350 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:42.973486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972b1d0-e325-4bca-964d-5c27740bb350 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:42.973755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972b1d0-e325-4bca-964d-5c27740bb350 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:42.974507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972b1d0-e325-4bca-964d-5c27740bb350 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:42.974809 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972b1d0-e325-4bca-964d-5c27740bb350 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:42.976217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972b1d0-e325-4bca-964d-5c27740bb350 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:42.989909 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 476/928] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:42.990815 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972b1d0-e325-4bca-964d-5c27740bb350 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:42.997619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:43.039145 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 453/929] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:43.039992 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6593e9f-5652-44e9-bfee-d11a39400c8f None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:43.113028 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972b1d0-e325-4bca-964d-5c27740bb350 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:43.153834 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6593e9f-5652-44e9-bfee-d11a39400c8f None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:43.160201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf500d-aedc-4850-bd80-2321388286c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:43.160850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf500d-aedc-4850-bd80-2321388286c3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:43.161130 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf500d-aedc-4850-bd80-2321388286c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:43.161401 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf500d-aedc-4850-bd80-2321388286c3 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:43.162082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf500d-aedc-4850-bd80-2321388286c3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:43.162384 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf500d-aedc-4850-bd80-2321388286c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:43.163743 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acf500d-aedc-4850-bd80-2321388286c3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:43.173008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 477/930] 10.222.0.85 () {56 vars in 1122 bytes} [Tue Aug 2 09:58:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:43.173689 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf500d-aedc-4850-bd80-2321388286c3 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:43.197222 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:43.204013 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f6ab6-de77-47df-b0ca-457b15f7c1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:43.205110 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f6ab6-de77-47df-b0ca-457b15f7c1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:43.205580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f6ab6-de77-47df-b0ca-457b15f7c1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:43.206042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f6ab6-de77-47df-b0ca-457b15f7c1d7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:43.218690 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f6ab6-de77-47df-b0ca-457b15f7c1d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:43.220127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f6ab6-de77-47df-b0ca-457b15f7c1d7 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:43.233423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-534f6ab6-de77-47df-b0ca-457b15f7c1d7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:58:43.233423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:43.233423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:43.233423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:43.233423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:43.233423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:43.233423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:43.233423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:43.233423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:43.233423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:43.233423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:43.233423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:43.233423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:43.233423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:43.233423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:43.233423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:43.234565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:43.234565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:43.234565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:43.234565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:43.234565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:43.234565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:43.234565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:43.234565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:43.234565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:43.234565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:43.234565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:43.234565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:43.234565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:43.234565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:43.234565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:43.234565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:43.234565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:43.234565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:43.236196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:43.236196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:43.236196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:43.236196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:43.236196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:43.236196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:43.236196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:43.236196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:43.236196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:58:43.236196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:43.239405 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 454/931] 10.222.0.85 () {56 vars in 1117 bytes} [Tue Aug 2 09:58:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:43.240263 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f6ab6-de77-47df-b0ca-457b15f7c1d7 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:43.272733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:43.299073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf500d-aedc-4850-bd80-2321388286c3 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:43.334532 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d1e72-61b5-4785-9319-e1f17de19b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:43.335201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d1e72-61b5-4785-9319-e1f17de19b0b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:43.335487 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d1e72-61b5-4785-9319-e1f17de19b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:43.335761 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d1e72-61b5-4785-9319-e1f17de19b0b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:43.336441 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d1e72-61b5-4785-9319-e1f17de19b0b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:43.337785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d1e72-61b5-4785-9319-e1f17de19b0b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:43.347903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-1c7d1e72-61b5-4785-9319-e1f17de19b0b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 09:58:43.347903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:43.347903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:43.347903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:43.347903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:43.347903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:43.347903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:43.347903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:43.347903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 09:58:43.347903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:43.347903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:43.347903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:43.347903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:43.347903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:43.347903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:43.347903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:43.349096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:43.349096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:43.349096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:43.349096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:43.349096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:43.349096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:43.349096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:43.349096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:43.349096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:43.349096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:43.349096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:43.349096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:43.349096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:43.349096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:43.349096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:43.349096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:43.356021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:43.356021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:43.356021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:43.356021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:43.356021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:43.356021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:43.356021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:43.356021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:43.356021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:43.356021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:43.356021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:43.356021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:43.356021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:43.356021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 09:58:43.356021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:43.356021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 478/932] 10.222.0.85 () {56 vars in 1132 bytes} [Tue Aug 2 09:58:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:43.356984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d1e72-61b5-4785-9319-e1f17de19b0b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:43.373647 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f6ab6-de77-47df-b0ca-457b15f7c1d7 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:43.410874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8daac3-ca97-461d-a539-1ad9dba554d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:43.411524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8daac3-ca97-461d-a539-1ad9dba554d8 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:43.411801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8daac3-ca97-461d-a539-1ad9dba554d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:43.412075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8daac3-ca97-461d-a539-1ad9dba554d8 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:43.412778 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8daac3-ca97-461d-a539-1ad9dba554d8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:43.413226 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8daac3-ca97-461d-a539-1ad9dba554d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:43.414625 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8daac3-ca97-461d-a539-1ad9dba554d8 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:43.420679 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 455/933] 10.222.0.85 () {56 vars in 1122 bytes} [Tue Aug 2 09:58:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:43.421470 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8daac3-ca97-461d-a539-1ad9dba554d8 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:43.449256 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:43.471488 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d1e72-61b5-4785-9319-e1f17de19b0b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:43.508595 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59568778-a2b1-4daf-b20a-13e36ef06646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:43.509638 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568778-a2b1-4daf-b20a-13e36ef06646 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:43.510128 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568778-a2b1-4daf-b20a-13e36ef06646 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:43.511134 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568778-a2b1-4daf-b20a-13e36ef06646 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:43.512724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59568778-a2b1-4daf-b20a-13e36ef06646 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:43.513232 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59568778-a2b1-4daf-b20a-13e36ef06646 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:43.515040 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59568778-a2b1-4daf-b20a-13e36ef06646 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:43.530516 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:43.539728 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 479/934] 10.222.0.85 () {56 vars in 1149 bytes} [Tue Aug 2 09:58:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:43.539728 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59568778-a2b1-4daf-b20a-13e36ef06646 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:43.544979 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8daac3-ca97-461d-a539-1ad9dba554d8 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:43.581298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b3afb-4d87-4dd8-994d-cce5740f8730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:43.582006 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b3afb-4d87-4dd8-994d-cce5740f8730 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:43.582357 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b3afb-4d87-4dd8-994d-cce5740f8730 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:43.582701 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b3afb-4d87-4dd8-994d-cce5740f8730 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:43.583448 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b3afb-4d87-4dd8-994d-cce5740f8730 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:43.583831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b3afb-4d87-4dd8-994d-cce5740f8730 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:43.585319 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b3afb-4d87-4dd8-994d-cce5740f8730 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:43.595243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 456/935] 10.222.0.85 () {56 vars in 1126 bytes} [Tue Aug 2 09:58:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:43.595243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b3afb-4d87-4dd8-994d-cce5740f8730 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:43.655084 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59568778-a2b1-4daf-b20a-13e36ef06646 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:43.691434 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092600c-cdcf-475d-bfb3-377fcc42002e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:43.692180 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092600c-cdcf-475d-bfb3-377fcc42002e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:43.692649 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092600c-cdcf-475d-bfb3-377fcc42002e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:43.693028 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092600c-cdcf-475d-bfb3-377fcc42002e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:43.693873 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092600c-cdcf-475d-bfb3-377fcc42002e None admin] RBAC: Adding query filter params (interface=public, service_id=0b91e862bc82452e99207593833a7f4d, region_id=RegionOne) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:43.694299 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092600c-cdcf-475d-bfb3-377fcc42002e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:43.695977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092600c-cdcf-475d-bfb3-377fcc42002e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:43.698230 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b3afb-4d87-4dd8-994d-cce5740f8730 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:43.706261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 480/936] 10.222.0.85 () {56 vars in 1251 bytes} [Tue Aug 2 09:58:43 2022] GET /identity/v3/endpoints?service_id=0b91e862bc82452e99207593833a7f4d&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:43.706261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092600c-cdcf-475d-bfb3-377fcc42002e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:43.707649 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:43.734678 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f1eca-1dcc-40b4-898c-5239c5969551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:43.735391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f1eca-1dcc-40b4-898c-5239c5969551 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:43.735747 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f1eca-1dcc-40b4-898c-5239c5969551 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:43.736103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f1eca-1dcc-40b4-898c-5239c5969551 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:43.747283 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f1eca-1dcc-40b4-898c-5239c5969551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:43.748821 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f1eca-1dcc-40b4-898c-5239c5969551 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:43.763396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-2c1f1eca-1dcc-40b4-898c-5239c5969551 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:43.763396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:43.763396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:43.763396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:43.763396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:43.763396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:43.763396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:43.763396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:43.763396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:43.763396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:43.763396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:43.763396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:43.763396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:43.763396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:43.763396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:43.764508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:43.764508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:43.764508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:43.764508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:43.764508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:43.764508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:43.764508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:43.764508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:43.764508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:43.764508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:43.764508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:43.764508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:43.764508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:43.764508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:43.764508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:43.764508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:43.764508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:43.765714 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:43.765714 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:43.765714 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:43.765714 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:43.765714 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 457/937] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:43.765714 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f1eca-1dcc-40b4-898c-5239c5969551 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:43.779958 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:43.819234 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092600c-cdcf-475d-bfb3-377fcc42002e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:43.857514 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb303c52-9700-4741-86ca-e12ddfae1669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:43.858126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb303c52-9700-4741-86ca-e12ddfae1669 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:43.858512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb303c52-9700-4741-86ca-e12ddfae1669 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:43.858784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb303c52-9700-4741-86ca-e12ddfae1669 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:43.859569 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb303c52-9700-4741-86ca-e12ddfae1669 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:43.859871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb303c52-9700-4741-86ca-e12ddfae1669 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:43.861251 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb303c52-9700-4741-86ca-e12ddfae1669 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:43.866755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 481/938] 10.222.0.85 () {56 vars in 1126 bytes} [Tue Aug 2 09:58:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:43.867555 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb303c52-9700-4741-86ca-e12ddfae1669 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:43.880731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f1eca-1dcc-40b4-898c-5239c5969551 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:43.916058 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9e4e9-37c4-4c73-b193-63aba3ca52e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:43.916708 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9e4e9-37c4-4c73-b193-63aba3ca52e0 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:43.917575 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9e4e9-37c4-4c73-b193-63aba3ca52e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:43.917930 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9e4e9-37c4-4c73-b193-63aba3ca52e0 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:43.918641 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9e4e9-37c4-4c73-b193-63aba3ca52e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:43.920021 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9e4e9-37c4-4c73-b193-63aba3ca52e0 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:43.926665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 458/939] 10.222.0.85 () {56 vars in 1087 bytes} [Tue Aug 2 09:58:43 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:58:43.927368 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9e4e9-37c4-4c73-b193-63aba3ca52e0 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:43.966485 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:44.012578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb303c52-9700-4741-86ca-e12ddfae1669 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:44.025133 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:44.057195 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cdfc7-7f48-4470-8a52-f6d4019be2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:44.058584 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cdfc7-7f48-4470-8a52-f6d4019be2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:44.059045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cdfc7-7f48-4470-8a52-f6d4019be2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:44.059401 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cdfc7-7f48-4470-8a52-f6d4019be2a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:44.060121 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cdfc7-7f48-4470-8a52-f6d4019be2a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:44.060424 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cdfc7-7f48-4470-8a52-f6d4019be2a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:44.061838 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cdfc7-7f48-4470-8a52-f6d4019be2a8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:44.064438 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9e4e9-37c4-4c73-b193-63aba3ca52e0 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:44.076925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 482/940] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:44.082261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cdfc7-7f48-4470-8a52-f6d4019be2a8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:44.108879 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bacd4-5170-4cdf-a17f-993955b5d8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:44.109783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bacd4-5170-4cdf-a17f-993955b5d8da None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:44.111019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bacd4-5170-4cdf-a17f-993955b5d8da None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:44.111019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bacd4-5170-4cdf-a17f-993955b5d8da None admin] PATH_INFO: `/v3/endpoints` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:44.111198 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bacd4-5170-4cdf-a17f-993955b5d8da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:44.112587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bacd4-5170-4cdf-a17f-993955b5d8da None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:44.139652 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 459/941] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 09:58:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:58:44.209011 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cdfc7-7f48-4470-8a52-f6d4019be2a8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:44.242280 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:44.258600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa7429-57c0-453e-a047-7235ed13fedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:44.259545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa7429-57c0-453e-a047-7235ed13fedf None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:44.259990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa7429-57c0-453e-a047-7235ed13fedf None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:44.260477 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa7429-57c0-453e-a047-7235ed13fedf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:44.269200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa7429-57c0-453e-a047-7235ed13fedf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:44.270935 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa7429-57c0-453e-a047-7235ed13fedf None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:44.284840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-abaa7429-57c0-453e-a047-7235ed13fedf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:44.284840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:44.284840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:44.284840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:44.284840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:44.284840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:44.284840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:44.284840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:44.284840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:44.284840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:44.284840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:44.284840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:44.284840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:44.284840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:44.284840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:44.286010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:44.286010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:44.286010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:44.286010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:44.286010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:44.286010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:44.286010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:44.286010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:44.286010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:44.286010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:44.286010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:44.286010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:44.286010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:44.286010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:44.286010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:44.286010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:44.286010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:44.287082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:44.287082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:44.287082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:44.287082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:44.287082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:44.287082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:44.287082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:44.287082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:44.289781 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 483/942] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:44.299662 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bacd4-5170-4cdf-a17f-993955b5d8da None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:44.410186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bacd4-5170-4cdf-a17f-993955b5d8da None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:44.438801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:44.447335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef87989-5d6e-46a9-a302-41f5e6103d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:44.449010 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef87989-5d6e-46a9-a302-41f5e6103d4e None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:44.449759 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef87989-5d6e-46a9-a302-41f5e6103d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:44.450571 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef87989-5d6e-46a9-a302-41f5e6103d4e None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:44.451558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef87989-5d6e-46a9-a302-41f5e6103d4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:44.451940 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef87989-5d6e-46a9-a302-41f5e6103d4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:44.453657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef87989-5d6e-46a9-a302-41f5e6103d4e None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:44.468509 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 460/943] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:44.474747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa7429-57c0-453e-a047-7235ed13fedf None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:44.581173 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa7429-57c0-453e-a047-7235ed13fedf None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:44.622878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e052f59-6479-45f0-a934-ff27ac3581f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:44.623734 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e052f59-6479-45f0-a934-ff27ac3581f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:44.624332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e052f59-6479-45f0-a934-ff27ac3581f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:44.624808 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e052f59-6479-45f0-a934-ff27ac3581f5 None admin] PATH_INFO: `/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/f43a16e2dcab4872963222c557853d32/roles/142cbbffc00f4c1aa03655720f13107c` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:44.627099 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e052f59-6479-45f0-a934-ff27ac3581f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=701d7ad0b7594984885e7bfe8a236937, user_id=f43a16e2dcab4872963222c557853d32, role_id=142cbbffc00f4c1aa03655720f13107c)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:44.628660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e052f59-6479-45f0-a934-ff27ac3581f5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:44.646407 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 484/944] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:58:44 2022] PUT /identity/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/f43a16e2dcab4872963222c557853d32/roles/142cbbffc00f4c1aa03655720f13107c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:58:44.866197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650cf36-aed5-4a62-b894-f74c148934ec None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:44.866545 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650cf36-aed5-4a62-b894-f74c148934ec None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:44.866660 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e650cf36-aed5-4a62-b894-f74c148934ec None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:44.868268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 461/945] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:44.874165 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d799cb2-dbab-4b24-9a1d-3fefb3377b56 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:44.874712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d799cb2-dbab-4b24-9a1d-3fefb3377b56 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:44.874712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d799cb2-dbab-4b24-9a1d-3fefb3377b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:44.894364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6d799cb2-dbab-4b24-9a1d-3fefb3377b56 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:44.895544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6d799cb2-dbab-4b24-9a1d-3fefb3377b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:44.939617 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:44.968761 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 485/946] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:44.991621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650cf36-aed5-4a62-b894-f74c148934ec None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:45.100590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e650cf36-aed5-4a62-b894-f74c148934ec None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:45.141705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408c73e-3717-4b7a-8bf7-0542fb8e7be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:45.142249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408c73e-3717-4b7a-8bf7-0542fb8e7be1 None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:45.142535 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408c73e-3717-4b7a-8bf7-0542fb8e7be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:45.142817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408c73e-3717-4b7a-8bf7-0542fb8e7be1 None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:45.143515 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408c73e-3717-4b7a-8bf7-0542fb8e7be1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:45.144984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408c73e-3717-4b7a-8bf7-0542fb8e7be1 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:45.147878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: WARNING keystone.server.flask.common [None req-2408c73e-3717-4b7a-8bf7-0542fb8e7be1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 02 09:58:45.167343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.sql.core [None req-2408c73e-3717-4b7a-8bf7-0542fb8e7be1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 09:58:45.167343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 02 09:58:45.167343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [parameters: {'id': 'fef44f7159bd47f2845083c49a54f9ad', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 02 09:58:45.167343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80329) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 09:58:45.176428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-2408c73e-3717-4b7a-8bf7-0542fb8e7be1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fef44f7159bd47f2845083c49a54f9ad.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fef44f7159bd47f2845083c49a54f9ad. Aug 02 09:58:45.176428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:45.176428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 09:58:45.176428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 09:58:45.176428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 09:58:45.176428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 09:58:45.176428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 09:58:45.176428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 09:58:45.176428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 09:58:45.176428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application conn.query(q) Aug 02 09:58:45.176428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 09:58:45.176428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 09:58:45.176428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 09:58:45.177229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application result.read() Aug 02 09:58:45.177229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 09:58:45.177229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 09:58:45.177229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 09:58:45.177229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 09:58:45.177229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 09:58:45.177229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 09:58:45.177229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 09:58:45.177229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 09:58:45.177229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 09:58:45.177229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:45.177229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 09:58:45.177229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:45.177229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:45.177229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 09:58:45.177229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 09:58:45.177229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 02 09:58:45.177229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 02 09:58:45.178164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 09:58:45.178164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application next(self.gen) Aug 02 09:58:45.178164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 09:58:45.178164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application yield resource Aug 02 09:58:45.178164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 09:58:45.178164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application next(self.gen) Aug 02 09:58:45.178164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 09:58:45.178164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 09:58:45.178164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 09:58:45.178164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 09:58:45.178164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 09:58:45.178164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise self.value Aug 02 09:58:45.178164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 09:58:45.178164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 09:58:45.178164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 09:58:45.178164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application session.commit() Aug 02 09:58:45.178164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 09:58:45.179040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 09:58:45.179040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 09:58:45.179040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 09:58:45.179040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 09:58:45.179040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self.session.flush() Aug 02 09:58:45.179040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 09:58:45.179040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 09:58:45.179040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 09:58:45.179040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 09:58:45.179040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 09:58:45.179040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application compat.raise_( Aug 02 09:58:45.179040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 09:58:45.179040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception Aug 02 09:58:45.179040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 09:58:45.179040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 09:58:45.179040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 09:58:45.179040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 09:58:45.179924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 09:58:45.179924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 09:58:45.179924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 09:58:45.179924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 09:58:45.179924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 02 09:58:45.179924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 02 09:58:45.179924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 09:58:45.179924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 09:58:45.179924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 09:58:45.179924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 09:58:45.179924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 09:58:45.179924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 09:58:45.179924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 09:58:45.179924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 09:58:45.179924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 09:58:45.180740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 09:58:45.180740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 09:58:45.180740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception Aug 02 09:58:45.180740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 09:58:45.180740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 09:58:45.180740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 09:58:45.180740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 09:58:45.180740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 09:58:45.180740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 09:58:45.180740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 09:58:45.180740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application conn.query(q) Aug 02 09:58:45.180740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 09:58:45.180740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 09:58:45.180740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 09:58:45.180740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application result.read() Aug 02 09:58:45.180740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 09:58:45.180740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 09:58:45.181593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 09:58:45.181593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 09:58:45.181593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 09:58:45.181593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 09:58:45.181593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 09:58:45.181593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 09:58:45.181593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 09:58:45.181593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 02 09:58:45.181593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [parameters: {'id': 'fef44f7159bd47f2845083c49a54f9ad', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 02 09:58:45.181593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 09:58:45.181593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:45.181593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:45.181593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:45.181593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:45.181593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 02 09:58:45.182404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 02 09:58:45.182404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 09:58:45.182404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 09:58:45.182404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 02 09:58:45.182404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:45.182404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:45.182404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:45.182404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:45.182404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:45.182404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:45.182404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:45.182404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:45.182404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:45.182404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:45.182404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:45.182404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:45.182404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:45.188953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:45.188953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 02 09:58:45.188953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 02 09:58:45.188953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:45.188953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:45.188953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 02 09:58:45.188953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 02 09:58:45.188953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fef44f7159bd47f2845083c49a54f9ad. Aug 02 09:58:45.188953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:45.188953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 462/947] 10.222.0.85 () {60 vars in 1140 bytes} [Tue Aug 2 09:58:44 2022] POST /identity/v3/projects => generated 262 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:45.189553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d799cb2-dbab-4b24-9a1d-3fefb3377b56 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:45.301568 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d799cb2-dbab-4b24-9a1d-3fefb3377b56 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:45.338389 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3499c-e325-474a-9f35-d44768b68a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:45.339761 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3499c-e325-474a-9f35-d44768b68a82 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:45.340025 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3499c-e325-474a-9f35-d44768b68a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:45.340325 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3499c-e325-474a-9f35-d44768b68a82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:45.347433 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3499c-e325-474a-9f35-d44768b68a82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:45.348889 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d3499c-e325-474a-9f35-d44768b68a82 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:45.361043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-b4d3499c-e325-474a-9f35-d44768b68a82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:45.361043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:45.361043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:45.361043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:45.361043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:45.361043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:45.361043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:45.361043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:45.361043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:45.361043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:45.361043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:45.361043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:45.361043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:45.361043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:45.361043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:45.362833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:45.362833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:45.362833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:45.362833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:45.362833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:45.362833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:45.362833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:45.362833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:45.362833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:45.362833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:45.362833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:45.362833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:45.362833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:45.362833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:45.362833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:45.362833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:45.362833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:45.364924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:45.364924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:45.364924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:45.364924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:45.364924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:45.364924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:45.364924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:45.364924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:45.364924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 486/948] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:45.368313 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408c73e-3717-4b7a-8bf7-0542fb8e7be1 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:45.422607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:45.488387 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408c73e-3717-4b7a-8bf7-0542fb8e7be1 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:45.524193 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2436f-a19b-4df2-8e6f-ecc733a2e7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:45.524843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2436f-a19b-4df2-8e6f-ecc733a2e7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:45.525129 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2436f-a19b-4df2-8e6f-ecc733a2e7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:45.525452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2436f-a19b-4df2-8e6f-ecc733a2e7a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:45.526724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2436f-a19b-4df2-8e6f-ecc733a2e7a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:45.527405 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2436f-a19b-4df2-8e6f-ecc733a2e7a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:45.528685 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2436f-a19b-4df2-8e6f-ecc733a2e7a6 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:45.550063 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 463/949] 10.222.0.85 () {56 vars in 1112 bytes} [Tue Aug 2 09:58:45 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:46.127317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8534c-07c0-4f76-8e11-8b424d2463dc None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:46.128019 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8534c-07c0-4f76-8e11-8b424d2463dc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:46.128019 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8534c-07c0-4f76-8e11-8b424d2463dc None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:46.129471 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 487/950] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:46.134878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216a8e9-ab35-42f7-9da5-e921aa5f2b17 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:46.135351 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216a8e9-ab35-42f7-9da5-e921aa5f2b17 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:46.135625 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216a8e9-ab35-42f7-9da5-e921aa5f2b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:46.155007 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-d216a8e9-ab35-42f7-9da5-e921aa5f2b17 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:46.156531 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-d216a8e9-ab35-42f7-9da5-e921aa5f2b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:46.224977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 464/951] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:46.248501 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8534c-07c0-4f76-8e11-8b424d2463dc None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:46.285841 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:46.357312 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8534c-07c0-4f76-8e11-8b424d2463dc None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:46.393537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234d5eb-9940-4585-9249-a36e769ab3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:46.394994 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020a5d5-3120-4996-b5e4-38e7193f182f None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:46.397173 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020a5d5-3120-4996-b5e4-38e7193f182f None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:46.397173 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020a5d5-3120-4996-b5e4-38e7193f182f None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:46.397360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234d5eb-9940-4585-9249-a36e769ab3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:46.397360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234d5eb-9940-4585-9249-a36e769ab3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:46.397360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234d5eb-9940-4585-9249-a36e769ab3f9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:46.397360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234d5eb-9940-4585-9249-a36e769ab3f9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:46.397620 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 465/952] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:58:46.399273 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234d5eb-9940-4585-9249-a36e769ab3f9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:46.402902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fd344-2de7-4e02-a147-9a44b5ec2acc None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:46.403238 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fd344-2de7-4e02-a147-9a44b5ec2acc None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:46.403515 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fd344-2de7-4e02-a147-9a44b5ec2acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:46.410796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-b234d5eb-9940-4585-9249-a36e769ab3f9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:58:46.410796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:46.410796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:46.410796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:46.410796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:46.410796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:46.410796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:46.410796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:46.410796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:58:46.410796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:46.410796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:46.410796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:46.410796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:46.410796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:46.410796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:46.410796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:46.410796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:46.411799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:46.411799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:46.411799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:46.411799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:46.411799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:46.411799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:46.411799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:46.411799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:46.411799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:46.411799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:46.411799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:46.411799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:46.411799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:46.411799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:46.411799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:46.411799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:46.412847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:46.412847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:46.412847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:46.412847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:46.412847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:46.412847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:46.412847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:46.412847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:46.412847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:46.412847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:46.412847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:46.412847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:46.412847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:58:46.412847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:46.416423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 488/953] 10.222.0.85 () {56 vars in 1126 bytes} [Tue Aug 2 09:58:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:46.420059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234d5eb-9940-4585-9249-a36e769ab3f9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:46.429119 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-235fd344-2de7-4e02-a147-9a44b5ec2acc None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:46.430730 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-235fd344-2de7-4e02-a147-9a44b5ec2acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:46.464851 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:46.507570 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 466/954] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:58:46.527549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:46.528989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fd344-2de7-4e02-a147-9a44b5ec2acc None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:46.532887 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234d5eb-9940-4585-9249-a36e769ab3f9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:46.571544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd7c39-2b4d-4ce1-8e02-a7c7380fb01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:46.572646 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd7c39-2b4d-4ce1-8e02-a7c7380fb01c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:46.573835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd7c39-2b4d-4ce1-8e02-a7c7380fb01c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:46.574233 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd7c39-2b4d-4ce1-8e02-a7c7380fb01c None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:46.575098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd7c39-2b4d-4ce1-8e02-a7c7380fb01c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:46.575541 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd7c39-2b4d-4ce1-8e02-a7c7380fb01c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:46.578010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd7c39-2b4d-4ce1-8e02-a7c7380fb01c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:46.584620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 489/955] 10.222.0.85 () {56 vars in 1122 bytes} [Tue Aug 2 09:58:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:46.591127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd7c39-2b4d-4ce1-8e02-a7c7380fb01c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:46.669108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fd344-2de7-4e02-a147-9a44b5ec2acc None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:46.719111 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33be6a-d0ad-406d-bc7a-7dd93773698b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:46.719779 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33be6a-d0ad-406d-bc7a-7dd93773698b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:46.720072 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33be6a-d0ad-406d-bc7a-7dd93773698b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:46.720352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33be6a-d0ad-406d-bc7a-7dd93773698b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:46.720930 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd7c39-2b4d-4ce1-8e02-a7c7380fb01c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:46.721060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33be6a-d0ad-406d-bc7a-7dd93773698b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:46.722776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33be6a-d0ad-406d-bc7a-7dd93773698b None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:46.736249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-1e33be6a-d0ad-406d-bc7a-7dd93773698b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 09:58:46.736249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:46.736249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:46.736249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:46.736249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:46.736249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:46.736249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:46.736249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:46.736249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 09:58:46.736249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:46.736249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:46.736249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:46.736249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:46.736249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:46.736249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:46.736249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:46.736249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:46.737473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:46.737473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:46.737473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:46.737473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:46.737473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:46.737473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:46.737473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:46.737473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:46.737473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:46.737473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:46.737473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:46.737473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:46.737473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:46.737473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:46.737473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:46.737473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:46.738348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:46.738348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:46.738348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:46.738348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:46.738348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:46.738348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:46.738348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:46.738348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:46.738348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:46.738348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:46.738348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:46.738348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:46.738348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 09:58:46.738348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:46.739078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 467/956] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:46.746416 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33be6a-d0ad-406d-bc7a-7dd93773698b None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:46.763779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fa755-7457-4379-9336-bbb14f620fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:46.764818 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fa755-7457-4379-9336-bbb14f620fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:46.765341 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fa755-7457-4379-9336-bbb14f620fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:46.765830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fa755-7457-4379-9336-bbb14f620fa8 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:46.766726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fa755-7457-4379-9336-bbb14f620fa8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:46.767250 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fa755-7457-4379-9336-bbb14f620fa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:46.768850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fa755-7457-4379-9336-bbb14f620fa8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:46.774639 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 490/957] 10.222.0.85 () {56 vars in 1122 bytes} [Tue Aug 2 09:58:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:46.780665 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fa755-7457-4379-9336-bbb14f620fa8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:46.782989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:46.817515 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:46.863154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33be6a-d0ad-406d-bc7a-7dd93773698b None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:46.900924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60dcf0-e58d-4192-8011-9bfe186f32ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:46.902261 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60dcf0-e58d-4192-8011-9bfe186f32ea None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:46.902545 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60dcf0-e58d-4192-8011-9bfe186f32ea None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:46.902830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60dcf0-e58d-4192-8011-9bfe186f32ea None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:46.903513 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60dcf0-e58d-4192-8011-9bfe186f32ea None admin] RBAC: Adding query filter params (name=compute) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:46.903825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60dcf0-e58d-4192-8011-9bfe186f32ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:46.905232 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60dcf0-e58d-4192-8011-9bfe186f32ea None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:46.910084 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fa755-7457-4379-9336-bbb14f620fa8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:46.910309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 468/958] 10.222.0.85 () {56 vars in 1112 bytes} [Tue Aug 2 09:58:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:46.911481 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62880cc-4eb2-4505-b077-c399c3d451fb None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:46.911770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62880cc-4eb2-4505-b077-c399c3d451fb None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:46.912050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62880cc-4eb2-4505-b077-c399c3d451fb None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:46.916562 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 469/959] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:46.916562 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62880cc-4eb2-4505-b077-c399c3d451fb None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:46.954218 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6bef4-79b4-4843-a64c-59512c001613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:46.955119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6bef4-79b4-4843-a64c-59512c001613 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:46.955643 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6bef4-79b4-4843-a64c-59512c001613 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:46.955914 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6bef4-79b4-4843-a64c-59512c001613 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:46.956649 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6bef4-79b4-4843-a64c-59512c001613 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:46.958002 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6bef4-79b4-4843-a64c-59512c001613 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:46.983236 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 491/960] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 09:58:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:58:46.994033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb71a6e-fd2e-4e0c-b227-2907c41387d0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:46.994385 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb71a6e-fd2e-4e0c-b227-2907c41387d0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:46.994597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb71a6e-fd2e-4e0c-b227-2907c41387d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:47.014473 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-adb71a6e-fd2e-4e0c-b227-2907c41387d0 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:47.015713 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-adb71a6e-fd2e-4e0c-b227-2907c41387d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:47.036963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:47.063814 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62880cc-4eb2-4505-b077-c399c3d451fb None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:47.104850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 492/961] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:47.116917 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd1ea3-0c82-45a9-bba3-7a0271eae629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:47.117650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd1ea3-0c82-45a9-bba3-7a0271eae629 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:47.118011 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd1ea3-0c82-45a9-bba3-7a0271eae629 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:47.118400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd1ea3-0c82-45a9-bba3-7a0271eae629 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:47.119205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd1ea3-0c82-45a9-bba3-7a0271eae629 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:47.119575 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd1ea3-0c82-45a9-bba3-7a0271eae629 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:47.121651 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd1ea3-0c82-45a9-bba3-7a0271eae629 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:47.127473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 470/962] 10.222.0.85 () {56 vars in 1112 bytes} [Tue Aug 2 09:58:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:47.128974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb71a6e-fd2e-4e0c-b227-2907c41387d0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:47.147505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:47.257025 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb71a6e-fd2e-4e0c-b227-2907c41387d0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:47.306847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349af9f-1ca0-40c4-abb8-0eb91ec0c6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:47.307586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349af9f-1ca0-40c4-abb8-0eb91ec0c6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:47.307870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349af9f-1ca0-40c4-abb8-0eb91ec0c6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:47.308144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349af9f-1ca0-40c4-abb8-0eb91ec0c6c8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:47.324682 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349af9f-1ca0-40c4-abb8-0eb91ec0c6c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:47.329965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-8349af9f-1ca0-40c4-abb8-0eb91ec0c6c8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:58:47.329965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:47.329965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:47.329965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:47.329965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:47.329965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:47.329965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:47.329965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:47.329965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:47.329965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:47.329965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:47.329965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:47.329965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:47.329965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:47.329965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:47.329965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:47.330917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:47.330917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:47.330917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:47.330917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:47.330917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:47.330917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:47.330917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:47.330917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:47.330917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:47.330917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:47.330917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:47.330917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:47.330917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:47.330917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:47.330917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:47.330917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:47.331759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:47.331759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:47.331759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:47.331759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:47.331759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:47.331759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:47.331759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:47.331759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:47.331759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:47.331759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:47.331759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:58:47.331759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:47.332418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 493/963] 10.222.0.85 () {56 vars in 1120 bytes} [Tue Aug 2 09:58:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:47.338024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd1ea3-0c82-45a9-bba3-7a0271eae629 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:47.448654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd1ea3-0c82-45a9-bba3-7a0271eae629 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:47.485004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c528a02-a011-4c97-9485-a7306d19a5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:47.485622 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c528a02-a011-4c97-9485-a7306d19a5cb None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:47.485901 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c528a02-a011-4c97-9485-a7306d19a5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:47.486201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c528a02-a011-4c97-9485-a7306d19a5cb None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:47.486885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c528a02-a011-4c97-9485-a7306d19a5cb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:47.487189 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c528a02-a011-4c97-9485-a7306d19a5cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:47.488594 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c528a02-a011-4c97-9485-a7306d19a5cb None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:47.498127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 471/964] 10.222.0.85 () {56 vars in 1115 bytes} [Tue Aug 2 09:58:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:47.503780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349af9f-1ca0-40c4-abb8-0eb91ec0c6c8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:47.578078 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:47.613161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349af9f-1ca0-40c4-abb8-0eb91ec0c6c8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:47.648867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e617e7-96f3-40dc-84d5-f01405e1f90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:47.649516 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e617e7-96f3-40dc-84d5-f01405e1f90e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:47.649798 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e617e7-96f3-40dc-84d5-f01405e1f90e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:47.650074 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e617e7-96f3-40dc-84d5-f01405e1f90e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:47.661939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e617e7-96f3-40dc-84d5-f01405e1f90e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:47.663404 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e617e7-96f3-40dc-84d5-f01405e1f90e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:47.678820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-b0e617e7-96f3-40dc-84d5-f01405e1f90e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:47.678820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:47.678820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:47.678820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:47.678820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:47.678820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:47.678820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:47.678820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:47.678820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:47.678820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:47.678820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:47.678820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:47.678820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:47.678820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:47.678820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:47.679725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:47.679725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:47.679725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:47.679725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:47.679725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:47.679725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:47.679725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:47.679725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:47.679725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:47.679725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:47.679725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:47.679725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:47.679725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:47.679725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:47.679725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:47.679725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:47.679725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:47.680637 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:47.680637 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:47.680637 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:47.680637 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:47.680637 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 494/965] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:47.685819 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c528a02-a011-4c97-9485-a7306d19a5cb None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:47.702326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:47.708192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca090-737e-4e3e-a9f5-d66995f44849 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:47.708506 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca090-737e-4e3e-a9f5-d66995f44849 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:47.708797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca090-737e-4e3e-a9f5-d66995f44849 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:47.714417 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 495/966] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:47.715999 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91a7de-d7e6-43a8-8f78-ddfa1ae81f35 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:47.716286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91a7de-d7e6-43a8-8f78-ddfa1ae81f35 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:47.716597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91a7de-d7e6-43a8-8f78-ddfa1ae81f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:47.736083 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-fd91a7de-d7e6-43a8-8f78-ddfa1ae81f35 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:47.737316 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fd91a7de-d7e6-43a8-8f78-ddfa1ae81f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:47.795999 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c528a02-a011-4c97-9485-a7306d19a5cb None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:47.832576 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 496/967] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:58:47.838179 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b435ce-6f26-48d2-80da-c2a91228c733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:47.839469 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b435ce-6f26-48d2-80da-c2a91228c733 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:47.839828 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b435ce-6f26-48d2-80da-c2a91228c733 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:47.840114 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b435ce-6f26-48d2-80da-c2a91228c733 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:47.840864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b435ce-6f26-48d2-80da-c2a91228c733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:47.841175 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b435ce-6f26-48d2-80da-c2a91228c733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:47.842549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b435ce-6f26-48d2-80da-c2a91228c733 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:47.855069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91a7de-d7e6-43a8-8f78-ddfa1ae81f35 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:47.859175 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 472/968] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:47.865495 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b435ce-6f26-48d2-80da-c2a91228c733 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:47.922710 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:47.968422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:47.972275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91a7de-d7e6-43a8-8f78-ddfa1ae81f35 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:48.002167 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b435ce-6f26-48d2-80da-c2a91228c733 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:48.011497 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c4432-5851-4b68-b2e7-ac9838e5470f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:48.012406 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c4432-5851-4b68-b2e7-ac9838e5470f None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:48.012906 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c4432-5851-4b68-b2e7-ac9838e5470f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:48.013370 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c4432-5851-4b68-b2e7-ac9838e5470f None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:48.014242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c4432-5851-4b68-b2e7-ac9838e5470f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:48.015906 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c4432-5851-4b68-b2e7-ac9838e5470f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:48.018659 dv-cinder-850318-6-smb devstack@keystone.service[80330]: WARNING keystone.server.flask.common [None req-3f1c4432-5851-4b68-b2e7-ac9838e5470f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 02 09:58:48.032442 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.sql.core [None req-3f1c4432-5851-4b68-b2e7-ac9838e5470f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 09:58:48.032442 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 02 09:58:48.032442 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [parameters: {'user_id': '7a4e78763c84498eab69da7e5879c979', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 02 09:58:48.032442 dv-cinder-850318-6-smb devstack@keystone.service[80330]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80330) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 09:58:48.042542 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee358a-58ee-4834-ba57-4c5e02f3a369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:48.043346 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee358a-58ee-4834-ba57-4c5e02f3a369 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:48.043634 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee358a-58ee-4834-ba57-4c5e02f3a369 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:48.043910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee358a-58ee-4834-ba57-4c5e02f3a369 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:48.051855 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee358a-58ee-4834-ba57-4c5e02f3a369 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:48.052142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-3f1c4432-5851-4b68-b2e7-ac9838e5470f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 02 09:58:48.052142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:48.052142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 09:58:48.052142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 09:58:48.052142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 09:58:48.052142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 09:58:48.052142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 09:58:48.052142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 09:58:48.052142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 09:58:48.052142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application conn.query(q) Aug 02 09:58:48.052142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 09:58:48.052142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 09:58:48.052142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 09:58:48.052142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application result.read() Aug 02 09:58:48.052142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 09:58:48.052996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 09:58:48.052996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 09:58:48.052996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 09:58:48.052996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 09:58:48.052996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 09:58:48.052996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 09:58:48.052996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 09:58:48.052996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 09:58:48.052996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:48.052996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 09:58:48.052996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:48.052996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:48.052996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 09:58:48.052996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 09:58:48.052996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 02 09:58:48.052996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 02 09:58:48.052996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 09:58:48.052996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application next(self.gen) Aug 02 09:58:48.053957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 09:58:48.053957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application yield resource Aug 02 09:58:48.053957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 09:58:48.053957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application next(self.gen) Aug 02 09:58:48.053957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 09:58:48.053957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 09:58:48.053957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 09:58:48.053957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 09:58:48.053957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 09:58:48.053957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise self.value Aug 02 09:58:48.053957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 09:58:48.053957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 09:58:48.053957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 09:58:48.053957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application session.commit() Aug 02 09:58:48.053957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 09:58:48.053957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 09:58:48.053957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 09:58:48.054934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 09:58:48.054934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 09:58:48.054934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.session.flush() Aug 02 09:58:48.054934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 09:58:48.054934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 09:58:48.054934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 09:58:48.054934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 09:58:48.054934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 09:58:48.054934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application compat.raise_( Aug 02 09:58:48.054934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 09:58:48.054934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception Aug 02 09:58:48.054934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 09:58:48.054934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 09:58:48.054934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 09:58:48.054934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 09:58:48.054934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 09:58:48.054934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 09:58:48.055830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 09:58:48.055830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 09:58:48.055830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 02 09:58:48.055830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 02 09:58:48.055830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 09:58:48.055830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 09:58:48.055830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 09:58:48.055830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 09:58:48.055830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 09:58:48.055830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 09:58:48.055830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 09:58:48.055830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 09:58:48.055830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 09:58:48.055830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 09:58:48.055830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 09:58:48.055830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception Aug 02 09:58:48.058221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 09:58:48.058221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 09:58:48.058221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 09:58:48.058221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 09:58:48.058221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 09:58:48.058221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 09:58:48.058221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 09:58:48.058221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application conn.query(q) Aug 02 09:58:48.058221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 09:58:48.058221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 09:58:48.058221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 09:58:48.058221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application result.read() Aug 02 09:58:48.058221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 09:58:48.058221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 09:58:48.058221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 09:58:48.058221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 09:58:48.060212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 09:58:48.060212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 09:58:48.060212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 09:58:48.060212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 09:58:48.060212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 09:58:48.060212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 02 09:58:48.060212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [parameters: {'user_id': '7a4e78763c84498eab69da7e5879c979', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 02 09:58:48.060212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 09:58:48.060212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:48.060212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:48.060212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:48.060212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:48.060212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:48.060212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:48.060212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:48.062196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:48.062196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:48.062196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:48.062196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:48.062196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:48.062196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:48.062196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:48.062196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 02 09:58:48.062196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 02 09:58:48.062196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:48.062196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:48.062196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:48.062196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:48.062196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:48.062196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:48.062196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 02 09:58:48.062196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 02 09:58:48.064369 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 02 09:58:48.064369 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 02 09:58:48.064369 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 09:58:48.064369 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 09:58:48.064369 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 02 09:58:48.064369 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:48.065148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee358a-58ee-4834-ba57-4c5e02f3a369 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:48.071425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-f6ee358a-58ee-4834-ba57-4c5e02f3a369 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:58:48.071425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:48.071425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:48.071425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:48.071425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:48.071425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:48.071425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:48.071425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:48.071425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:48.071425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:48.071425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:48.071425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:48.071425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:48.071425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:48.071425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:48.071425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:48.074217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:48.074217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:48.074217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:48.074217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:48.074217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:48.074217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:48.074217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:48.074217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:48.074217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:48.074217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:48.074217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:48.074217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:48.074217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:48.074217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:48.074217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:48.074217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:48.074217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:48.074217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:48.075422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:48.075422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:48.075422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:48.075422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:48.075422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:48.075422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:48.075422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:48.075422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:48.075422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 09:58:48.075422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:48.075422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 473/969] 10.222.0.85 () {56 vars in 1117 bytes} [Tue Aug 2 09:58:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:48.075422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee358a-58ee-4834-ba57-4c5e02f3a369 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:48.078091 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 497/970] 10.222.0.85 () {60 vars in 1131 bytes} [Tue Aug 2 09:58:47 2022] POST /identity/v3/users => generated 160 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:48.078091 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c4432-5851-4b68-b2e7-ac9838e5470f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:48.192341 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee358a-58ee-4834-ba57-4c5e02f3a369 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:48.194470 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c4432-5851-4b68-b2e7-ac9838e5470f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:48.213090 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:48.235551 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01da880-0729-4df3-ab3e-9b31b5fa1184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:48.236185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01da880-0729-4df3-ab3e-9b31b5fa1184 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:48.236497 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01da880-0729-4df3-ab3e-9b31b5fa1184 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:48.236783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01da880-0729-4df3-ab3e-9b31b5fa1184 None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:48.237666 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01da880-0729-4df3-ab3e-9b31b5fa1184 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:48.237788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcc3df-bfb7-43b4-a5ab-7ed72bb8b174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:48.237974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01da880-0729-4df3-ab3e-9b31b5fa1184 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:48.238693 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcc3df-bfb7-43b4-a5ab-7ed72bb8b174 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:48.239092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcc3df-bfb7-43b4-a5ab-7ed72bb8b174 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:48.239425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01da880-0729-4df3-ab3e-9b31b5fa1184 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:48.239727 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcc3df-bfb7-43b4-a5ab-7ed72bb8b174 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:48.241624 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:48.252340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcc3df-bfb7-43b4-a5ab-7ed72bb8b174 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:48.254155 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcc3df-bfb7-43b4-a5ab-7ed72bb8b174 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:48.265153 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 474/971] 10.222.0.85 () {56 vars in 1149 bytes} [Tue Aug 2 09:58:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:48.266920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-95fcc3df-bfb7-43b4-a5ab-7ed72bb8b174 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 09:58:48.266920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:48.266920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:48.266920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:48.266920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:48.266920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:48.266920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:48.266920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:48.266920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:48.266920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:48.266920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:48.266920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:48.266920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:48.266920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:48.266920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:48.266920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:48.267834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:48.267834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:48.267834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:48.267834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:48.267834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:48.267834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:48.267834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:48.267834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:48.267834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:48.267834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:48.267834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:48.267834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:48.267834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:48.267834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:48.267834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:48.267834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:48.267834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:48.267834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:48.268880 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:48.268880 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:48.268880 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:48.268880 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:48.268880 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:48.268880 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:48.268880 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:48.268880 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:48.268880 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 09:58:48.268880 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:48.270845 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01da880-0729-4df3-ab3e-9b31b5fa1184 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:48.273007 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 498/972] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:58:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:48.273877 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcc3df-bfb7-43b4-a5ab-7ed72bb8b174 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:48.402443 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01da880-0729-4df3-ab3e-9b31b5fa1184 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:48.417644 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcc3df-bfb7-43b4-a5ab-7ed72bb8b174 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:48.440964 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a8e70-12d0-4154-9e2e-0eb593843add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:48.441590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a8e70-12d0-4154-9e2e-0eb593843add None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:48.441905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a8e70-12d0-4154-9e2e-0eb593843add None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:48.442425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a8e70-12d0-4154-9e2e-0eb593843add None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:48.453311 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc6ffc-b220-446a-8dab-91a48f085639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:48.454168 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc6ffc-b220-446a-8dab-91a48f085639 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:48.454636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc6ffc-b220-446a-8dab-91a48f085639 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:48.455082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc6ffc-b220-446a-8dab-91a48f085639 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:48.456025 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc6ffc-b220-446a-8dab-91a48f085639 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:48.456542 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc6ffc-b220-446a-8dab-91a48f085639 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:48.458125 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc6ffc-b220-446a-8dab-91a48f085639 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:48.497562 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 499/973] 10.222.0.85 () {56 vars in 1101 bytes} [Tue Aug 2 09:58:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:48.509893 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:48.523297 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a8e70-12d0-4154-9e2e-0eb593843add None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:48.525291 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a8e70-12d0-4154-9e2e-0eb593843add None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:48.641774 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 475/974] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:58:48 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:58:48.648717 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc6ffc-b220-446a-8dab-91a48f085639 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:48.688862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:48.766710 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc6ffc-b220-446a-8dab-91a48f085639 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:48.803875 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0a69a-42ca-4288-8666-ce4771bd4f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:48.804543 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a69a-42ca-4288-8666-ce4771bd4f23 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:48.804832 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a69a-42ca-4288-8666-ce4771bd4f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:48.805129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a69a-42ca-4288-8666-ce4771bd4f23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:48.816415 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0a69a-42ca-4288-8666-ce4771bd4f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:48.817893 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0a69a-42ca-4288-8666-ce4771bd4f23 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:48.833183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-adb0a69a-42ca-4288-8666-ce4771bd4f23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:48.833183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:48.833183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:48.833183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:48.833183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:48.833183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:48.833183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:48.833183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:48.833183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:48.833183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:48.833183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:48.833183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:48.833183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:48.833183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:48.833183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:48.834157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:48.834157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:48.834157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:48.834157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:48.834157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:48.834157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:48.834157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:48.834157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:48.834157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:48.834157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:48.834157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:48.834157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:48.834157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:48.834157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:48.834157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:48.834157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:48.834157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:48.835039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:48.835039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:48.835039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:48.835039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:48.835039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 500/975] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:48.840684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a8e70-12d0-4154-9e2e-0eb593843add None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:48.940063 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:48.950665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a8e70-12d0-4154-9e2e-0eb593843add None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:48.985211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68e014-8ea2-46f8-b094-5e2487f1a61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:48.985831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68e014-8ea2-46f8-b094-5e2487f1a61d None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:48.986115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68e014-8ea2-46f8-b094-5e2487f1a61d None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:48.986393 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68e014-8ea2-46f8-b094-5e2487f1a61d None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:48.987100 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68e014-8ea2-46f8-b094-5e2487f1a61d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:48.987395 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68e014-8ea2-46f8-b094-5e2487f1a61d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:48.988789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68e014-8ea2-46f8-b094-5e2487f1a61d None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:49.000844 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 476/976] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:49.006186 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0a69a-42ca-4288-8666-ce4771bd4f23 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:49.095801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:49.112574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0a69a-42ca-4288-8666-ce4771bd4f23 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:49.147695 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5534741-abad-4c01-b4f6-7bfa7ee5a877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:49.148341 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5534741-abad-4c01-b4f6-7bfa7ee5a877 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:49.148653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5534741-abad-4c01-b4f6-7bfa7ee5a877 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:49.148930 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5534741-abad-4c01-b4f6-7bfa7ee5a877 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:49.157325 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5534741-abad-4c01-b4f6-7bfa7ee5a877 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:49.158785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5534741-abad-4c01-b4f6-7bfa7ee5a877 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:49.170517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-b5534741-abad-4c01-b4f6-7bfa7ee5a877 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:49.170517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:49.170517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:49.170517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:49.170517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:49.170517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:49.170517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:49.170517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:49.170517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:49.170517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:49.170517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:49.170517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:49.170517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:49.170517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:49.170517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:49.171423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:49.171423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:49.171423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:49.171423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:49.171423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:49.171423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:49.171423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:49.171423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:49.171423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:49.171423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:49.171423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:49.171423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:49.171423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:49.171423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:49.171423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:49.171423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:49.171423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:49.172322 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:49.172322 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:49.172322 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:49.172322 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:49.172322 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:49.172322 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:49.172322 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:49.172322 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:49.176629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 501/977] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:49.178682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68e014-8ea2-46f8-b094-5e2487f1a61d None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:49.185683 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19f30e-b2bf-45c6-ba21-327be87496b1 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:49.185982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19f30e-b2bf-45c6-ba21-327be87496b1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:49.186249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19f30e-b2bf-45c6-ba21-327be87496b1 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:49.188024 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 502/978] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:58:49.193045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bf5cb-a7aa-4e37-a1e9-6c432d068678 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:49.193449 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bf5cb-a7aa-4e37-a1e9-6c432d068678 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:49.193924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bf5cb-a7aa-4e37-a1e9-6c432d068678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:49.215911 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3d6bf5cb-a7aa-4e37-a1e9-6c432d068678 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:49.217485 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3d6bf5cb-a7aa-4e37-a1e9-6c432d068678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:49.287615 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68e014-8ea2-46f8-b094-5e2487f1a61d None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:49.288432 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 503/979] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:58:49.293922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525139c-4537-4ada-8ae6-e0aa0aff6033 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:49.294191 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525139c-4537-4ada-8ae6-e0aa0aff6033 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:49.294498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525139c-4537-4ada-8ae6-e0aa0aff6033 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:49.296662 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 504/980] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:49.301009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d9393-c292-4efd-8314-2f21b177a004 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:49.301381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d9393-c292-4efd-8314-2f21b177a004 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:49.301655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d9393-c292-4efd-8314-2f21b177a004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:49.320750 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-385d9393-c292-4efd-8314-2f21b177a004 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:49.321918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-385d9393-c292-4efd-8314-2f21b177a004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:49.325763 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d4cf8-6109-4c2e-853e-3d9124a77537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:49.326385 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d4cf8-6109-4c2e-853e-3d9124a77537 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:49.326670 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d4cf8-6109-4c2e-853e-3d9124a77537 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:49.326954 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693d4cf8-6109-4c2e-853e-3d9124a77537 None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:49.327704 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d4cf8-6109-4c2e-853e-3d9124a77537 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:49.328014 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d4cf8-6109-4c2e-853e-3d9124a77537 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:49.329481 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693d4cf8-6109-4c2e-853e-3d9124a77537 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:49.342045 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 477/981] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:49.345475 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d4cf8-6109-4c2e-853e-3d9124a77537 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:49.360966 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:49.391360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 505/982] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:58:49.392280 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d9393-c292-4efd-8314-2f21b177a004 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:49.400089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:49.455742 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693d4cf8-6109-4c2e-853e-3d9124a77537 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:49.491133 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e7a44-06bc-4683-bc63-be7a4e0c7f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:49.491764 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e7a44-06bc-4683-bc63-be7a4e0c7f6b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:49.492041 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e7a44-06bc-4683-bc63-be7a4e0c7f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:49.492309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e7a44-06bc-4683-bc63-be7a4e0c7f6b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:49.492887 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d9393-c292-4efd-8314-2f21b177a004 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:49.492988 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e7a44-06bc-4683-bc63-be7a4e0c7f6b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:49.494307 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e7a44-06bc-4683-bc63-be7a4e0c7f6b None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:49.503525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-117e7a44-06bc-4683-bc63-be7a4e0c7f6b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:58:49.503525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:49.503525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:49.503525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:49.503525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:49.503525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:49.503525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:49.503525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:49.503525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:58:49.503525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:49.503525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:49.503525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:49.503525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:49.503525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:49.503525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:49.503525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:49.503525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:49.504598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:49.504598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:49.504598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:49.504598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:49.504598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:49.504598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:49.504598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:49.504598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:49.504598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:49.504598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:49.504598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:49.504598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:49.504598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:49.504598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:49.504598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:49.504598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:49.505792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:49.505792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:49.505792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:49.505792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:49.505792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:49.505792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:49.505792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:49.505792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:49.505792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:49.505792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:49.505792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:49.505792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:49.505792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:58:49.505792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:49.505792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 478/983] 10.222.0.85 () {56 vars in 1126 bytes} [Tue Aug 2 09:58:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:49.507111 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e7a44-06bc-4683-bc63-be7a4e0c7f6b None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:49.531142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ef1cf-056f-4c8d-9e20-accd3d3da982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:49.531752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ef1cf-056f-4c8d-9e20-accd3d3da982 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:49.532040 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ef1cf-056f-4c8d-9e20-accd3d3da982 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:49.532368 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ef1cf-056f-4c8d-9e20-accd3d3da982 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:49.533200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ef1cf-056f-4c8d-9e20-accd3d3da982 None admin] RBAC: Adding query filter params (role.id=142cbbffc00f4c1aa03655720f13107c, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=f43a16e2dcab4872963222c557853d32) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:49.533508 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ef1cf-056f-4c8d-9e20-accd3d3da982 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:49.534928 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ef1cf-056f-4c8d-9e20-accd3d3da982 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:49.540667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 506/984] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:58:49 2022] GET /identity/v3/role_assignments?user.id=f43a16e2dcab4872963222c557853d32&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=142cbbffc00f4c1aa03655720f13107c => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:49.542017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ef1cf-056f-4c8d-9e20-accd3d3da982 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:49.595549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:49.625850 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e7a44-06bc-4683-bc63-be7a4e0c7f6b None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:49.629716 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:49.664422 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ef1cf-056f-4c8d-9e20-accd3d3da982 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:49.669762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c7ca3-d3fa-4b61-8f9c-e87b11bb3323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:49.670827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c7ca3-d3fa-4b61-8f9c-e87b11bb3323 None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:49.671326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c7ca3-d3fa-4b61-8f9c-e87b11bb3323 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:49.671843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c7ca3-d3fa-4b61-8f9c-e87b11bb3323 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:49.672774 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c7ca3-d3fa-4b61-8f9c-e87b11bb3323 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:49.674334 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c7ca3-d3fa-4b61-8f9c-e87b11bb3323 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:49.694491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 479/985] 10.222.0.85 () {60 vars in 1141 bytes} [Tue Aug 2 09:58:49 2022] POST /identity/v3/services => generated 242 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:58:49.712945 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d415688-5718-4434-a762-54de23435e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:49.713902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d415688-5718-4434-a762-54de23435e98 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:49.714264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d415688-5718-4434-a762-54de23435e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:49.714550 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d415688-5718-4434-a762-54de23435e98 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:49.715334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d415688-5718-4434-a762-54de23435e98 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:49.715568 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d415688-5718-4434-a762-54de23435e98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:49.717031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d415688-5718-4434-a762-54de23435e98 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:49.722827 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 507/986] 10.222.0.85 () {56 vars in 1122 bytes} [Tue Aug 2 09:58:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:49.730080 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c7ca3-d3fa-4b61-8f9c-e87b11bb3323 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:49.850467 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c7ca3-d3fa-4b61-8f9c-e87b11bb3323 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:49.889198 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef58ce-e025-42c0-8258-b508bfd58ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:49.889746 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef58ce-e025-42c0-8258-b508bfd58ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:49.890029 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef58ce-e025-42c0-8258-b508bfd58ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:49.890302 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef58ce-e025-42c0-8258-b508bfd58ab4 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:49.890988 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef58ce-e025-42c0-8258-b508bfd58ab4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:49.891295 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef58ce-e025-42c0-8258-b508bfd58ab4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:49.892686 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef58ce-e025-42c0-8258-b508bfd58ab4 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:49.894983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:49.898333 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 480/987] 10.222.0.85 () {56 vars in 1122 bytes} [Tue Aug 2 09:58:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:49.905514 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d415688-5718-4434-a762-54de23435e98 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:50.013641 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d415688-5718-4434-a762-54de23435e98 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:50.042114 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:50.049376 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba458efb-8ddd-4ce9-a339-312597151b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:50.050000 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba458efb-8ddd-4ce9-a339-312597151b84 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:50.050282 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba458efb-8ddd-4ce9-a339-312597151b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:50.050559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba458efb-8ddd-4ce9-a339-312597151b84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:50.051329 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba458efb-8ddd-4ce9-a339-312597151b84 None admin] RBAC: Adding query filter params (interface=admin, service_id=0b91e862bc82452e99207593833a7f4d, region_id=RegionOne) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:50.051644 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba458efb-8ddd-4ce9-a339-312597151b84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:50.053057 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba458efb-8ddd-4ce9-a339-312597151b84 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:50.059034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 508/988] 10.222.0.85 () {56 vars in 1249 bytes} [Tue Aug 2 09:58:49 2022] GET /identity/v3/endpoints?service_id=0b91e862bc82452e99207593833a7f4d&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:50.064690 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef58ce-e025-42c0-8258-b508bfd58ab4 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:50.170243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef58ce-e025-42c0-8258-b508bfd58ab4 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:50.204739 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce6361-836d-4315-a1fb-46a7dece4bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:50.205355 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce6361-836d-4315-a1fb-46a7dece4bbe None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:50.205635 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce6361-836d-4315-a1fb-46a7dece4bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:50.205909 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce6361-836d-4315-a1fb-46a7dece4bbe None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:50.206556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce6361-836d-4315-a1fb-46a7dece4bbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:50.207909 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce6361-836d-4315-a1fb-46a7dece4bbe None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:50.216775 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 481/989] 10.222.0.85 () {56 vars in 1087 bytes} [Tue Aug 2 09:58:50 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 09:58:51.693571 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb9a38-65c3-4d93-8079-b41008e2f287 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:51.694090 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb9a38-65c3-4d93-8079-b41008e2f287 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:51.694169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb9a38-65c3-4d93-8079-b41008e2f287 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:51.695626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 509/990] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:51.701645 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea541e-121e-4142-b536-b597faddd669 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:51.702072 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea541e-121e-4142-b536-b597faddd669 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:51.702239 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea541e-121e-4142-b536-b597faddd669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:51.720648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-57ea541e-121e-4142-b536-b597faddd669 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:51.721833 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-57ea541e-121e-4142-b536-b597faddd669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:51.786441 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:51.793131 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e89518-0926-4814-97b5-74507595df88 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:51.793478 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e89518-0926-4814-97b5-74507595df88 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:51.793757 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e89518-0926-4814-97b5-74507595df88 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:51.796530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 510/991] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:58:51.796657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 482/992] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:51.801880 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24efc2c-37ea-4607-8c03-22e5bd10738b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:51.802246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24efc2c-37ea-4607-8c03-22e5bd10738b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:51.802594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24efc2c-37ea-4607-8c03-22e5bd10738b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:51.818347 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea541e-121e-4142-b536-b597faddd669 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:51.821255 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e24efc2c-37ea-4607-8c03-22e5bd10738b None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:51.823856 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e24efc2c-37ea-4607-8c03-22e5bd10738b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:51.896693 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 511/993] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:51.919517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24efc2c-37ea-4607-8c03-22e5bd10738b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:51.928959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea541e-121e-4142-b536-b597faddd669 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:51.966007 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840cbb5-3e37-41ef-b7f1-6000f2d27d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:51.966565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840cbb5-3e37-41ef-b7f1-6000f2d27d9d None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:51.966852 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840cbb5-3e37-41ef-b7f1-6000f2d27d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:51.967122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840cbb5-3e37-41ef-b7f1-6000f2d27d9d None admin] PATH_INFO: `/v3/services/image` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:51.967750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840cbb5-3e37-41ef-b7f1-6000f2d27d9d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:51.969155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840cbb5-3e37-41ef-b7f1-6000f2d27d9d None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:51.978691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-4840cbb5-3e37-41ef-b7f1-6000f2d27d9d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 09:58:51.978691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:51.978691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:51.978691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:51.978691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:51.978691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:51.978691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:51.978691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:51.978691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 09:58:51.978691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:51.978691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:51.978691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:51.978691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:51.978691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:51.978691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:51.978691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:51.978691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:51.980773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:51.980773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:51.980773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:51.980773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:51.980773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:51.980773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:51.980773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:51.980773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:51.980773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:51.980773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:51.980773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:51.980773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:51.980773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:51.980773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:51.980773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:51.980773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:51.981640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:51.981640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:51.981640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:51.981640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:51.981640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:51.981640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:51.981640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:51.981640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:51.981640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:51.981640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:51.981640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:51.981640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:51.981640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 09:58:51.981640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:51.981640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 483/994] 10.222.0.85 () {56 vars in 1105 bytes} [Tue Aug 2 09:58:51 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:51.986345 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840cbb5-3e37-41ef-b7f1-6000f2d27d9d None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:52.030642 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24efc2c-37ea-4607-8c03-22e5bd10738b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:52.051329 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:52.055302 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:52.068018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6f549-0e30-4729-8328-04a5fd18213e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:52.068688 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6f549-0e30-4729-8328-04a5fd18213e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:52.068974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6f549-0e30-4729-8328-04a5fd18213e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:52.069248 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6f549-0e30-4729-8328-04a5fd18213e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:52.069878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6f549-0e30-4729-8328-04a5fd18213e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:52.074058 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6f549-0e30-4729-8328-04a5fd18213e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:52.085878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-b6c6f549-0e30-4729-8328-04a5fd18213e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 09:58:52.085878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:52.085878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:52.085878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:52.085878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:52.085878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:52.085878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:52.085878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:52.085878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 09:58:52.085878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:52.085878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:52.085878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:52.085878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:52.085878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:52.085878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:52.085878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:52.085878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:52.086888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:52.086888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:52.086888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:52.086888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:52.086888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:52.086888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:52.086888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:52.086888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:52.086888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:52.086888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:52.086888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:52.086888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:52.086888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:52.086888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:52.086888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:52.086888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:52.087731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:52.087731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:52.087731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:52.087731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:52.087731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:52.087731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:52.087731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:52.087731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:52.087731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:52.087731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:52.087731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:52.087731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:52.087731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 09:58:52.087731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:52.087731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 512/995] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:52.093353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6f549-0e30-4729-8328-04a5fd18213e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:52.103123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840cbb5-3e37-41ef-b7f1-6000f2d27d9d None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:52.142443 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81405d-09ed-4c88-ad24-9623956521c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:52.143171 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81405d-09ed-4c88-ad24-9623956521c2 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:52.143486 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81405d-09ed-4c88-ad24-9623956521c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:52.143825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81405d-09ed-4c88-ad24-9623956521c2 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:52.144612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81405d-09ed-4c88-ad24-9623956521c2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:52.144961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81405d-09ed-4c88-ad24-9623956521c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:52.146606 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81405d-09ed-4c88-ad24-9623956521c2 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:52.153513 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 484/996] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:52.160048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81405d-09ed-4c88-ad24-9623956521c2 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:52.206591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6f549-0e30-4729-8328-04a5fd18213e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:52.242912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988c920-7e1f-4baf-b37b-dc2ff27ae42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:52.243457 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988c920-7e1f-4baf-b37b-dc2ff27ae42d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:52.243742 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988c920-7e1f-4baf-b37b-dc2ff27ae42d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:52.244017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988c920-7e1f-4baf-b37b-dc2ff27ae42d None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:52.245395 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988c920-7e1f-4baf-b37b-dc2ff27ae42d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:52.245739 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988c920-7e1f-4baf-b37b-dc2ff27ae42d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:52.247090 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d988c920-7e1f-4baf-b37b-dc2ff27ae42d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:52.251906 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 513/997] 10.222.0.85 () {56 vars in 1112 bytes} [Tue Aug 2 09:58:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:52.251906 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149d166-cdec-4c2e-812a-c24b9223d4af None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:52.251906 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149d166-cdec-4c2e-812a-c24b9223d4af None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:52.251906 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9149d166-cdec-4c2e-812a-c24b9223d4af None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:52.258915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 514/998] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:52.259663 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149d166-cdec-4c2e-812a-c24b9223d4af None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:52.269558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81405d-09ed-4c88-ad24-9623956521c2 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:52.294972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:52.305270 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73a0a7-f022-4d33-8cfc-ddb52273fb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:52.305908 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73a0a7-f022-4d33-8cfc-ddb52273fb0f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:52.306190 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73a0a7-f022-4d33-8cfc-ddb52273fb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:52.306464 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73a0a7-f022-4d33-8cfc-ddb52273fb0f None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:52.307662 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73a0a7-f022-4d33-8cfc-ddb52273fb0f None admin] RBAC: Adding query filter params (type=image) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:52.307972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73a0a7-f022-4d33-8cfc-ddb52273fb0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:52.309362 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73a0a7-f022-4d33-8cfc-ddb52273fb0f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:52.313806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 485/999] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:52.314934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1dc54-2c8f-48f5-af3e-8ad31efd8e4a None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:52.315217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1dc54-2c8f-48f5-af3e-8ad31efd8e4a None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:52.315488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1dc54-2c8f-48f5-af3e-8ad31efd8e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:52.324964 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:52.347016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-14c1dc54-2c8f-48f5-af3e-8ad31efd8e4a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:52.348490 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-14c1dc54-2c8f-48f5-af3e-8ad31efd8e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:52.380171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9149d166-cdec-4c2e-812a-c24b9223d4af None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:52.419940 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e538a-544e-467b-8c77-31889e4b041d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:52.420920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e538a-544e-467b-8c77-31889e4b041d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:52.421199 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e538a-544e-467b-8c77-31889e4b041d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:52.421474 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e538a-544e-467b-8c77-31889e4b041d None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:52.422167 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e538a-544e-467b-8c77-31889e4b041d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:52.422474 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e538a-544e-467b-8c77-31889e4b041d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:52.423872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e538a-544e-467b-8c77-31889e4b041d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:52.429427 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 515/1000] 10.222.0.85 () {56 vars in 1112 bytes} [Tue Aug 2 09:58:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:52.431479 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 486/1001] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:52 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:52.437674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e538a-544e-467b-8c77-31889e4b041d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:52.455039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1dc54-2c8f-48f5-af3e-8ad31efd8e4a None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:52.550598 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e538a-544e-467b-8c77-31889e4b041d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:52.569535 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:52.570167 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1dc54-2c8f-48f5-af3e-8ad31efd8e4a None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:52.589182 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef75de-1425-47a9-82b0-f1b8ce3811ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:52.589529 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef75de-1425-47a9-82b0-f1b8ce3811ec None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:52.589810 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef75de-1425-47a9-82b0-f1b8ce3811ec None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:52.590086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef75de-1425-47a9-82b0-f1b8ce3811ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:52.590843 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef75de-1425-47a9-82b0-f1b8ce3811ec None admin] RBAC: Adding query filter params (interface=public, service_id=c8577af042894117b71a285a5e773ecf, region_id=RegionOne) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:52.591154 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef75de-1425-47a9-82b0-f1b8ce3811ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:52.591912 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:52.592548 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef75de-1425-47a9-82b0-f1b8ce3811ec None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:52.598096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 516/1002] 10.222.0.85 () {56 vars in 1251 bytes} [Tue Aug 2 09:58:52 2022] GET /identity/v3/endpoints?service_id=c8577af042894117b71a285a5e773ecf&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:52.603112 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef75de-1425-47a9-82b0-f1b8ce3811ec None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:52.614150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cbcfe-63f2-4faf-b3d5-97eaeb4d9d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:52.615012 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cbcfe-63f2-4faf-b3d5-97eaeb4d9d7c None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:52.615471 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cbcfe-63f2-4faf-b3d5-97eaeb4d9d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:52.615981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cbcfe-63f2-4faf-b3d5-97eaeb4d9d7c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:52.616795 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cbcfe-63f2-4faf-b3d5-97eaeb4d9d7c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:52.618405 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cbcfe-63f2-4faf-b3d5-97eaeb4d9d7c None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:52.629259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-3f7cbcfe-63f2-4faf-b3d5-97eaeb4d9d7c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:58:52.629259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:52.629259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:52.629259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:52.629259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:52.629259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:52.629259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:52.629259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:52.629259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:58:52.629259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:52.629259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:52.629259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:52.629259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:52.629259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:52.629259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:52.629259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:52.629259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:52.630465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:52.630465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:52.630465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:52.630465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:52.630465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:52.630465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:52.630465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:52.630465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:52.630465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:52.630465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:52.630465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:52.630465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:52.630465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:52.630465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:52.630465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:52.630465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:52.631740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:52.631740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:52.631740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:52.631740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:52.631740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:52.631740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:52.631740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:52.631740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:52.631740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:52.631740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:52.631740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:52.631740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:52.631740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 09:58:52.631740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:52.634414 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 487/1003] 10.222.0.85 () {56 vars in 1126 bytes} [Tue Aug 2 09:58:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:52.640371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cbcfe-63f2-4faf-b3d5-97eaeb4d9d7c None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:52.716683 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef75de-1425-47a9-82b0-f1b8ce3811ec None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:52.754666 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a6895-63a9-41cb-809a-4cb45e55e61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:52.755535 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a6895-63a9-41cb-809a-4cb45e55e61c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:52.755815 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a6895-63a9-41cb-809a-4cb45e55e61c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:52.756079 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a6895-63a9-41cb-809a-4cb45e55e61c None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:52.757018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a6895-63a9-41cb-809a-4cb45e55e61c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:52.758375 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a6895-63a9-41cb-809a-4cb45e55e61c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:52.764404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cbcfe-63f2-4faf-b3d5-97eaeb4d9d7c None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:52.764946 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 517/1004] 10.222.0.85 () {56 vars in 1087 bytes} [Tue Aug 2 09:58:52 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:58:52.809657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ec9be-4136-438a-96bf-f1a940d64b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:52.810553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ec9be-4136-438a-96bf-f1a940d64b89 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:52.810981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ec9be-4136-438a-96bf-f1a940d64b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:52.811398 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ec9be-4136-438a-96bf-f1a940d64b89 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:52.812238 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ec9be-4136-438a-96bf-f1a940d64b89 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:52.812735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ec9be-4136-438a-96bf-f1a940d64b89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:52.814365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ec9be-4136-438a-96bf-f1a940d64b89 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:52.820569 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 488/1005] 10.222.0.85 () {56 vars in 1122 bytes} [Tue Aug 2 09:58:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:52.828171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a6895-63a9-41cb-809a-4cb45e55e61c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:52.882889 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:52.947193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a6895-63a9-41cb-809a-4cb45e55e61c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:52.984869 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8a5b6-e609-4a33-a8dd-b16130a2b994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:52.985497 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8a5b6-e609-4a33-a8dd-b16130a2b994 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:52.985778 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8a5b6-e609-4a33-a8dd-b16130a2b994 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:52.986053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8a5b6-e609-4a33-a8dd-b16130a2b994 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:52.986728 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8a5b6-e609-4a33-a8dd-b16130a2b994 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:52.987032 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8a5b6-e609-4a33-a8dd-b16130a2b994 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:52.988381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b8a5b6-e609-4a33-a8dd-b16130a2b994 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:52.993504 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 518/1006] 10.222.0.85 () {56 vars in 1122 bytes} [Tue Aug 2 09:58:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:52.999909 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ec9be-4136-438a-96bf-f1a940d64b89 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:53.048373 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:53.106094 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ec9be-4136-438a-96bf-f1a940d64b89 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:53.140428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2be367-752c-47be-9549-efebd7de190d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:53.141068 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2be367-752c-47be-9549-efebd7de190d None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:53.141355 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2be367-752c-47be-9549-efebd7de190d None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:53.141632 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2be367-752c-47be-9549-efebd7de190d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:53.142352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2be367-752c-47be-9549-efebd7de190d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:53.143719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2be367-752c-47be-9549-efebd7de190d None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:53.168489 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 489/1007] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 09:58:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:58:54.340931 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e7a03-f940-4fe7-bd4d-6a4850825e42 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:54.341467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e7a03-f940-4fe7-bd4d-6a4850825e42 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:54.341467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e7a03-f940-4fe7-bd4d-6a4850825e42 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:54.342977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 519/1008] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:54.348003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02a2f6-b55d-4365-b458-66de2887689b None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:54.348390 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02a2f6-b55d-4365-b458-66de2887689b None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:54.348602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02a2f6-b55d-4365-b458-66de2887689b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:54.367738 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-ee02a2f6-b55d-4365-b458-66de2887689b None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:54.368969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ee02a2f6-b55d-4365-b458-66de2887689b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:54.442618 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 490/1009] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:54.465448 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e7a03-f940-4fe7-bd4d-6a4850825e42 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:54.569486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e7a03-f940-4fe7-bd4d-6a4850825e42 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:54.579202 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:54.606934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327c45b-84f7-4790-b6f6-4c2e7e1a1bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:54.607560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327c45b-84f7-4790-b6f6-4c2e7e1a1bcf None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:54.607843 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327c45b-84f7-4790-b6f6-4c2e7e1a1bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:54.608119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327c45b-84f7-4790-b6f6-4c2e7e1a1bcf None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:54.608849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327c45b-84f7-4790-b6f6-4c2e7e1a1bcf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:54.610211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327c45b-84f7-4790-b6f6-4c2e7e1a1bcf None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:54.627243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 520/1010] 10.222.0.85 () {60 vars in 1141 bytes} [Tue Aug 2 09:58:54 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:58:54.787677 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21422b46-5e0a-40af-bcc8-f7a7e2aff02c None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:54.787964 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21422b46-5e0a-40af-bcc8-f7a7e2aff02c None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:54.788241 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21422b46-5e0a-40af-bcc8-f7a7e2aff02c None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:54.789711 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 491/1011] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:54.795808 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f949275-4963-434b-a9e3-8dcc3b231bc8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:54.796098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f949275-4963-434b-a9e3-8dcc3b231bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:54.796381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f949275-4963-434b-a9e3-8dcc3b231bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:54.816164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4f949275-4963-434b-a9e3-8dcc3b231bc8 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:54.817423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4f949275-4963-434b-a9e3-8dcc3b231bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:54.894074 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 521/1012] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:54 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:54.917427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21422b46-5e0a-40af-bcc8-f7a7e2aff02c None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:54.950182 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:55.028667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21422b46-5e0a-40af-bcc8-f7a7e2aff02c None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:55.063051 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d31afd-801e-40c3-904d-f746c67c427e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:55.063695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d31afd-801e-40c3-904d-f746c67c427e None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:55.063982 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d31afd-801e-40c3-904d-f746c67c427e None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:55.064262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d31afd-801e-40c3-904d-f746c67c427e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:55.064919 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d31afd-801e-40c3-904d-f746c67c427e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:55.066296 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d31afd-801e-40c3-904d-f746c67c427e None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:55.075522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-d0d31afd-801e-40c3-904d-f746c67c427e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 09:58:55.075522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:55.075522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:55.075522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:55.075522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:55.075522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:55.075522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:55.075522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:55.075522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 09:58:55.075522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:55.075522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:55.075522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:55.075522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:55.075522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:55.075522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:55.075522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:55.075522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:55.076830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:55.076830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:55.076830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:55.076830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:55.076830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:55.076830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:55.076830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:55.076830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:55.076830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:55.076830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:55.076830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:55.076830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:55.076830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:55.076830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:55.076830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:55.076830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:55.077990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:55.077990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:55.077990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:55.077990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:55.077990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:55.077990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:55.077990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:55.077990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:55.077990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:55.077990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:55.077990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:55.077990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:55.077990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 09:58:55.077990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:55.080548 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 492/1013] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:55.082726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f949275-4963-434b-a9e3-8dcc3b231bc8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:55.180748 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:55.189947 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f949275-4963-434b-a9e3-8dcc3b231bc8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:55.224771 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859afb7b-5dac-4b1a-ac0d-1e9662cc85e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:55.225394 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859afb7b-5dac-4b1a-ac0d-1e9662cc85e4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:55.225679 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859afb7b-5dac-4b1a-ac0d-1e9662cc85e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:55.225957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859afb7b-5dac-4b1a-ac0d-1e9662cc85e4 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:55.226675 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859afb7b-5dac-4b1a-ac0d-1e9662cc85e4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:55.226985 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859afb7b-5dac-4b1a-ac0d-1e9662cc85e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:55.228352 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859afb7b-5dac-4b1a-ac0d-1e9662cc85e4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:55.234021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 522/1014] 10.222.0.85 () {56 vars in 1112 bytes} [Tue Aug 2 09:58:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:55.239519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d31afd-801e-40c3-904d-f746c67c427e None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:55.256372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76e17b-0d25-4753-8534-9f88708466a2 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:55.256372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76e17b-0d25-4753-8534-9f88708466a2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:55.256888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76e17b-0d25-4753-8534-9f88708466a2 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:55.258828 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 523/1015] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:58:55.264316 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e48ee6-43c9-44b5-887e-3008e8bcadd2 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:55.264647 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e48ee6-43c9-44b5-887e-3008e8bcadd2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:55.264928 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e48ee6-43c9-44b5-887e-3008e8bcadd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:55.284264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e6e48ee6-43c9-44b5-887e-3008e8bcadd2 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:55.286028 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e6e48ee6-43c9-44b5-887e-3008e8bcadd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:55.360093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:55.367846 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d31afd-801e-40c3-904d-f746c67c427e None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:55.375320 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 524/1016] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:55 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:58:55.399095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e48ee6-43c9-44b5-887e-3008e8bcadd2 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:55.407404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26c31e-ee1b-4fd2-94b3-2a32c2d0a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:55.408036 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26c31e-ee1b-4fd2-94b3-2a32c2d0a346 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:55.408320 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26c31e-ee1b-4fd2-94b3-2a32c2d0a346 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:55.408951 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26c31e-ee1b-4fd2-94b3-2a32c2d0a346 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:55.409316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26c31e-ee1b-4fd2-94b3-2a32c2d0a346 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:55.409624 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26c31e-ee1b-4fd2-94b3-2a32c2d0a346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:55.411153 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26c31e-ee1b-4fd2-94b3-2a32c2d0a346 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:55.415951 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 493/1017] 10.222.0.85 () {56 vars in 1112 bytes} [Tue Aug 2 09:58:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:55.422415 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26c31e-ee1b-4fd2-94b3-2a32c2d0a346 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:55.501512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:55.518218 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e48ee6-43c9-44b5-887e-3008e8bcadd2 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:55.526576 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26c31e-ee1b-4fd2-94b3-2a32c2d0a346 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:55.560775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798399d-10ec-4524-8727-2d5d9d674968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:55.561421 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798399d-10ec-4524-8727-2d5d9d674968 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:55.561701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798399d-10ec-4524-8727-2d5d9d674968 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:55.561978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798399d-10ec-4524-8727-2d5d9d674968 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:55.563122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798399d-10ec-4524-8727-2d5d9d674968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:55.563455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a0af7-20fa-4407-8b13-e6b6a0fb29a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:55.564229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a0af7-20fa-4407-8b13-e6b6a0fb29a6 None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:55.564586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798399d-10ec-4524-8727-2d5d9d674968 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:55.564875 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a0af7-20fa-4407-8b13-e6b6a0fb29a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:55.565301 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a0af7-20fa-4407-8b13-e6b6a0fb29a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:55.566150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a0af7-20fa-4407-8b13-e6b6a0fb29a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:55.566256 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 525/1018] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:55.567719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a0af7-20fa-4407-8b13-e6b6a0fb29a6 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:55.571989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798399d-10ec-4524-8727-2d5d9d674968 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:55.600664 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 494/1019] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 09:58:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:58:55.686237 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798399d-10ec-4524-8727-2d5d9d674968 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:55.733377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa04e64-3def-429c-bb08-5538680ae6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:55.734007 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa04e64-3def-429c-bb08-5538680ae6ae None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:55.734285 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa04e64-3def-429c-bb08-5538680ae6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:55.734559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa04e64-3def-429c-bb08-5538680ae6ae None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:55.735252 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa04e64-3def-429c-bb08-5538680ae6ae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:55.736725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa04e64-3def-429c-bb08-5538680ae6ae None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:55.770004 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 526/1020] 10.222.0.85 () {60 vars in 1141 bytes} [Tue Aug 2 09:58:55 2022] POST /identity/v3/projects => generated 311 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:58:56.671648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb68cc-28a1-4f04-9f52-a39c32c6ac82 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:56.672157 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb68cc-28a1-4f04-9f52-a39c32c6ac82 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:56.672236 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb68cc-28a1-4f04-9f52-a39c32c6ac82 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:56.673765 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 495/1021] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:56.678619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9adaa-b9fc-4092-9fc5-8a293b54acd4 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:56.679011 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9adaa-b9fc-4092-9fc5-8a293b54acd4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:56.679201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9adaa-b9fc-4092-9fc5-8a293b54acd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:56.687102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:56.697959 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-11c9adaa-b9fc-4092-9fc5-8a293b54acd4 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:56.699753 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-11c9adaa-b9fc-4092-9fc5-8a293b54acd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:56.772110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 527/1022] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:56.794938 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb68cc-28a1-4f04-9f52-a39c32c6ac82 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:56.811103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:56.904328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb68cc-28a1-4f04-9f52-a39c32c6ac82 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:56.940364 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a61b2-8da4-4c4f-a633-a80dc452de6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:56.940931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a61b2-8da4-4c4f-a633-a80dc452de6e None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:56.941212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a61b2-8da4-4c4f-a633-a80dc452de6e None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:56.941484 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a61b2-8da4-4c4f-a633-a80dc452de6e None admin] PATH_INFO: `/v3/services/image` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:56.942112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a61b2-8da4-4c4f-a633-a80dc452de6e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:56.943478 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a61b2-8da4-4c4f-a633-a80dc452de6e None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:56.953389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-5d0a61b2-8da4-4c4f-a633-a80dc452de6e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 09:58:56.953389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:56.953389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:56.953389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:56.953389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:56.953389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:56.953389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:56.953389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:56.953389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 09:58:56.953389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:56.953389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:56.953389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:56.953389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:56.953389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:56.953389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:56.953389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:56.953389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:56.954401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:56.954401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:56.954401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:56.954401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:56.954401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:56.954401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:56.954401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:56.954401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:56.954401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:56.954401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:56.954401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:56.954401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:56.954401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:56.954401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:56.954401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:56.954401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:56.955293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:56.955293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:56.955293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:56.955293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:56.955293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:56.955293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:56.955293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:56.955293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:56.955293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:56.955293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:56.955293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:56.955293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:56.955293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 09:58:56.955293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:56.955293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 496/1023] 10.222.0.85 () {56 vars in 1105 bytes} [Tue Aug 2 09:58:56 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:56.960691 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9adaa-b9fc-4092-9fc5-8a293b54acd4 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:57.061922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9adaa-b9fc-4092-9fc5-8a293b54acd4 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:57.096905 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cd2a9-8333-4b6f-86fd-72b937fda368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:57.097512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cd2a9-8333-4b6f-86fd-72b937fda368 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:57.097788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cd2a9-8333-4b6f-86fd-72b937fda368 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:57.098055 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748cd2a9-8333-4b6f-86fd-72b937fda368 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:57.098730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cd2a9-8333-4b6f-86fd-72b937fda368 None admin] RBAC: Adding query filter params (name=image) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:57.099029 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cd2a9-8333-4b6f-86fd-72b937fda368 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:57.100379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748cd2a9-8333-4b6f-86fd-72b937fda368 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:57.101448 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:57.111789 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 528/1024] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:57.113366 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a61b2-8da4-4c4f-a633-a80dc452de6e None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:57.198265 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:57.222658 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a61b2-8da4-4c4f-a633-a80dc452de6e None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:57.257988 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985fe59-f868-44e8-b863-872c8fd756ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:57.258784 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985fe59-f868-44e8-b863-872c8fd756ef None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:57.259469 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985fe59-f868-44e8-b863-872c8fd756ef None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:57.259845 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985fe59-f868-44e8-b863-872c8fd756ef None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:57.261669 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985fe59-f868-44e8-b863-872c8fd756ef None admin] RBAC: Adding query filter params (type=image) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:57.261984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985fe59-f868-44e8-b863-872c8fd756ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:57.263515 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1985fe59-f868-44e8-b863-872c8fd756ef None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:57.268720 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 497/1025] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:57.274815 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cd2a9-8333-4b6f-86fd-72b937fda368 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:57.384686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748cd2a9-8333-4b6f-86fd-72b937fda368 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:57.421640 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc424a-b45c-4d77-aab3-5ecd53dc8567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:57.422257 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc424a-b45c-4d77-aab3-5ecd53dc8567 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:57.422533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc424a-b45c-4d77-aab3-5ecd53dc8567 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:57.422800 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc424a-b45c-4d77-aab3-5ecd53dc8567 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:57.423553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc424a-b45c-4d77-aab3-5ecd53dc8567 None admin] RBAC: Adding query filter params (interface=public, service_id=b8d918c6d3c74e07b90a783eec03544d, region_id=RegionOne) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:57.423859 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc424a-b45c-4d77-aab3-5ecd53dc8567 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:57.425250 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc424a-b45c-4d77-aab3-5ecd53dc8567 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:57.435127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 529/1026] 10.222.0.85 () {56 vars in 1251 bytes} [Tue Aug 2 09:58:57 2022] GET /identity/v3/endpoints?service_id=b8d918c6d3c74e07b90a783eec03544d&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:57.436776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985fe59-f868-44e8-b863-872c8fd756ef None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:57.538789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985fe59-f868-44e8-b863-872c8fd756ef None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:57.572857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabfb6f4-3d96-48ba-a772-19cbf4497474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:57.573480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfb6f4-3d96-48ba-a772-19cbf4497474 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:57.573786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfb6f4-3d96-48ba-a772-19cbf4497474 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:57.574057 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfb6f4-3d96-48ba-a772-19cbf4497474 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:57.574796 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfb6f4-3d96-48ba-a772-19cbf4497474 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:57.576437 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabfb6f4-3d96-48ba-a772-19cbf4497474 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:57.588897 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 498/1027] 10.222.0.85 () {56 vars in 1087 bytes} [Tue Aug 2 09:58:57 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 09:58:57.805382 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b6294-383d-4f33-ad56-a5910f91cf83 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:57.805867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b6294-383d-4f33-ad56-a5910f91cf83 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:57.805867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b6294-383d-4f33-ad56-a5910f91cf83 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:57.807948 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 530/1028] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:57.812894 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb135b-28f2-49bb-a869-74ef8cc6ad67 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:57.813343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb135b-28f2-49bb-a869-74ef8cc6ad67 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:57.813520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb135b-28f2-49bb-a869-74ef8cc6ad67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:57.826436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:57.833023 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-39eb135b-28f2-49bb-a869-74ef8cc6ad67 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:57.834212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-39eb135b-28f2-49bb-a869-74ef8cc6ad67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:57.850342 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697faf5c-4a67-4da2-93a5-c9aad4647889 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:57.850644 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697faf5c-4a67-4da2-93a5-c9aad4647889 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:57.850909 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697faf5c-4a67-4da2-93a5-c9aad4647889 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:57.852261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 531/1029] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:58:57.857790 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558856f-e1c3-4cd1-8325-198c76eb3da0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:57.858080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558856f-e1c3-4cd1-8325-198c76eb3da0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:57.858397 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558856f-e1c3-4cd1-8325-198c76eb3da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:57.878226 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a558856f-e1c3-4cd1-8325-198c76eb3da0 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:57.879407 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a558856f-e1c3-4cd1-8325-198c76eb3da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:57.910900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 499/1030] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:58:57.936447 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb135b-28f2-49bb-a869-74ef8cc6ad67 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:57.948359 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:57.961578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 532/1031] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:58:57.985988 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558856f-e1c3-4cd1-8325-198c76eb3da0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:58.045679 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb135b-28f2-49bb-a869-74ef8cc6ad67 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:58.085853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a1afd-76cf-4e70-a837-1d6336029b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:58.086418 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a1afd-76cf-4e70-a837-1d6336029b65 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:58.086704 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a1afd-76cf-4e70-a837-1d6336029b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:58.086984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a1afd-76cf-4e70-a837-1d6336029b65 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:58.089931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:58.098712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558856f-e1c3-4cd1-8325-198c76eb3da0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:58.099053 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a1afd-76cf-4e70-a837-1d6336029b65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:58:58.104148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-0d2a1afd-76cf-4e70-a837-1d6336029b65 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:58:58.104148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:58.104148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:58.104148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:58.104148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:58.104148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:58.104148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:58.104148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:58.104148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:58.104148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:58.104148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:58.104148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:58.104148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:58:58.104148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:58:58.104148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:58:58.104148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:58:58.105124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:58:58.105124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:58:58.105124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:58:58.105124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:58:58.105124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:58.105124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:58.105124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:58.105124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:58.105124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:58.105124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:58.105124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:58.105124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:58.105124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:58.105124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:58.105124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:58.105124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:58.109316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:58.109316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:58.109316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:58.109316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:58.109316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:58:58.109316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:58:58.109316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:58:58.109316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:58:58.109316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:58:58.109316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:58:58.109316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:58:58.109316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:58.109316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 500/1032] 10.222.0.85 () {56 vars in 1120 bytes} [Tue Aug 2 09:58:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:58.111404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a1afd-76cf-4e70-a837-1d6336029b65 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:58.141007 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ad15e-e85f-415b-b36e-fd323f768d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:58.141925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ad15e-e85f-415b-b36e-fd323f768d4d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:58.142205 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ad15e-e85f-415b-b36e-fd323f768d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:58.142479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ad15e-e85f-415b-b36e-fd323f768d4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:58.143625 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ad15e-e85f-415b-b36e-fd323f768d4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:58.145092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ad15e-e85f-415b-b36e-fd323f768d4d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:58.146676 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 533/1033] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:58.152321 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ad15e-e85f-415b-b36e-fd323f768d4d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:58.218433 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:58.225751 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a1afd-76cf-4e70-a837-1d6336029b65 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:58.262982 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aab309-db10-46ad-be13-b0611986389e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:58.263625 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aab309-db10-46ad-be13-b0611986389e None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:58.263911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aab309-db10-46ad-be13-b0611986389e None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:58.264191 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aab309-db10-46ad-be13-b0611986389e None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:58.264968 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aab309-db10-46ad-be13-b0611986389e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:58.265280 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aab309-db10-46ad-be13-b0611986389e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:58.265453 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ad15e-e85f-415b-b36e-fd323f768d4d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:58.266661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aab309-db10-46ad-be13-b0611986389e None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:58.276196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 501/1034] 10.222.0.85 () {56 vars in 1115 bytes} [Tue Aug 2 09:58:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:58.281745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aab309-db10-46ad-be13-b0611986389e None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:58.310391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34866b0-50bd-4258-8f69-27a0f83eb806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:58.311016 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34866b0-50bd-4258-8f69-27a0f83eb806 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:58.311299 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34866b0-50bd-4258-8f69-27a0f83eb806 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:58.311575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34866b0-50bd-4258-8f69-27a0f83eb806 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:58.312264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34866b0-50bd-4258-8f69-27a0f83eb806 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:58.313726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34866b0-50bd-4258-8f69-27a0f83eb806 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:58.338663 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 534/1035] 10.222.0.85 () {60 vars in 1132 bytes} [Tue Aug 2 09:58:58 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:58:58.349761 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:58.406682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aab309-db10-46ad-be13-b0611986389e None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:58.443986 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba98d6-7746-42fd-b011-ce7e73189d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:58.444664 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba98d6-7746-42fd-b011-ce7e73189d60 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:58.444945 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba98d6-7746-42fd-b011-ce7e73189d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:58.445219 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba98d6-7746-42fd-b011-ce7e73189d60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:58.457436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba98d6-7746-42fd-b011-ce7e73189d60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:58.458902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba98d6-7746-42fd-b011-ce7e73189d60 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:58.475040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-b0ba98d6-7746-42fd-b011-ce7e73189d60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:58.475040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:58.475040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:58.475040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:58.475040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:58.475040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:58.475040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:58.475040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:58.475040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:58.475040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:58.475040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:58.475040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:58.475040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:58.475040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:58.475040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:58.476016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:58.476016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:58.476016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:58.476016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:58.476016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:58.476016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:58.476016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:58.476016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:58.476016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:58.476016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:58.476016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:58.476016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:58.476016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:58.476016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:58.476016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:58.476016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:58.476016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:58.476974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:58.476974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:58.476974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:58.476974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:58.480917 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 502/1036] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:58.483001 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34866b0-50bd-4258-8f69-27a0f83eb806 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:58.591089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34866b0-50bd-4258-8f69-27a0f83eb806 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:58.608174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:58.628116 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3164a-0e7b-4e7d-bd28-2cba717a5ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:58.628763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3164a-0e7b-4e7d-bd28-2cba717a5ece None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:58.629044 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3164a-0e7b-4e7d-bd28-2cba717a5ece None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:58.629315 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3164a-0e7b-4e7d-bd28-2cba717a5ece None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:58.630009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3164a-0e7b-4e7d-bd28-2cba717a5ece None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:58.630315 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3164a-0e7b-4e7d-bd28-2cba717a5ece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:58.631923 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3164a-0e7b-4e7d-bd28-2cba717a5ece None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:58.644877 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 535/1037] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:58:58.650221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba98d6-7746-42fd-b011-ce7e73189d60 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:58.755856 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba98d6-7746-42fd-b011-ce7e73189d60 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:58.767941 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:58.792516 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b10b9-43ea-42d8-9ecb-4fa57d3e5582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:58.793171 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b10b9-43ea-42d8-9ecb-4fa57d3e5582 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:58.793449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b10b9-43ea-42d8-9ecb-4fa57d3e5582 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:58.793722 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b10b9-43ea-42d8-9ecb-4fa57d3e5582 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:58.801466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b10b9-43ea-42d8-9ecb-4fa57d3e5582 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:58.802917 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b10b9-43ea-42d8-9ecb-4fa57d3e5582 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:58.815703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-880b10b9-43ea-42d8-9ecb-4fa57d3e5582 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:58:58.815703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:58.815703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:58.815703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:58.815703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:58.815703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:58.815703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:58.815703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:58.815703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:58.815703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:58.815703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:58.815703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:58.815703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:58:58.815703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:58:58.815703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:58:58.815703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:58:58.817365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:58.817365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:58.817365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:58:58.817365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:58.817365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:58:58.817365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:58:58.817365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:58.817365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:58.817365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:58.817365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:58.817365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:58.817365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:58.817365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:58.817365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:58.817365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:58.817365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:58.817365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:58.817365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:58.818653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:58.818653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:58.818653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:58:58.818653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:58:58.818653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:58:58.818653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:58:58.818653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:58:58.818653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:58:58.818653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:58:58.818653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:58.820534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 503/1038] 10.222.0.85 () {56 vars in 1093 bytes} [Tue Aug 2 09:58:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:58.823301 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3164a-0e7b-4e7d-bd28-2cba717a5ece None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:58.937852 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3164a-0e7b-4e7d-bd28-2cba717a5ece None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:58.972604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9638021-c163-495f-aeef-b2c73eaee103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:58.973218 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9638021-c163-495f-aeef-b2c73eaee103 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:58.973495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9638021-c163-495f-aeef-b2c73eaee103 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:58.973766 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9638021-c163-495f-aeef-b2c73eaee103 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:58.974553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9638021-c163-495f-aeef-b2c73eaee103 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:58.974856 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9638021-c163-495f-aeef-b2c73eaee103 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:58.976298 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9638021-c163-495f-aeef-b2c73eaee103 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:58.999553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 536/1039] 10.222.0.85 () {56 vars in 1133 bytes} [Tue Aug 2 09:58:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:59.000998 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b10b9-43ea-42d8-9ecb-4fa57d3e5582 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:59.101692 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b10b9-43ea-42d8-9ecb-4fa57d3e5582 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:59.136780 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0370234-ed4b-4fe1-9490-eb4ffbe8f093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:59.137393 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370234-ed4b-4fe1-9490-eb4ffbe8f093 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:59.137675 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370234-ed4b-4fe1-9490-eb4ffbe8f093 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:59.137952 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0370234-ed4b-4fe1-9490-eb4ffbe8f093 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:59.178215 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:59.209319 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0370234-ed4b-4fe1-9490-eb4ffbe8f093 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:59.210711 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0370234-ed4b-4fe1-9490-eb4ffbe8f093 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:59.321474 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 504/1040] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:58:58 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 09:58:59.327113 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9638021-c163-495f-aeef-b2c73eaee103 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:59.363129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:59.435108 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9638021-c163-495f-aeef-b2c73eaee103 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:59.468629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b7fdc-5cb1-49b8-a993-bac986954dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:59.469190 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b7fdc-5cb1-49b8-a993-bac986954dfd None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:59.469467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b7fdc-5cb1-49b8-a993-bac986954dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:59.469736 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b7fdc-5cb1-49b8-a993-bac986954dfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:59.480434 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b7fdc-5cb1-49b8-a993-bac986954dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:59.481927 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b7fdc-5cb1-49b8-a993-bac986954dfd None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:59.497279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-3b6b7fdc-5cb1-49b8-a993-bac986954dfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:59.497279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:59.497279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:59.497279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:59.497279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:59.497279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:59.497279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:59.497279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:59.497279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:59.497279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:59.497279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:59.497279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:59.497279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:58:59.497279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:58:59.497279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:58:59.498208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:58:59.498208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:59.498208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:59.498208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:59.498208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:59.498208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:59.498208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:59.498208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:59.498208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:59.498208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:59.498208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:59.498208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:59.498208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:59.498208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:59.498208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:59.498208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:59.498208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:59.499105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:58:59.499105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:58:59.499105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:58:59.499105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:59.499916 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 537/1041] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:59.504085 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0370234-ed4b-4fe1-9490-eb4ffbe8f093 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:59.575742 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:59.610711 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0370234-ed4b-4fe1-9490-eb4ffbe8f093 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:59.647541 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09759246-a86e-4ec0-9bc3-e92cd195431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:59.648259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09759246-a86e-4ec0-9bc3-e92cd195431a None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:59.648577 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09759246-a86e-4ec0-9bc3-e92cd195431a None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:59.648854 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09759246-a86e-4ec0-9bc3-e92cd195431a None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:59.649552 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09759246-a86e-4ec0-9bc3-e92cd195431a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:59.649710 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52feea11-f72e-4803-af83-1b4f95fc0935 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:59.649863 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09759246-a86e-4ec0-9bc3-e92cd195431a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:59.649961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52feea11-f72e-4803-af83-1b4f95fc0935 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:59.650228 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52feea11-f72e-4803-af83-1b4f95fc0935 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:59.652272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 538/1042] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:58:59.652386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09759246-a86e-4ec0-9bc3-e92cd195431a None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:59.657033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa757437-4398-41e8-a854-75236967bd58 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:59.657323 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa757437-4398-41e8-a854-75236967bd58 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:59.657595 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa757437-4398-41e8-a854-75236967bd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:59.671217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 505/1043] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:58:59.672512 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09759246-a86e-4ec0-9bc3-e92cd195431a None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:59.676377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-aa757437-4398-41e8-a854-75236967bd58 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:58:59.677673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-aa757437-4398-41e8-a854-75236967bd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:58:59.748351 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 539/1044] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:58:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:58:59.770668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa757437-4398-41e8-a854-75236967bd58 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:59.781162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09759246-a86e-4ec0-9bc3-e92cd195431a None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:59.789057 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:59.811661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:58:59.817758 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facda715-4855-4e09-a716-42887b13c70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:59.818456 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda715-4855-4e09-a716-42887b13c70c None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:59.818852 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda715-4855-4e09-a716-42887b13c70c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:59.819128 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda715-4855-4e09-a716-42887b13c70c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:59.826494 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facda715-4855-4e09-a716-42887b13c70c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:59.827937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facda715-4855-4e09-a716-42887b13c70c None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:59.839554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-facda715-4855-4e09-a716-42887b13c70c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:59.839554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:59.839554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:59.839554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:59.839554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:59.839554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:59.839554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:59.839554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:59.839554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:59.839554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:59.839554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:59.839554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:59.839554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:58:59.839554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:58:59.839554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:58:59.840482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:58:59.840482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:59.840482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:59.840482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:59.840482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:59.840482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:59.840482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:59.840482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:59.840482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:59.840482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:59.840482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:59.840482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:59.840482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:59.840482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:59.840482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:59.840482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:59.840482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:59.846225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:58:59.846225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:58:59.846225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:58:59.846225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:58:59.846225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:58:59.846225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:58:59.846225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:58:59.846225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:58:59.846225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 506/1045] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:58:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:58:59.846707 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facda715-4855-4e09-a716-42887b13c70c None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:59.891528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa757437-4398-41e8-a854-75236967bd58 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:59.926645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403242d-1022-4d03-83f8-f95476d88a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:59.927289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403242d-1022-4d03-83f8-f95476d88a5d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:59.927580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403242d-1022-4d03-83f8-f95476d88a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:59.927860 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403242d-1022-4d03-83f8-f95476d88a5d None admin] PATH_INFO: `/v3/services/image` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:59.928478 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403242d-1022-4d03-83f8-f95476d88a5d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:58:59.929844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3403242d-1022-4d03-83f8-f95476d88a5d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:58:59.939937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-3403242d-1022-4d03-83f8-f95476d88a5d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 09:58:59.939937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:59.939937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 09:58:59.939937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 09:58:59.939937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 09:58:59.939937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 09:58:59.939937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 09:58:59.939937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:59.939937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 09:58:59.939937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:59.939937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:58:59.939937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:59.939937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:58:59.939937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:58:59.939937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:58:59.939937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:58:59.939937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:58:59.941183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:58:59.941183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:58:59.941183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:58:59.941183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:58:59.941183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:58:59.941183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:58:59.941183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 09:58:59.941183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 09:58:59.941183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 09:58:59.941183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 09:58:59.941183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:58:59.941183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:58:59.941183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:58:59.941183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:58:59.941183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:58:59.941183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:58:59.942006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:58:59.942006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:58:59.942006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:58:59.942006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:58:59.942006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:58:59.942006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:58:59.942006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:58:59.942006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:58:59.942006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:58:59.942006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:58:59.942006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 09:58:59.942006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 09:58:59.942006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 09:58:59.942006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:58:59.942006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 540/1046] 10.222.0.85 () {56 vars in 1105 bytes} [Tue Aug 2 09:58:59 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:58:59.946952 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403242d-1022-4d03-83f8-f95476d88a5d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:58:59.955999 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facda715-4855-4e09-a716-42887b13c70c None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:58:59.996185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dc9ec-cf1b-4d7a-bf5a-053b9e47f331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:58:59.996980 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dc9ec-cf1b-4d7a-bf5a-053b9e47f331 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:58:59.997265 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dc9ec-cf1b-4d7a-bf5a-053b9e47f331 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:58:59.997543 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dc9ec-cf1b-4d7a-bf5a-053b9e47f331 None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:58:59.998294 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dc9ec-cf1b-4d7a-bf5a-053b9e47f331 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:58:59.998659 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dc9ec-cf1b-4d7a-bf5a-053b9e47f331 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:00.000319 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dc9ec-cf1b-4d7a-bf5a-053b9e47f331 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:00.013597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 507/1047] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:58:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:00.019457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dc9ec-cf1b-4d7a-bf5a-053b9e47f331 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:00.033145 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:00.055676 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403242d-1022-4d03-83f8-f95476d88a5d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:00.071828 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:00.094447 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8283d-fed4-41ef-a43e-47835a54c4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:00.095170 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8283d-fed4-41ef-a43e-47835a54c4eb None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:00.095459 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8283d-fed4-41ef-a43e-47835a54c4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:00.095739 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8283d-fed4-41ef-a43e-47835a54c4eb None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:00.096425 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8283d-fed4-41ef-a43e-47835a54c4eb None admin] RBAC: Adding query filter params (name=image) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:00.096763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8283d-fed4-41ef-a43e-47835a54c4eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:00.098142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8283d-fed4-41ef-a43e-47835a54c4eb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:00.103230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 541/1048] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:58:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:59:00.110046 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8283d-fed4-41ef-a43e-47835a54c4eb None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:00.131783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dc9ec-cf1b-4d7a-bf5a-053b9e47f331 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:00.169570 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d9689-bf67-4b24-986d-85f87122c819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:00.170634 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d9689-bf67-4b24-986d-85f87122c819 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:00.170925 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d9689-bf67-4b24-986d-85f87122c819 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:00.171360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d9689-bf67-4b24-986d-85f87122c819 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:00.172159 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d9689-bf67-4b24-986d-85f87122c819 None admin] RBAC: Adding query filter params (role.id=142cbbffc00f4c1aa03655720f13107c, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=310867deefd34a598cfef2f3e4245ace) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:00.172514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d9689-bf67-4b24-986d-85f87122c819 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:00.173954 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d9689-bf67-4b24-986d-85f87122c819 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:00.188510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 508/1049] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:59:00 2022] GET /identity/v3/role_assignments?user.id=310867deefd34a598cfef2f3e4245ace&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=142cbbffc00f4c1aa03655720f13107c => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:59:00.237449 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8283d-fed4-41ef-a43e-47835a54c4eb None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:00.278193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d3056-7d60-4a7c-9d09-d8e470fcbcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:00.278749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d3056-7d60-4a7c-9d09-d8e470fcbcfe None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:00.279029 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d3056-7d60-4a7c-9d09-d8e470fcbcfe None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:00.279302 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d3056-7d60-4a7c-9d09-d8e470fcbcfe None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:00.279997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d3056-7d60-4a7c-9d09-d8e470fcbcfe None admin] RBAC: Adding query filter params (type=image) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:00.280304 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d3056-7d60-4a7c-9d09-d8e470fcbcfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:00.281740 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d3056-7d60-4a7c-9d09-d8e470fcbcfe None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:00.295484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 542/1050] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:59:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:59:00.298727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d9689-bf67-4b24-986d-85f87122c819 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:00.411766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d9689-bf67-4b24-986d-85f87122c819 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:00.426906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:00.448815 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a459f-9251-4b94-8b78-1ebfe5201990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:00.449441 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a459f-9251-4b94-8b78-1ebfe5201990 None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:00.449726 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a459f-9251-4b94-8b78-1ebfe5201990 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:00.450003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a459f-9251-4b94-8b78-1ebfe5201990 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:00.450715 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a459f-9251-4b94-8b78-1ebfe5201990 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:00.452073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a459f-9251-4b94-8b78-1ebfe5201990 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:00.472621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 509/1051] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 09:59:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:59:00.547178 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e1e87-06d8-4190-845d-5afe0faa8f01 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:00.547484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e1e87-06d8-4190-845d-5afe0faa8f01 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:00.547670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e1e87-06d8-4190-845d-5afe0faa8f01 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:00.549219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 543/1052] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:59:00.554684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9a83b-9713-4b41-90dc-ae450ddf647c None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:00.554988 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9a83b-9713-4b41-90dc-ae450ddf647c None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:00.555272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9a83b-9713-4b41-90dc-ae450ddf647c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:00.575877 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-61d9a83b-9713-4b41-90dc-ae450ddf647c None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:00.577132 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-61d9a83b-9713-4b41-90dc-ae450ddf647c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:00.657624 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 510/1053] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:59:00.680822 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e1e87-06d8-4190-845d-5afe0faa8f01 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:00.693275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:00.787555 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e1e87-06d8-4190-845d-5afe0faa8f01 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:00.822990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346ecd5-07ea-4948-bb11-e3387aad0e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:00.823603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346ecd5-07ea-4948-bb11-e3387aad0e7f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:00.823894 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346ecd5-07ea-4948-bb11-e3387aad0e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:00.824170 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346ecd5-07ea-4948-bb11-e3387aad0e7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:00.834554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346ecd5-07ea-4948-bb11-e3387aad0e7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:59:00.839607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-3346ecd5-07ea-4948-bb11-e3387aad0e7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:59:00.839607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:00.839607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:00.839607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:00.839607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:00.839607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:00.839607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:00.839607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:00.839607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:00.839607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:00.839607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:00.839607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:00.839607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:59:00.839607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:59:00.839607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:59:00.839607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:59:00.840587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:59:00.840587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:59:00.840587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:59:00.840587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:59:00.840587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:00.840587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:00.840587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:00.840587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:00.840587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:00.840587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:00.840587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:00.840587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:00.840587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:00.840587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:00.840587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:00.840587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:00.841636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:00.841636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:00.841636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:00.841636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:00.841636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:59:00.841636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:59:00.841636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:59:00.841636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:59:00.841636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:59:00.841636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:59:00.841636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:59:00.841636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:59:00.841636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 544/1054] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:59:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:59:00.846748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9a83b-9713-4b41-90dc-ae450ddf647c None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:00.947384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:00.955190 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9a83b-9713-4b41-90dc-ae450ddf647c None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:00.992833 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370871e2-63c3-4319-96f1-611bf95c1d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:00.993453 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370871e2-63c3-4319-96f1-611bf95c1d22 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:00.993739 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370871e2-63c3-4319-96f1-611bf95c1d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:00.994017 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370871e2-63c3-4319-96f1-611bf95c1d22 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:00.995655 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370871e2-63c3-4319-96f1-611bf95c1d22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:00.995991 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370871e2-63c3-4319-96f1-611bf95c1d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:00.997361 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370871e2-63c3-4319-96f1-611bf95c1d22 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:01.010924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 511/1055] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:59:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:01.012171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346ecd5-07ea-4948-bb11-e3387aad0e7f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:01.081530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:01.116295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346ecd5-07ea-4948-bb11-e3387aad0e7f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:01.151152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ba21a-1563-4b07-bb7d-95c89f2bdc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:01.152050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ba21a-1563-4b07-bb7d-95c89f2bdc4a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:01.152340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ba21a-1563-4b07-bb7d-95c89f2bdc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:01.152624 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ba21a-1563-4b07-bb7d-95c89f2bdc4a None admin] PATH_INFO: `/v3/users/4ff3d765e3c74d89b61a40cebb8244cc` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:01.165964 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ba21a-1563-4b07-bb7d-95c89f2bdc4a None admin] RBAC: Authorizing `identity:get_user(user_id=4ff3d765e3c74d89b61a40cebb8244cc)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:01.168052 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ba21a-1563-4b07-bb7d-95c89f2bdc4a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:01.169910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 545/1056] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:59:01 2022] GET /identity/v3/users/4ff3d765e3c74d89b61a40cebb8244cc => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:01.175397 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370871e2-63c3-4319-96f1-611bf95c1d22 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:01.277271 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370871e2-63c3-4319-96f1-611bf95c1d22 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:01.316701 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60a41a-8ffa-4390-947c-4cad3244512b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:01.317327 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60a41a-8ffa-4390-947c-4cad3244512b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:01.317644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60a41a-8ffa-4390-947c-4cad3244512b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:01.317928 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60a41a-8ffa-4390-947c-4cad3244512b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:01.346035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:01.389963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60a41a-8ffa-4390-947c-4cad3244512b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:01.391417 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60a41a-8ffa-4390-947c-4cad3244512b None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:01.495137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 512/1057] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:59:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:59:01.496547 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ba21a-1563-4b07-bb7d-95c89f2bdc4a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:01.597377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ba21a-1563-4b07-bb7d-95c89f2bdc4a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:01.624983 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:01.636605 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3eaca8-194a-40ef-9ce0-45fa4c4a83e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:01.637265 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eaca8-194a-40ef-9ce0-45fa4c4a83e2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:01.637551 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eaca8-194a-40ef-9ce0-45fa4c4a83e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:01.637829 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eaca8-194a-40ef-9ce0-45fa4c4a83e2 None admin] PATH_INFO: `/v3/projects/eb987c71ff7c463f9a3e68679738d6e6` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:01.639003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3eaca8-194a-40ef-9ce0-45fa4c4a83e2 None admin] RBAC: Authorizing `identity:get_project(project_id=eb987c71ff7c463f9a3e68679738d6e6)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:01.640438 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3eaca8-194a-40ef-9ce0-45fa4c4a83e2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:01.647168 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 546/1058] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:59:01 2022] GET /identity/v3/projects/eb987c71ff7c463f9a3e68679738d6e6 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:59:01.648173 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60a41a-8ffa-4390-947c-4cad3244512b None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:01.708605 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:01.752104 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60a41a-8ffa-4390-947c-4cad3244512b None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:01.786571 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be239f0c-acee-4a5c-b891-719fec7d02e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:01.787189 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be239f0c-acee-4a5c-b891-719fec7d02e4 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:01.787476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be239f0c-acee-4a5c-b891-719fec7d02e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:01.787756 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be239f0c-acee-4a5c-b891-719fec7d02e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:01.788580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be239f0c-acee-4a5c-b891-719fec7d02e4 None admin] RBAC: Adding query filter params (role.id=c15ca78eb3c9472f94e15e2d28c7f403, scope.project.id=eb987c71ff7c463f9a3e68679738d6e6, user.id=4ff3d765e3c74d89b61a40cebb8244cc) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:01.788897 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be239f0c-acee-4a5c-b891-719fec7d02e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:01.790320 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be239f0c-acee-4a5c-b891-719fec7d02e4 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:01.804550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 513/1059] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:59:01 2022] GET /identity/v3/role_assignments?user.id=4ff3d765e3c74d89b61a40cebb8244cc&scope.project.id=eb987c71ff7c463f9a3e68679738d6e6&role.id=c15ca78eb3c9472f94e15e2d28c7f403 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:59:02.226298 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaaa5c-d758-4daf-998f-76e00f79db83 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:02.226861 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaaa5c-d758-4daf-998f-76e00f79db83 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:02.226861 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aaaa5c-d758-4daf-998f-76e00f79db83 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:02.228341 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 547/1060] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:59:02.234544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed498e15-4a62-4ad8-996c-d999577f0e31 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:02.234940 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed498e15-4a62-4ad8-996c-d999577f0e31 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:02.235139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed498e15-4a62-4ad8-996c-d999577f0e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:02.254205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-ed498e15-4a62-4ad8-996c-d999577f0e31 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:02.255390 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ed498e15-4a62-4ad8-996c-d999577f0e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:02.330271 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 514/1061] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:59:02.352426 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaaa5c-d758-4daf-998f-76e00f79db83 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:02.458801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aaaa5c-d758-4daf-998f-76e00f79db83 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:02.493562 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f1caf-70f4-45cd-bae8-56c3590e3ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:02.494120 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f1caf-70f4-45cd-bae8-56c3590e3ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:02.494461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f1caf-70f4-45cd-bae8-56c3590e3ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:02.494735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f1caf-70f4-45cd-bae8-56c3590e3ad0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:02.505362 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f1caf-70f4-45cd-bae8-56c3590e3ad0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:59:02.510788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-ec6f1caf-70f4-45cd-bae8-56c3590e3ad0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:59:02.510788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:02.510788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:02.510788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:02.510788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:02.510788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:02.510788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:02.510788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:02.510788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:02.510788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:02.510788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:02.510788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:02.510788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:59:02.510788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:59:02.510788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:59:02.510788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:59:02.511712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:59:02.511712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:59:02.511712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:59:02.511712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:59:02.511712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:02.511712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:02.511712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:02.511712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:02.511712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:02.511712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:02.511712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:02.511712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:02.511712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:02.511712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:02.511712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:02.511712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:02.512559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:02.512559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:02.512559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:02.512559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:02.512559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:59:02.512559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:59:02.512559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:59:02.512559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:59:02.512559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:59:02.512559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:59:02.512559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:59:02.512559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:59:02.516786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 548/1062] 10.222.0.85 () {56 vars in 1120 bytes} [Tue Aug 2 09:59:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:59:02.517966 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed498e15-4a62-4ad8-996c-d999577f0e31 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:02.531714 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01180644-d98b-4540-ab71-42af9d35a954 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:02.532000 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01180644-d98b-4540-ab71-42af9d35a954 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:02.532274 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01180644-d98b-4540-ab71-42af9d35a954 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:02.533919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 549/1063] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:59:02.538642 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb91f5d-865d-4292-a0b4-e35810b5fb83 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:02.538928 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb91f5d-865d-4292-a0b4-e35810b5fb83 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:02.539197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb91f5d-865d-4292-a0b4-e35810b5fb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:02.558069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-dfb91f5d-865d-4292-a0b4-e35810b5fb83 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:02.559292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dfb91f5d-865d-4292-a0b4-e35810b5fb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:02.572944 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:02.611923 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:02.623703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed498e15-4a62-4ad8-996c-d999577f0e31 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:02.630590 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 550/1064] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:59:02.652881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb91f5d-865d-4292-a0b4-e35810b5fb83 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:02.660014 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd0a4f-993c-42a6-9492-8d41978a9625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:02.660883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd0a4f-993c-42a6-9492-8d41978a9625 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:02.661359 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd0a4f-993c-42a6-9492-8d41978a9625 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:02.661796 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd0a4f-993c-42a6-9492-8d41978a9625 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:02.662515 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd0a4f-993c-42a6-9492-8d41978a9625 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:02.662873 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd0a4f-993c-42a6-9492-8d41978a9625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:02.664261 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd0a4f-993c-42a6-9492-8d41978a9625 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:02.673495 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 515/1065] 10.222.0.85 () {56 vars in 1115 bytes} [Tue Aug 2 09:59:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:02.678650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd0a4f-993c-42a6-9492-8d41978a9625 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:02.762635 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb91f5d-865d-4292-a0b4-e35810b5fb83 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:02.781952 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd0a4f-993c-42a6-9492-8d41978a9625 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:02.795658 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:02.799136 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3600a4-ab52-4eea-997d-d12935c95a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:02.799792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3600a4-ab52-4eea-997d-d12935c95a93 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:02.800077 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3600a4-ab52-4eea-997d-d12935c95a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:02.800359 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3600a4-ab52-4eea-997d-d12935c95a93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:02.820022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33391ba6-c1b8-4b1c-a3ee-388297321ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:02.820974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33391ba6-c1b8-4b1c-a3ee-388297321ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:02.821396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33391ba6-c1b8-4b1c-a3ee-388297321ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:02.821810 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33391ba6-c1b8-4b1c-a3ee-388297321ba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:02.833240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33391ba6-c1b8-4b1c-a3ee-388297321ba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:02.834894 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33391ba6-c1b8-4b1c-a3ee-388297321ba1 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:02.851369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-33391ba6-c1b8-4b1c-a3ee-388297321ba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:59:02.851369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:02.851369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:02.851369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:02.851369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:02.851369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:02.851369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:02.851369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:02.851369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:02.851369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:02.851369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:02.851369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:02.851369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:59:02.851369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:59:02.851369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:59:02.852326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:59:02.852326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:02.852326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:02.852326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:02.852326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:02.852326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:02.852326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:02.852326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:02.852326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:02.852326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:02.852326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:02.852326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:02.852326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:02.852326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:02.852326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:02.852326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:02.852326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:02.853347 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:59:02.853347 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:59:02.853347 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:59:02.853347 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:59:02.855541 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 516/1066] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:59:02.856360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:02.861162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33391ba6-c1b8-4b1c-a3ee-388297321ba1 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:02.878389 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3600a4-ab52-4eea-997d-d12935c95a93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:02.879863 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3600a4-ab52-4eea-997d-d12935c95a93 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:02.976095 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33391ba6-c1b8-4b1c-a3ee-388297321ba1 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:02.993554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 551/1067] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:59:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 09:59:02.999983 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3600a4-ab52-4eea-997d-d12935c95a93 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:03.015980 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9acfc-eb50-49ca-b517-1abb979ac944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:03.016627 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9acfc-eb50-49ca-b517-1abb979ac944 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:03.016891 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9acfc-eb50-49ca-b517-1abb979ac944 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:03.017164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9acfc-eb50-49ca-b517-1abb979ac944 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:03.017851 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9acfc-eb50-49ca-b517-1abb979ac944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:03.018162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9acfc-eb50-49ca-b517-1abb979ac944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:03.019510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9acfc-eb50-49ca-b517-1abb979ac944 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:03.031531 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 517/1068] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:03.037020 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9acfc-eb50-49ca-b517-1abb979ac944 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:03.066350 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:03.096241 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:03.114978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3600a4-ab52-4eea-997d-d12935c95a93 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:03.145376 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9acfc-eb50-49ca-b517-1abb979ac944 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:03.151164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdce20-dfc0-4a5b-a09b-fa57654a3d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:03.151794 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdce20-dfc0-4a5b-a09b-fa57654a3d29 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:03.152078 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdce20-dfc0-4a5b-a09b-fa57654a3d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:03.152353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdce20-dfc0-4a5b-a09b-fa57654a3d29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:03.162988 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdce20-dfc0-4a5b-a09b-fa57654a3d29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:03.164437 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdce20-dfc0-4a5b-a09b-fa57654a3d29 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:03.179902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c37451-400c-49b6-abe8-56e22d223f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:03.180556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c37451-400c-49b6-abe8-56e22d223f2b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:03.180837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c37451-400c-49b6-abe8-56e22d223f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:03.181108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c37451-400c-49b6-abe8-56e22d223f2b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:03.181209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-03bdce20-dfc0-4a5b-a09b-fa57654a3d29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:59:03.181209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:03.181209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:03.181209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:03.181209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:03.181209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:03.181209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:03.181209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:03.181209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:03.181209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:03.181209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:03.181209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:03.181209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:59:03.181209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:59:03.181209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:59:03.182129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:59:03.182129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:03.182129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:03.182129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:03.182129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:03.182129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:03.182129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:03.182129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:03.182129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:03.182129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:03.182129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:03.182129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:03.182129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:03.182129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:03.182129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:03.182129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:03.182129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:03.183724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:59:03.183724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:59:03.183724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:59:03.183724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:59:03.183724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 552/1069] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:59:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:59:03.188353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdce20-dfc0-4a5b-a09b-fa57654a3d29 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:03.189864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c37451-400c-49b6-abe8-56e22d223f2b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:03.191299 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c37451-400c-49b6-abe8-56e22d223f2b None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:03.203537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-b7c37451-400c-49b6-abe8-56e22d223f2b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:59:03.203537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:03.203537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:03.203537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:03.203537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:03.203537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:03.203537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:03.203537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:03.203537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:03.203537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:03.203537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:03.203537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:03.203537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:59:03.203537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:59:03.203537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:59:03.203537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:59:03.204510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:03.204510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:03.204510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:59:03.204510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:59:03.204510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:59:03.204510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:59:03.204510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:03.204510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:03.204510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:03.204510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:03.204510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:03.204510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:03.204510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:03.204510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:03.204510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:03.204510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:03.204510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:03.204510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:03.210436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:03.210436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:03.210436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:59:03.210436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:59:03.210436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:59:03.210436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:59:03.210436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:59:03.210436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:59:03.210436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:59:03.210436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:59:03.210436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 518/1070] 10.222.0.85 () {56 vars in 1093 bytes} [Tue Aug 2 09:59:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:59:03.213212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c37451-400c-49b6-abe8-56e22d223f2b None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:03.310412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:03.311651 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdce20-dfc0-4a5b-a09b-fa57654a3d29 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:03.327894 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c37451-400c-49b6-abe8-56e22d223f2b None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:03.349921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90303eb6-82c5-48e1-8261-2b3f08f8de7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:03.350545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90303eb6-82c5-48e1-8261-2b3f08f8de7b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:03.350818 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90303eb6-82c5-48e1-8261-2b3f08f8de7b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:03.351086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90303eb6-82c5-48e1-8261-2b3f08f8de7b None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:03.351780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90303eb6-82c5-48e1-8261-2b3f08f8de7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:03.352079 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90303eb6-82c5-48e1-8261-2b3f08f8de7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:03.353464 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90303eb6-82c5-48e1-8261-2b3f08f8de7b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:03.356820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:03.367673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 553/1071] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:03.368737 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8ac04-5f34-449e-ae7e-7e729dac224a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:03.369407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8ac04-5f34-449e-ae7e-7e729dac224a None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:03.369712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8ac04-5f34-449e-ae7e-7e729dac224a None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:03.369963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8ac04-5f34-449e-ae7e-7e729dac224a None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:03.370784 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8ac04-5f34-449e-ae7e-7e729dac224a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:03.371098 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8ac04-5f34-449e-ae7e-7e729dac224a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:03.372597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8ac04-5f34-449e-ae7e-7e729dac224a None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:03.399381 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 519/1072] 10.222.0.85 () {56 vars in 1133 bytes} [Tue Aug 2 09:59:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:59:03.401767 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90303eb6-82c5-48e1-8261-2b3f08f8de7b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:03.517716 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90303eb6-82c5-48e1-8261-2b3f08f8de7b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:03.557253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4008c-8ce4-4413-92bd-8938ce78b8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:03.557810 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4008c-8ce4-4413-92bd-8938ce78b8aa None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:03.558085 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4008c-8ce4-4413-92bd-8938ce78b8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:03.558353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4008c-8ce4-4413-92bd-8938ce78b8aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:03.568835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4008c-8ce4-4413-92bd-8938ce78b8aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:03.570464 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4008c-8ce4-4413-92bd-8938ce78b8aa None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:03.586755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d6a4008c-8ce4-4413-92bd-8938ce78b8aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:59:03.586755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:03.586755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:03.586755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:03.586755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:03.586755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:03.586755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:03.586755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:03.586755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:03.586755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:03.586755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:03.586755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:03.586755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:59:03.586755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:59:03.586755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:59:03.587703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:59:03.587703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:03.587703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:03.587703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:03.587703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:03.587703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:03.587703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:03.587703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:03.587703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:03.587703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:03.587703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:03.587703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:03.587703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:03.587703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:03.587703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:03.587703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:03.587703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:03.589394 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:59:03.589394 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:59:03.589394 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:59:03.589394 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:59:03.589394 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 554/1073] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:59:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:59:03.595593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8ac04-5f34-449e-ae7e-7e729dac224a None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:03.703301 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8ac04-5f34-449e-ae7e-7e729dac224a None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:03.738719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca3c99-77bd-4c1f-b5cb-3f0c60b76bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:03.739331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca3c99-77bd-4c1f-b5cb-3f0c60b76bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:03.739617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca3c99-77bd-4c1f-b5cb-3f0c60b76bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:03.739891 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca3c99-77bd-4c1f-b5cb-3f0c60b76bc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:03.740607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca3c99-77bd-4c1f-b5cb-3f0c60b76bc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:03.740913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca3c99-77bd-4c1f-b5cb-3f0c60b76bc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:03.742272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca3c99-77bd-4c1f-b5cb-3f0c60b76bc3 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:03.753757 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 520/1074] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:59:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:03.759574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4008c-8ce4-4413-92bd-8938ce78b8aa None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:03.809482 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:03.852789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb98cd7-ee1e-46df-a3ea-0dd13a55fa94 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:03.853081 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb98cd7-ee1e-46df-a3ea-0dd13a55fa94 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:03.853358 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb98cd7-ee1e-46df-a3ea-0dd13a55fa94 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:03.855332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 521/1075] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 09:59:03.860204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4008c-8ce4-4413-92bd-8938ce78b8aa None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:03.860378 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf788ed-2f68-4e01-955f-90425f664654 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:03.860700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf788ed-2f68-4e01-955f-90425f664654 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:03.860979 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf788ed-2f68-4e01-955f-90425f664654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:03.868139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:03.881329 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-5bf788ed-2f68-4e01-955f-90425f664654 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:03.882764 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-5bf788ed-2f68-4e01-955f-90425f664654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:03.895822 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be18af-3cc5-4e6d-9182-07b55b64d4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:03.896477 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be18af-3cc5-4e6d-9182-07b55b64d4fe None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:03.896769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be18af-3cc5-4e6d-9182-07b55b64d4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:03.897045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be18af-3cc5-4e6d-9182-07b55b64d4fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:03.903594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be18af-3cc5-4e6d-9182-07b55b64d4fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:03.905057 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be18af-3cc5-4e6d-9182-07b55b64d4fe None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:03.916660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a6be18af-3cc5-4e6d-9182-07b55b64d4fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:59:03.916660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:03.916660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:03.916660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:03.916660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:03.916660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:03.916660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:03.916660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:03.916660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:03.916660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:03.916660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:03.916660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:03.916660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:59:03.916660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:59:03.916660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:59:03.917539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:59:03.917539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:03.917539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:03.917539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:03.917539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:03.917539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:03.917539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:03.917539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:03.917539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:03.917539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:03.917539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:03.917539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:03.917539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:03.917539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:03.917539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:03.917539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:03.917539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:03.918460 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:59:03.918460 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:59:03.918460 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:59:03.918460 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:59:03.918460 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:59:03.918460 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:59:03.918460 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:59:03.918460 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:59:03.918460 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 555/1076] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:59:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:59:03.923449 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be18af-3cc5-4e6d-9182-07b55b64d4fe None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:03.951026 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 522/1077] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:59:03.972907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf788ed-2f68-4e01-955f-90425f664654 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:04.023456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be18af-3cc5-4e6d-9182-07b55b64d4fe None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:04.032954 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:04.059060 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6558839-d442-4b3e-8c1f-85a70671f2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:04.059736 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6558839-d442-4b3e-8c1f-85a70671f2ea None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:04.059963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6558839-d442-4b3e-8c1f-85a70671f2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:04.060237 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6558839-d442-4b3e-8c1f-85a70671f2ea None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:04.061016 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6558839-d442-4b3e-8c1f-85a70671f2ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:04.061326 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6558839-d442-4b3e-8c1f-85a70671f2ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:04.062739 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6558839-d442-4b3e-8c1f-85a70671f2ea None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:04.070879 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf788ed-2f68-4e01-955f-90425f664654 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:04.074649 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 556/1078] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:59:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:59:04.080531 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6558839-d442-4b3e-8c1f-85a70671f2ea None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:04.105398 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797bfe1-41cf-4665-ad53-ea5292373522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:04.106030 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797bfe1-41cf-4665-ad53-ea5292373522 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:04.106307 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797bfe1-41cf-4665-ad53-ea5292373522 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:04.106577 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797bfe1-41cf-4665-ad53-ea5292373522 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:04.108372 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:04.117913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797bfe1-41cf-4665-ad53-ea5292373522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:59:04.123700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-f797bfe1-41cf-4665-ad53-ea5292373522 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:59:04.123700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:04.123700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:04.123700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:04.123700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:04.123700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:04.123700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:04.123700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:04.123700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:04.123700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:04.123700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:04.123700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:04.123700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:59:04.123700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:59:04.123700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:59:04.123700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:59:04.124797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:59:04.124797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:59:04.124797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:59:04.124797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:59:04.124797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:04.124797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:04.124797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:04.124797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:04.124797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:04.124797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:04.124797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:04.124797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:04.124797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:04.124797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:04.124797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:04.124797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:04.126125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:04.126125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:04.126125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:04.126125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:04.126125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:59:04.126125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:59:04.126125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:59:04.126125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:59:04.126125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:59:04.126125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:59:04.126125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:59:04.126125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:59:04.126125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 523/1079] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:59:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:59:04.130799 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797bfe1-41cf-4665-ad53-ea5292373522 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:04.181819 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6558839-d442-4b3e-8c1f-85a70671f2ea None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:04.215534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d1fbf-cbc6-491b-9661-1ecf8b953f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:04.216193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d1fbf-cbc6-491b-9661-1ecf8b953f8a None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:04.216487 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d1fbf-cbc6-491b-9661-1ecf8b953f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:04.216761 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d1fbf-cbc6-491b-9661-1ecf8b953f8a None admin] PATH_INFO: `/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/310867deefd34a598cfef2f3e4245ace/roles/142cbbffc00f4c1aa03655720f13107c` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:04.218938 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d1fbf-cbc6-491b-9661-1ecf8b953f8a None admin] RBAC: Authorizing `identity:create_grant(project_id=701d7ad0b7594984885e7bfe8a236937, user_id=310867deefd34a598cfef2f3e4245ace, role_id=142cbbffc00f4c1aa03655720f13107c)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:04.220348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d1fbf-cbc6-491b-9661-1ecf8b953f8a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:04.232010 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797bfe1-41cf-4665-ad53-ea5292373522 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:04.234205 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 557/1080] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:59:04 2022] PUT /identity/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/310867deefd34a598cfef2f3e4245ace/roles/142cbbffc00f4c1aa03655720f13107c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 09:59:04.279139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31ce3e-ff40-44ed-b21e-f5a727dade0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:04.279781 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31ce3e-ff40-44ed-b21e-f5a727dade0b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:04.280067 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31ce3e-ff40-44ed-b21e-f5a727dade0b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:04.280343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31ce3e-ff40-44ed-b21e-f5a727dade0b None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:04.281114 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31ce3e-ff40-44ed-b21e-f5a727dade0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:04.281426 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31ce3e-ff40-44ed-b21e-f5a727dade0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:04.282850 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31ce3e-ff40-44ed-b21e-f5a727dade0b None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:04.293359 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 524/1081] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:59:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:59:04.298868 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d1fbf-cbc6-491b-9661-1ecf8b953f8a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:04.329605 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:04.409835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d1fbf-cbc6-491b-9661-1ecf8b953f8a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:04.444721 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd20786-abb3-44cb-8f3b-6587c334051c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:04.445360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd20786-abb3-44cb-8f3b-6587c334051c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:04.445640 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd20786-abb3-44cb-8f3b-6587c334051c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:04.445913 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd20786-abb3-44cb-8f3b-6587c334051c None admin] PATH_INFO: `/v3/users/4ff3d765e3c74d89b61a40cebb8244cc` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:04.447081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd20786-abb3-44cb-8f3b-6587c334051c None admin] RBAC: Authorizing `identity:get_user(user_id=4ff3d765e3c74d89b61a40cebb8244cc)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:04.448717 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd20786-abb3-44cb-8f3b-6587c334051c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:04.450330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 558/1082] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:59:04 2022] GET /identity/v3/users/4ff3d765e3c74d89b61a40cebb8244cc => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:59:04.455887 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31ce3e-ff40-44ed-b21e-f5a727dade0b None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:04.512230 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:04.556590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31ce3e-ff40-44ed-b21e-f5a727dade0b None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:04.590883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031f2a1-7486-4eae-a833-b0c9d9e25b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:04.591447 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031f2a1-7486-4eae-a833-b0c9d9e25b4c None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:04.591730 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031f2a1-7486-4eae-a833-b0c9d9e25b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:04.592009 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031f2a1-7486-4eae-a833-b0c9d9e25b4c None admin] PATH_INFO: `/v3/projects/eb987c71ff7c463f9a3e68679738d6e6` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:04.593181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031f2a1-7486-4eae-a833-b0c9d9e25b4c None admin] RBAC: Authorizing `identity:get_project(project_id=eb987c71ff7c463f9a3e68679738d6e6)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:04.594613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7031f2a1-7486-4eae-a833-b0c9d9e25b4c None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:04.596278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 525/1083] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:59:04 2022] GET /identity/v3/projects/eb987c71ff7c463f9a3e68679738d6e6 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:04.602163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd20786-abb3-44cb-8f3b-6587c334051c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:04.699436 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:04.706358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd20786-abb3-44cb-8f3b-6587c334051c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:04.739431 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab437e-a326-41a8-a250-6c7d46d1b47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:04.740102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab437e-a326-41a8-a250-6c7d46d1b47b None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:04.740358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab437e-a326-41a8-a250-6c7d46d1b47b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:04.740653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab437e-a326-41a8-a250-6c7d46d1b47b None admin] PATH_INFO: `/v3/projects/eb987c71ff7c463f9a3e68679738d6e6/users/4ff3d765e3c74d89b61a40cebb8244cc/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:04.742564 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab437e-a326-41a8-a250-6c7d46d1b47b None admin] RBAC: Authorizing `identity:create_grant(project_id=eb987c71ff7c463f9a3e68679738d6e6, user_id=4ff3d765e3c74d89b61a40cebb8244cc, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:04.743976 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab437e-a326-41a8-a250-6c7d46d1b47b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:04.757541 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 559/1084] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:59:04 2022] PUT /identity/v3/projects/eb987c71ff7c463f9a3e68679738d6e6/users/4ff3d765e3c74d89b61a40cebb8244cc/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:59:06.303561 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fac9e1-eed1-4128-a090-6bac305ae259 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:06.303957 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fac9e1-eed1-4128-a090-6bac305ae259 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:06.304121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fac9e1-eed1-4128-a090-6bac305ae259 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:06.305651 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 526/1085] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:59:06.311682 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90ab7f-f78c-4939-af68-0435806ad60a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:06.312077 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90ab7f-f78c-4939-af68-0435806ad60a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:06.312239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90ab7f-f78c-4939-af68-0435806ad60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:06.330840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ec90ab7f-f78c-4939-af68-0435806ad60a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:06.332024 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ec90ab7f-f78c-4939-af68-0435806ad60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:06.398739 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 560/1086] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:59:06.422908 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fac9e1-eed1-4128-a090-6bac305ae259 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:06.528542 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fac9e1-eed1-4128-a090-6bac305ae259 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:06.552499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:06.564856 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0519616-4b5e-4f07-b9d6-68f17a4ea0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:06.565778 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0519616-4b5e-4f07-b9d6-68f17a4ea0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:06.566068 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0519616-4b5e-4f07-b9d6-68f17a4ea0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:06.566346 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0519616-4b5e-4f07-b9d6-68f17a4ea0e2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:06.576640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0519616-4b5e-4f07-b9d6-68f17a4ea0e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:59:06.581546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-b0519616-4b5e-4f07-b9d6-68f17a4ea0e2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:59:06.581546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:06.581546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:06.581546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:06.581546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:06.581546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:06.581546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:06.581546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:06.581546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:06.581546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:06.581546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:06.581546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:06.581546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:59:06.581546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:59:06.581546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:59:06.581546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:59:06.582445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:59:06.582445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:59:06.582445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:59:06.582445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:59:06.582445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:06.582445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:06.582445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:06.582445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:06.582445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:06.582445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:06.582445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:06.582445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:06.582445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:06.582445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:06.582445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:06.582445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:06.583288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:06.583288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:06.583288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:06.583288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:06.583288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:59:06.583288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:59:06.583288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:59:06.583288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:59:06.583288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:59:06.583288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:59:06.583288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 09:59:06.583288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:59:06.583288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 527/1087] 10.222.0.85 () {56 vars in 1120 bytes} [Tue Aug 2 09:59:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:59:06.589472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90ab7f-f78c-4939-af68-0435806ad60a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:06.672569 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:06.688478 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90ab7f-f78c-4939-af68-0435806ad60a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:06.722604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08ce15-5382-4fb2-8894-9e13f7b38ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:06.723552 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08ce15-5382-4fb2-8894-9e13f7b38ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:06.723836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08ce15-5382-4fb2-8894-9e13f7b38ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:06.724108 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08ce15-5382-4fb2-8894-9e13f7b38ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:06.724863 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08ce15-5382-4fb2-8894-9e13f7b38ae3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:06.725168 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08ce15-5382-4fb2-8894-9e13f7b38ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:06.726523 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08ce15-5382-4fb2-8894-9e13f7b38ae3 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:06.734504 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 561/1088] 10.222.0.85 () {56 vars in 1115 bytes} [Tue Aug 2 09:59:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:06.740228 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0519616-4b5e-4f07-b9d6-68f17a4ea0e2 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:06.792041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e79ad-6517-48d2-bc41-b68247870420 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:06.792332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e79ad-6517-48d2-bc41-b68247870420 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:06.792645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e79ad-6517-48d2-bc41-b68247870420 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:06.794006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 562/1089] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:59:06.798738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c79eb-9c4e-48fc-a6b2-60f6004f7e40 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:06.799029 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c79eb-9c4e-48fc-a6b2-60f6004f7e40 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:06.799308 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c79eb-9c4e-48fc-a6b2-60f6004f7e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:06.817053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-110c79eb-9c4e-48fc-a6b2-60f6004f7e40 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:06.818176 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-110c79eb-9c4e-48fc-a6b2-60f6004f7e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:06.839569 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0519616-4b5e-4f07-b9d6-68f17a4ea0e2 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:06.876169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e10b88-1eb4-42b6-ac95-a4ce6ee8cac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:06.876941 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e10b88-1eb4-42b6-ac95-a4ce6ee8cac7 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:06.877490 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e10b88-1eb4-42b6-ac95-a4ce6ee8cac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:06.877652 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e10b88-1eb4-42b6-ac95-a4ce6ee8cac7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:06.889597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e10b88-1eb4-42b6-ac95-a4ce6ee8cac7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:06.891049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e10b88-1eb4-42b6-ac95-a4ce6ee8cac7 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:06.893003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 563/1090] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:59:06.905826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-85e10b88-1eb4-42b6-ac95-a4ce6ee8cac7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:59:06.905826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:06.905826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:06.905826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:06.905826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:06.905826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:06.905826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:06.905826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:06.905826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:06.905826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:06.905826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:06.905826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:06.905826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:59:06.905826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:59:06.905826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:59:06.906872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:59:06.906872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:06.906872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:06.906872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:06.906872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:06.906872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:06.906872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:06.906872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:06.906872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:06.906872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:06.906872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:06.906872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:06.906872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:06.906872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:06.906872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:06.906872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:06.906872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:06.907766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:59:06.907766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:59:06.907766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:59:06.907766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:59:06.907766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 528/1091] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:59:06.912743 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c79eb-9c4e-48fc-a6b2-60f6004f7e40 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:06.915674 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e10b88-1eb4-42b6-ac95-a4ce6ee8cac7 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:06.951932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:06.993036 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:07.017670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c79eb-9c4e-48fc-a6b2-60f6004f7e40 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:07.020337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e10b88-1eb4-42b6-ac95-a4ce6ee8cac7 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:07.051783 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f955e4b-2833-47e0-a427-18f850feebbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:07.052400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f955e4b-2833-47e0-a427-18f850feebbd None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:07.052737 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f955e4b-2833-47e0-a427-18f850feebbd None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:07.053020 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f955e4b-2833-47e0-a427-18f850feebbd None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:07.053715 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f955e4b-2833-47e0-a427-18f850feebbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:07.054025 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f955e4b-2833-47e0-a427-18f850feebbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:07.054202 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd3451-f53a-4394-857c-f632cfa1d85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:07.054834 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd3451-f53a-4394-857c-f632cfa1d85b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:07.055118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd3451-f53a-4394-857c-f632cfa1d85b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:07.055395 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd3451-f53a-4394-857c-f632cfa1d85b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:07.055485 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f955e4b-2833-47e0-a427-18f850feebbd None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:07.066269 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd3451-f53a-4394-857c-f632cfa1d85b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:59:07.067013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 564/1092] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:07.071996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-20cd3451-f53a-4394-857c-f632cfa1d85b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:59:07.071996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:07.071996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:07.071996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:07.071996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:07.071996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:07.071996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:07.071996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:07.071996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:07.071996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:07.071996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:07.071996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:07.071996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:59:07.071996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:59:07.071996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:59:07.071996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:59:07.073608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:59:07.073608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:59:07.073608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:59:07.073608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:59:07.073608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:07.073608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:07.073608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:07.073608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:07.073608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:07.073608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:07.073608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:07.073608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:07.073608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:07.073608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:07.073608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:07.073608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:07.074454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:07.074454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:07.074454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:07.074454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:07.074454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:59:07.074454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:59:07.074454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:59:07.074454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:59:07.074454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:59:07.074454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:59:07.074454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:59:07.074454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:59:07.075211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f955e4b-2833-47e0-a427-18f850feebbd None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:07.075284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 529/1093] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:59:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:59:07.079327 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd3451-f53a-4394-857c-f632cfa1d85b None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:07.174906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:07.175605 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f955e4b-2833-47e0-a427-18f850feebbd None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:07.181142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd3451-f53a-4394-857c-f632cfa1d85b None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:07.209899 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f3324-0903-422f-8b21-2ec928da3c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:07.210532 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f3324-0903-422f-8b21-2ec928da3c51 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:07.210817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f3324-0903-422f-8b21-2ec928da3c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:07.211091 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f3324-0903-422f-8b21-2ec928da3c51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:07.216694 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b5976-fd90-4051-b02b-b16789cf07ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:07.217328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b5976-fd90-4051-b02b-b16789cf07ee None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:07.217587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b5976-fd90-4051-b02b-b16789cf07ee None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:07.217860 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b5976-fd90-4051-b02b-b16789cf07ee None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:07.218483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f3324-0903-422f-8b21-2ec928da3c51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:07.218577 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b5976-fd90-4051-b02b-b16789cf07ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:07.218864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b5976-fd90-4051-b02b-b16789cf07ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:07.219935 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f3324-0903-422f-8b21-2ec928da3c51 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:07.220211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b5976-fd90-4051-b02b-b16789cf07ee None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:07.221757 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:07.230331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 530/1094] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:59:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:59:07.232960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-741f3324-0903-422f-8b21-2ec928da3c51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:59:07.232960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:07.232960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:07.232960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:07.232960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:07.232960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:07.232960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:07.232960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:07.232960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:07.232960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:07.232960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:07.232960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:07.232960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 09:59:07.232960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 09:59:07.232960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 09:59:07.232960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 09:59:07.234030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:07.234030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:07.234030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 09:59:07.234030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:59:07.234030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 09:59:07.234030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 09:59:07.234030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:07.234030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:07.234030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:07.234030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:07.234030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:07.234030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:07.234030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:07.234030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:07.234030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:07.234030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:07.234030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:07.234030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:07.239687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:07.239687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:07.239687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 09:59:07.239687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 09:59:07.239687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 09:59:07.239687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 09:59:07.239687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 09:59:07.239687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 09:59:07.239687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 09:59:07.239687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:59:07.239687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 565/1095] 10.222.0.85 () {56 vars in 1093 bytes} [Tue Aug 2 09:59:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:59:07.240282 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b5976-fd90-4051-b02b-b16789cf07ee None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:07.240367 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f3324-0903-422f-8b21-2ec928da3c51 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:07.342598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b5976-fd90-4051-b02b-b16789cf07ee None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:07.344776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f3324-0903-422f-8b21-2ec928da3c51 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:07.377783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b992d5c-c22a-477c-bee0-5817f3fe495f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:07.378419 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b992d5c-c22a-477c-bee0-5817f3fe495f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:07.378706 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b992d5c-c22a-477c-bee0-5817f3fe495f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:07.378979 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b992d5c-c22a-477c-bee0-5817f3fe495f None admin] PATH_INFO: `/v3/users/4ff3d765e3c74d89b61a40cebb8244cc` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:07.379234 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13cd2c-86d8-4ba4-982b-2599bb554df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:07.379839 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13cd2c-86d8-4ba4-982b-2599bb554df4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:07.380116 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13cd2c-86d8-4ba4-982b-2599bb554df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:07.380214 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b992d5c-c22a-477c-bee0-5817f3fe495f None admin] RBAC: Authorizing `identity:get_user(user_id=4ff3d765e3c74d89b61a40cebb8244cc)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:07.380385 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13cd2c-86d8-4ba4-982b-2599bb554df4 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:07.381196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13cd2c-86d8-4ba4-982b-2599bb554df4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:07.381506 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13cd2c-86d8-4ba4-982b-2599bb554df4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:07.381861 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b992d5c-c22a-477c-bee0-5817f3fe495f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:07.383148 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13cd2c-86d8-4ba4-982b-2599bb554df4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:07.383483 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 531/1096] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:59:07 2022] GET /identity/v3/users/4ff3d765e3c74d89b61a40cebb8244cc => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:59:07.390515 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b992d5c-c22a-477c-bee0-5817f3fe495f None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:07.402480 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 566/1097] 10.222.0.85 () {56 vars in 1133 bytes} [Tue Aug 2 09:59:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:59:07.408087 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13cd2c-86d8-4ba4-982b-2599bb554df4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:07.419092 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:07.463734 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:07.492947 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b992d5c-c22a-477c-bee0-5817f3fe495f None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:07.508222 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13cd2c-86d8-4ba4-982b-2599bb554df4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:07.529094 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6600d4-13fd-4df5-bd00-49f90f0b3e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:07.529709 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6600d4-13fd-4df5-bd00-49f90f0b3e65 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:07.529991 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6600d4-13fd-4df5-bd00-49f90f0b3e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:07.530266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6600d4-13fd-4df5-bd00-49f90f0b3e65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:07.542991 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09fe99-abb8-46e4-b30a-9b77aae59def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:07.543603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09fe99-abb8-46e4-b30a-9b77aae59def None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:07.543884 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09fe99-abb8-46e4-b30a-9b77aae59def None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:07.544154 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09fe99-abb8-46e4-b30a-9b77aae59def None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:07.598646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6600d4-13fd-4df5-bd00-49f90f0b3e65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:07.600045 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6600d4-13fd-4df5-bd00-49f90f0b3e65 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:07.612696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09fe99-abb8-46e4-b30a-9b77aae59def None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:07.614131 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09fe99-abb8-46e4-b30a-9b77aae59def None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:07.625079 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:07.670008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:07.704295 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 532/1098] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:59:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:59:07.705337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6600d4-13fd-4df5-bd00-49f90f0b3e65 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:07.716941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 567/1099] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:59:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 09:59:07.722501 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09fe99-abb8-46e4-b30a-9b77aae59def None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:07.804073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6600d4-13fd-4df5-bd00-49f90f0b3e65 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:07.822225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09fe99-abb8-46e4-b30a-9b77aae59def None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:07.830671 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:07.839600 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91111611-24f2-43f5-93c0-d0c4359b8600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:07.840247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91111611-24f2-43f5-93c0-d0c4359b8600 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:07.840554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91111611-24f2-43f5-93c0-d0c4359b8600 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:07.840837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91111611-24f2-43f5-93c0-d0c4359b8600 None admin] PATH_INFO: `/v3/projects/eb987c71ff7c463f9a3e68679738d6e6` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:07.841988 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91111611-24f2-43f5-93c0-d0c4359b8600 None admin] RBAC: Authorizing `identity:get_project(project_id=eb987c71ff7c463f9a3e68679738d6e6)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:07.843422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91111611-24f2-43f5-93c0-d0c4359b8600 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:07.845115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 533/1100] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:59:07 2022] GET /identity/v3/projects/eb987c71ff7c463f9a3e68679738d6e6 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:59:07.851059 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91111611-24f2-43f5-93c0-d0c4359b8600 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:07.857243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbbac4-46cb-4b42-a8c8-0c78414273f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:07.857874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbbac4-46cb-4b42-a8c8-0c78414273f2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:07.858149 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbbac4-46cb-4b42-a8c8-0c78414273f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:07.858418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbbac4-46cb-4b42-a8c8-0c78414273f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:07.869824 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbbac4-46cb-4b42-a8c8-0c78414273f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:07.871248 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbbac4-46cb-4b42-a8c8-0c78414273f2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:07.887626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-22fbbac4-46cb-4b42-a8c8-0c78414273f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:59:07.887626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:07.887626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:07.887626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:07.887626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:07.887626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:07.887626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:07.887626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:07.887626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:07.887626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:07.887626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:07.887626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:07.887626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:59:07.887626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:59:07.887626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:59:07.888583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:59:07.888583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:07.888583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:07.888583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:07.888583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:07.888583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:07.888583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:07.888583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:07.888583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:07.888583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:07.888583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:07.888583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:07.888583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:07.888583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:07.888583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:07.888583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:07.888583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:07.889472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 09:59:07.889472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:59:07.889472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 09:59:07.889472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:59:07.889472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 568/1101] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 09:59:07.894410 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbbac4-46cb-4b42-a8c8-0c78414273f2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:07.905398 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:07.953468 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91111611-24f2-43f5-93c0-d0c4359b8600 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:07.986485 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614a07b-eb0b-442b-a36e-df997cf52f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:07.987093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614a07b-eb0b-442b-a36e-df997cf52f1b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:07.987378 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614a07b-eb0b-442b-a36e-df997cf52f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:07.987717 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614a07b-eb0b-442b-a36e-df997cf52f1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:07.988545 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614a07b-eb0b-442b-a36e-df997cf52f1b None admin] RBAC: Adding query filter params (role.id=c15ca78eb3c9472f94e15e2d28c7f403, scope.project.id=eb987c71ff7c463f9a3e68679738d6e6, user.id=4ff3d765e3c74d89b61a40cebb8244cc) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:07.988863 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614a07b-eb0b-442b-a36e-df997cf52f1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:07.990292 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614a07b-eb0b-442b-a36e-df997cf52f1b None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:07.992173 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbbac4-46cb-4b42-a8c8-0c78414273f2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:07.996543 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 534/1102] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:59:07 2022] GET /identity/v3/role_assignments?user.id=4ff3d765e3c74d89b61a40cebb8244cc&scope.project.id=eb987c71ff7c463f9a3e68679738d6e6&role.id=c15ca78eb3c9472f94e15e2d28c7f403 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:59:08.033502 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b4b30-e025-4e7e-b432-064e72b783e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:08.034140 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b4b30-e025-4e7e-b432-064e72b783e8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:08.034423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b4b30-e025-4e7e-b432-064e72b783e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:08.034698 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b4b30-e025-4e7e-b432-064e72b783e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:08.035407 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b4b30-e025-4e7e-b432-064e72b783e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:08.035714 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b4b30-e025-4e7e-b432-064e72b783e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:08.037138 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b4b30-e025-4e7e-b432-064e72b783e8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:08.051194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 569/1103] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 09:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:59:08.057059 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614a07b-eb0b-442b-a36e-df997cf52f1b None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:08.120256 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:08.165580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614a07b-eb0b-442b-a36e-df997cf52f1b None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:08.200205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4af5a-74fa-4865-9e3b-c7681a7b9534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:08.200906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4af5a-74fa-4865-9e3b-c7681a7b9534 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:08.201189 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4af5a-74fa-4865-9e3b-c7681a7b9534 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:08.201463 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4af5a-74fa-4865-9e3b-c7681a7b9534 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:08.208340 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4af5a-74fa-4865-9e3b-c7681a7b9534 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:08.210097 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4af5a-74fa-4865-9e3b-c7681a7b9534 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:08.223689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-32d4af5a-74fa-4865-9e3b-c7681a7b9534 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:59:08.223689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:08.223689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:08.223689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:08.223689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:08.223689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:08.223689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:08.223689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:08.223689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:08.223689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:08.223689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:08.223689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:08.223689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 09:59:08.223689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 09:59:08.223689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 09:59:08.224735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 09:59:08.224735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:08.224735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:08.224735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:08.224735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:08.224735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:08.224735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:08.224735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:08.224735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:08.224735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:08.224735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:08.224735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:08.224735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:08.224735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:08.224735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:08.224735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:08.224735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:08.225913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 09:59:08.225913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 09:59:08.225913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:59:08.225913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:59:08.225913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:59:08.225913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:59:08.225913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 09:59:08.225913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:59:08.226749 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 535/1104] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 09:59:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:59:08.232667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b4b30-e025-4e7e-b432-064e72b783e8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:08.306531 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:08.341464 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b4b30-e025-4e7e-b432-064e72b783e8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:08.375954 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7624c-f07e-4b11-94b6-42361a69272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:08.376582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7624c-f07e-4b11-94b6-42361a69272d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:08.376830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7624c-f07e-4b11-94b6-42361a69272d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:08.377109 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7624c-f07e-4b11-94b6-42361a69272d None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:08.377909 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca7624c-f07e-4b11-94b6-42361a69272d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:08.378215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca7624c-f07e-4b11-94b6-42361a69272d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:08.379627 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca7624c-f07e-4b11-94b6-42361a69272d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:08.391829 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 570/1105] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 09:59:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:08.398021 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4af5a-74fa-4865-9e3b-c7681a7b9534 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:08.501180 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4af5a-74fa-4865-9e3b-c7681a7b9534 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:08.518193 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:08.536264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75ea36-092c-4dfb-a480-591bfde18d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:08.536911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75ea36-092c-4dfb-a480-591bfde18d0b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:08.537200 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75ea36-092c-4dfb-a480-591bfde18d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:08.537478 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75ea36-092c-4dfb-a480-591bfde18d0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:08.538266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75ea36-092c-4dfb-a480-591bfde18d0b None admin] RBAC: Adding query filter params (role.id=142cbbffc00f4c1aa03655720f13107c, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=310867deefd34a598cfef2f3e4245ace) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:08.538578 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75ea36-092c-4dfb-a480-591bfde18d0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:08.540008 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75ea36-092c-4dfb-a480-591bfde18d0b None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:08.546920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 536/1106] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:59:08 2022] GET /identity/v3/role_assignments?user.id=310867deefd34a598cfef2f3e4245ace&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=142cbbffc00f4c1aa03655720f13107c => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:10.046980 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7075f1-4e17-4d6d-b089-ac595801dfb4 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:10.047537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7075f1-4e17-4d6d-b089-ac595801dfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:10.047537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7075f1-4e17-4d6d-b089-ac595801dfb4 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:10.048924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 571/1107] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:59:10.053904 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a635fce-4daf-4dd1-bc67-1202b4d86e5d None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:10.054304 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a635fce-4daf-4dd1-bc67-1202b4d86e5d None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:10.054470 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a635fce-4daf-4dd1-bc67-1202b4d86e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:10.073756 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-1a635fce-4daf-4dd1-bc67-1202b4d86e5d None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:10.074936 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-1a635fce-4daf-4dd1-bc67-1202b4d86e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:10.139855 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 537/1108] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:59:10.163735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7075f1-4e17-4d6d-b089-ac595801dfb4 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:10.266502 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7075f1-4e17-4d6d-b089-ac595801dfb4 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:10.292641 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:10.301578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd1257-c58c-40e3-a3c2-2d501f0dec8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:10.302164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd1257-c58c-40e3-a3c2-2d501f0dec8e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:10.302446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd1257-c58c-40e3-a3c2-2d501f0dec8e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:10.302718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd1257-c58c-40e3-a3c2-2d501f0dec8e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:10.303874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd1257-c58c-40e3-a3c2-2d501f0dec8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:10.305335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd1257-c58c-40e3-a3c2-2d501f0dec8e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:10.307657 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 572/1109] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:59:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:10.313618 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a635fce-4daf-4dd1-bc67-1202b4d86e5d None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:10.412210 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a635fce-4daf-4dd1-bc67-1202b4d86e5d None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:10.425913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:10.447961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09826de1-ace5-42cb-9293-e26e6053887d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:10.448604 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09826de1-ace5-42cb-9293-e26e6053887d None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:10.448888 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09826de1-ace5-42cb-9293-e26e6053887d None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:10.449161 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09826de1-ace5-42cb-9293-e26e6053887d None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:10.449837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09826de1-ace5-42cb-9293-e26e6053887d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:10.451256 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09826de1-ace5-42cb-9293-e26e6053887d None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:10.472131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 538/1110] 10.222.0.85 () {60 vars in 1132 bytes} [Tue Aug 2 09:59:10 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:59:12.489330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d315fa4-c9ed-4cf4-b1a0-adfc786ab946 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:12.489904 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d315fa4-c9ed-4cf4-b1a0-adfc786ab946 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:12.489904 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d315fa4-c9ed-4cf4-b1a0-adfc786ab946 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:12.491204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 573/1111] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:59:12.496816 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e504c-cfb3-4600-9ef8-6f0264696123 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:12.497273 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e504c-cfb3-4600-9ef8-6f0264696123 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:12.497374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e504c-cfb3-4600-9ef8-6f0264696123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:12.515949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-1b5e504c-cfb3-4600-9ef8-6f0264696123 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:12.517269 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-1b5e504c-cfb3-4600-9ef8-6f0264696123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:12.582668 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 539/1112] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:59:12.605812 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d315fa4-c9ed-4cf4-b1a0-adfc786ab946 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:12.704894 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d315fa4-c9ed-4cf4-b1a0-adfc786ab946 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:12.737601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c38fc-2fff-4a15-97b8-1e1740c6ffe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:12.738223 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c38fc-2fff-4a15-97b8-1e1740c6ffe2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:12.738505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c38fc-2fff-4a15-97b8-1e1740c6ffe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:12.738779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68c38fc-2fff-4a15-97b8-1e1740c6ffe2 None admin] PATH_INFO: `/v3/roles/cbb81f88446a46f38469b450c5f24624` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:12.740218 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c38fc-2fff-4a15-97b8-1e1740c6ffe2 None admin] RBAC: Authorizing `identity:get_role(role_id=cbb81f88446a46f38469b450c5f24624)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:12.741662 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68c38fc-2fff-4a15-97b8-1e1740c6ffe2 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:12.742973 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 574/1113] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:59:12 2022] GET /identity/v3/roles/cbb81f88446a46f38469b450c5f24624 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:12.749389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e504c-cfb3-4600-9ef8-6f0264696123 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:12.845537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:12.849520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e504c-cfb3-4600-9ef8-6f0264696123 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:12.885523 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca296d-1c13-4903-9015-ee8d9d09c191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:12.886149 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca296d-1c13-4903-9015-ee8d9d09c191 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:12.886427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca296d-1c13-4903-9015-ee8d9d09c191 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:12.886696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca296d-1c13-4903-9015-ee8d9d09c191 None admin] PATH_INFO: `/v3/users/bb8b57df62184c5787c28f2adb134036` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:12.899334 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca296d-1c13-4903-9015-ee8d9d09c191 None admin] RBAC: Authorizing `identity:get_user(user_id=bb8b57df62184c5787c28f2adb134036)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:12.901614 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca296d-1c13-4903-9015-ee8d9d09c191 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:12.903228 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 540/1114] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:59:12 2022] GET /identity/v3/users/bb8b57df62184c5787c28f2adb134036 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:12.909377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c38fc-2fff-4a15-97b8-1e1740c6ffe2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:12.970129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:13.008420 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68c38fc-2fff-4a15-97b8-1e1740c6ffe2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:13.041371 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47d87f-1192-43f4-9190-771141129124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:13.041978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47d87f-1192-43f4-9190-771141129124 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:13.042259 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47d87f-1192-43f4-9190-771141129124 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:13.042533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47d87f-1192-43f4-9190-771141129124 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:13.108553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47d87f-1192-43f4-9190-771141129124 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:13.109962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47d87f-1192-43f4-9190-771141129124 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:13.169226 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:13.208177 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 575/1115] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:59:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:59:13.214562 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca296d-1c13-4903-9015-ee8d9d09c191 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:13.315521 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca296d-1c13-4903-9015-ee8d9d09c191 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:13.349551 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5530d-f604-4a8c-b629-8ac870f2b30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:13.350180 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5530d-f604-4a8c-b629-8ac870f2b30e None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:13.350464 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5530d-f604-4a8c-b629-8ac870f2b30e None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:13.350740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5530d-f604-4a8c-b629-8ac870f2b30e None admin] PATH_INFO: `/v3/projects/eb987c71ff7c463f9a3e68679738d6e6` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:13.351882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5530d-f604-4a8c-b629-8ac870f2b30e None admin] RBAC: Authorizing `identity:get_project(project_id=eb987c71ff7c463f9a3e68679738d6e6)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:13.353334 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5530d-f604-4a8c-b629-8ac870f2b30e None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:13.355431 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 541/1116] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:59:13 2022] GET /identity/v3/projects/eb987c71ff7c463f9a3e68679738d6e6 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:13.361615 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47d87f-1192-43f4-9190-771141129124 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:13.460482 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47d87f-1192-43f4-9190-771141129124 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:13.499811 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce6f88-6e4f-4661-aee6-eda4e6a32e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:13.500711 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce6f88-6e4f-4661-aee6-eda4e6a32e6f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:13.501130 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce6f88-6e4f-4661-aee6-eda4e6a32e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:13.501539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce6f88-6e4f-4661-aee6-eda4e6a32e6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:13.502742 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce6f88-6e4f-4661-aee6-eda4e6a32e6f None admin] RBAC: Adding query filter params (role.id=cbb81f88446a46f38469b450c5f24624, scope.project.id=eb987c71ff7c463f9a3e68679738d6e6, user.id=bb8b57df62184c5787c28f2adb134036) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:13.503216 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce6f88-6e4f-4661-aee6-eda4e6a32e6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:13.505450 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce6f88-6e4f-4661-aee6-eda4e6a32e6f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:13.514551 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 576/1117] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:59:13 2022] GET /identity/v3/role_assignments?user.id=bb8b57df62184c5787c28f2adb134036&scope.project.id=eb987c71ff7c463f9a3e68679738d6e6&role.id=cbb81f88446a46f38469b450c5f24624 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:15.499408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ef6fe-fd6c-4c5f-b5d1-ceeb5681e63c None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:15.499988 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ef6fe-fd6c-4c5f-b5d1-ceeb5681e63c None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:15.499988 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ef6fe-fd6c-4c5f-b5d1-ceeb5681e63c None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:15.501340 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 542/1118] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:59:15.506365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e47461-31e9-428e-a50c-102c0dc19cbb None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:15.507063 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e47461-31e9-428e-a50c-102c0dc19cbb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:15.507168 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e47461-31e9-428e-a50c-102c0dc19cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:15.525433 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b2e47461-31e9-428e-a50c-102c0dc19cbb None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:15.526674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b2e47461-31e9-428e-a50c-102c0dc19cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:15.548831 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:15.593587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 577/1119] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:59:15.615436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ef6fe-fd6c-4c5f-b5d1-ceeb5681e63c None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:15.641182 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:15.714165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ef6fe-fd6c-4c5f-b5d1-ceeb5681e63c None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:15.746390 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc3b4f-e872-46fd-bd89-9b841c0e3917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:15.747001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc3b4f-e872-46fd-bd89-9b841c0e3917 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:15.747279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc3b4f-e872-46fd-bd89-9b841c0e3917 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:15.747555 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc3b4f-e872-46fd-bd89-9b841c0e3917 None admin] PATH_INFO: `/v3/roles/cbb81f88446a46f38469b450c5f24624` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:15.748996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc3b4f-e872-46fd-bd89-9b841c0e3917 None admin] RBAC: Authorizing `identity:get_role(role_id=cbb81f88446a46f38469b450c5f24624)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:15.750341 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc3b4f-e872-46fd-bd89-9b841c0e3917 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:15.751647 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 543/1120] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:59:15 2022] GET /identity/v3/roles/cbb81f88446a46f38469b450c5f24624 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:15.757692 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e47461-31e9-428e-a50c-102c0dc19cbb None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:15.854903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e47461-31e9-428e-a50c-102c0dc19cbb None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:15.888610 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951dad6-e23b-4d7d-b3d2-3cbafc26f94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:15.889243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951dad6-e23b-4d7d-b3d2-3cbafc26f94b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:15.889526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951dad6-e23b-4d7d-b3d2-3cbafc26f94b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:15.889801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951dad6-e23b-4d7d-b3d2-3cbafc26f94b None admin] PATH_INFO: `/v3/users/bb8b57df62184c5787c28f2adb134036` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:15.890959 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951dad6-e23b-4d7d-b3d2-3cbafc26f94b None admin] RBAC: Authorizing `identity:get_user(user_id=bb8b57df62184c5787c28f2adb134036)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:15.892386 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951dad6-e23b-4d7d-b3d2-3cbafc26f94b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:15.894010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 578/1121] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:59:15 2022] GET /identity/v3/users/bb8b57df62184c5787c28f2adb134036 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:15.899751 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc3b4f-e872-46fd-bd89-9b841c0e3917 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:15.988590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:15.998394 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc3b4f-e872-46fd-bd89-9b841c0e3917 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:16.031686 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734b5eb-8402-4420-9b1c-a4ab1dd9b7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:16.032307 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734b5eb-8402-4420-9b1c-a4ab1dd9b7be None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:16.032635 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734b5eb-8402-4420-9b1c-a4ab1dd9b7be None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:16.032905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734b5eb-8402-4420-9b1c-a4ab1dd9b7be None admin] PATH_INFO: `/v3/projects/eb987c71ff7c463f9a3e68679738d6e6` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:16.034031 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734b5eb-8402-4420-9b1c-a4ab1dd9b7be None admin] RBAC: Authorizing `identity:get_project(project_id=eb987c71ff7c463f9a3e68679738d6e6)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:16.035449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734b5eb-8402-4420-9b1c-a4ab1dd9b7be None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:16.037161 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 544/1122] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:59:15 2022] GET /identity/v3/projects/eb987c71ff7c463f9a3e68679738d6e6 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:16.043454 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951dad6-e23b-4d7d-b3d2-3cbafc26f94b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:16.071278 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:16.143965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951dad6-e23b-4d7d-b3d2-3cbafc26f94b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:16.176333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86b66d-a4a7-430e-b822-b49ec8b3bc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:16.177016 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86b66d-a4a7-430e-b822-b49ec8b3bc75 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:16.177299 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86b66d-a4a7-430e-b822-b49ec8b3bc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:16.177575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86b66d-a4a7-430e-b822-b49ec8b3bc75 None admin] PATH_INFO: `/v3/projects/eb987c71ff7c463f9a3e68679738d6e6/users/bb8b57df62184c5787c28f2adb134036/roles/cbb81f88446a46f38469b450c5f24624` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:16.179728 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86b66d-a4a7-430e-b822-b49ec8b3bc75 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb987c71ff7c463f9a3e68679738d6e6, user_id=bb8b57df62184c5787c28f2adb134036, role_id=cbb81f88446a46f38469b450c5f24624)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:16.181207 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86b66d-a4a7-430e-b822-b49ec8b3bc75 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:16.194105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 579/1123] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:59:16 2022] PUT /identity/v3/projects/eb987c71ff7c463f9a3e68679738d6e6/users/bb8b57df62184c5787c28f2adb134036/roles/cbb81f88446a46f38469b450c5f24624 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:59:18.173659 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea8a18-4b6b-4a39-82fc-1fa6de5f8936 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:18.174235 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea8a18-4b6b-4a39-82fc-1fa6de5f8936 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:18.174235 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea8a18-4b6b-4a39-82fc-1fa6de5f8936 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:18.175575 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 545/1124] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:59:18.180747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45c212-6a3d-48ed-9933-8a33c0891aee None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:18.181182 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45c212-6a3d-48ed-9933-8a33c0891aee None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:18.181329 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45c212-6a3d-48ed-9933-8a33c0891aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:18.201871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-df45c212-6a3d-48ed-9933-8a33c0891aee None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:18.203083 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-df45c212-6a3d-48ed-9933-8a33c0891aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:18.268680 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 580/1125] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:59:18.293353 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea8a18-4b6b-4a39-82fc-1fa6de5f8936 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:18.398372 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea8a18-4b6b-4a39-82fc-1fa6de5f8936 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:18.436551 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dd678-d459-4f70-8e60-13e15cc07897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:18.437115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dd678-d459-4f70-8e60-13e15cc07897 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:18.437402 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dd678-d459-4f70-8e60-13e15cc07897 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:18.437689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0dd678-d459-4f70-8e60-13e15cc07897 None admin] PATH_INFO: `/v3/roles/cbb81f88446a46f38469b450c5f24624` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:18.439156 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0dd678-d459-4f70-8e60-13e15cc07897 None admin] RBAC: Authorizing `identity:get_role(role_id=cbb81f88446a46f38469b450c5f24624)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:18.440601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0dd678-d459-4f70-8e60-13e15cc07897 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:18.441955 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 546/1126] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:59:18 2022] GET /identity/v3/roles/cbb81f88446a46f38469b450c5f24624 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:18.448135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45c212-6a3d-48ed-9933-8a33c0891aee None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:18.466352 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:18.551242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45c212-6a3d-48ed-9933-8a33c0891aee None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:18.585933 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd989de-77dc-4025-b099-08cecb5d7b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:18.587077 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd989de-77dc-4025-b099-08cecb5d7b5c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:18.587077 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd989de-77dc-4025-b099-08cecb5d7b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:18.587077 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd989de-77dc-4025-b099-08cecb5d7b5c None admin] PATH_INFO: `/v3/users/bb8b57df62184c5787c28f2adb134036` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:18.588902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd989de-77dc-4025-b099-08cecb5d7b5c None admin] RBAC: Authorizing `identity:get_user(user_id=bb8b57df62184c5787c28f2adb134036)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:18.590329 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd989de-77dc-4025-b099-08cecb5d7b5c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:18.591935 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 581/1127] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:59:18 2022] GET /identity/v3/users/bb8b57df62184c5787c28f2adb134036 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:18.598404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dd678-d459-4f70-8e60-13e15cc07897 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:18.630597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:18.704840 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0dd678-d459-4f70-8e60-13e15cc07897 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:18.739572 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f0bbc-b489-4019-a0b1-d9257558c7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:18.740182 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f0bbc-b489-4019-a0b1-d9257558c7dc None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:18.740492 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f0bbc-b489-4019-a0b1-d9257558c7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:18.740756 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f0bbc-b489-4019-a0b1-d9257558c7dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:18.811462 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f0bbc-b489-4019-a0b1-d9257558c7dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:18.812936 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f0bbc-b489-4019-a0b1-d9257558c7dc None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:18.840746 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:18.916573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 547/1128] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:59:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:59:18.922507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd989de-77dc-4025-b099-08cecb5d7b5c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:19.010686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:19.027665 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd989de-77dc-4025-b099-08cecb5d7b5c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:19.061544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ede6c-1376-4ad7-814b-732469c91357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:19.062181 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ede6c-1376-4ad7-814b-732469c91357 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:19.062457 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ede6c-1376-4ad7-814b-732469c91357 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:19.062726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ede6c-1376-4ad7-814b-732469c91357 None admin] PATH_INFO: `/v3/projects/eb987c71ff7c463f9a3e68679738d6e6` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:19.063863 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ede6c-1376-4ad7-814b-732469c91357 None admin] RBAC: Authorizing `identity:get_project(project_id=eb987c71ff7c463f9a3e68679738d6e6)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:19.065319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ede6c-1376-4ad7-814b-732469c91357 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:19.066975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 582/1129] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:59:18 2022] GET /identity/v3/projects/eb987c71ff7c463f9a3e68679738d6e6 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:59:19.073163 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f0bbc-b489-4019-a0b1-d9257558c7dc None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:19.170971 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f0bbc-b489-4019-a0b1-d9257558c7dc None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:19.196116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:19.204322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8a9b0-81d3-4a70-88ad-cd01b192ca14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:19.204965 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8a9b0-81d3-4a70-88ad-cd01b192ca14 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:19.205251 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8a9b0-81d3-4a70-88ad-cd01b192ca14 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:19.205528 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8a9b0-81d3-4a70-88ad-cd01b192ca14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:19.206311 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8a9b0-81d3-4a70-88ad-cd01b192ca14 None admin] RBAC: Adding query filter params (role.id=cbb81f88446a46f38469b450c5f24624, scope.project.id=eb987c71ff7c463f9a3e68679738d6e6, user.id=bb8b57df62184c5787c28f2adb134036) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:19.206623 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8a9b0-81d3-4a70-88ad-cd01b192ca14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:19.208058 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8a9b0-81d3-4a70-88ad-cd01b192ca14 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:19.214408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 548/1130] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:59:19 2022] GET /identity/v3/role_assignments?user.id=bb8b57df62184c5787c28f2adb134036&scope.project.id=eb987c71ff7c463f9a3e68679738d6e6&role.id=cbb81f88446a46f38469b450c5f24624 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:59:21.295620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18104fde-e1f0-4ed9-98ad-9c1d03c8af73 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:21.296160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18104fde-e1f0-4ed9-98ad-9c1d03c8af73 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:21.296160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18104fde-e1f0-4ed9-98ad-9c1d03c8af73 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:21.297577 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 583/1131] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:59:21.302955 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a770813-9f58-4df3-816f-9d32676e764e None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:21.303361 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a770813-9f58-4df3-816f-9d32676e764e None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:21.303507 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a770813-9f58-4df3-816f-9d32676e764e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:21.324945 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-0a770813-9f58-4df3-816f-9d32676e764e None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:21.326141 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-0a770813-9f58-4df3-816f-9d32676e764e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:21.396033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 549/1132] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 09:59:21.418675 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18104fde-e1f0-4ed9-98ad-9c1d03c8af73 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:21.520342 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18104fde-e1f0-4ed9-98ad-9c1d03c8af73 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:21.554136 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffe3d5-fd89-4829-ba74-7ce6446b44ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:21.554695 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffe3d5-fd89-4829-ba74-7ce6446b44ad None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:21.554978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffe3d5-fd89-4829-ba74-7ce6446b44ad None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:21.555254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffe3d5-fd89-4829-ba74-7ce6446b44ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:21.556376 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffe3d5-fd89-4829-ba74-7ce6446b44ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:21.557958 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffe3d5-fd89-4829-ba74-7ce6446b44ad None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:21.559520 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 584/1133] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:59:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:21.565308 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a770813-9f58-4df3-816f-9d32676e764e None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:21.662418 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a770813-9f58-4df3-816f-9d32676e764e None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:21.683792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:21.695284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0d0e0-c8ee-4d10-8d67-fd639ffa6d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:21.695895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0d0e0-c8ee-4d10-8d67-fd639ffa6d29 None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:21.696176 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0d0e0-c8ee-4d10-8d67-fd639ffa6d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:21.696450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0d0e0-c8ee-4d10-8d67-fd639ffa6d29 None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:21.697156 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0d0e0-c8ee-4d10-8d67-fd639ffa6d29 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:21.699222 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0d0e0-c8ee-4d10-8d67-fd639ffa6d29 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:21.725002 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 550/1134] 10.222.0.85 () {60 vars in 1141 bytes} [Tue Aug 2 09:59:21 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:59:23.728127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c9c86-2150-46ae-a67f-2b73c344ad8c None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:23.728706 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c9c86-2150-46ae-a67f-2b73c344ad8c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:23.728800 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c9c86-2150-46ae-a67f-2b73c344ad8c None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:23.730088 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 585/1135] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:59:23.735285 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3aa8c-50f4-43c5-bb37-65f4220a2a83 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:23.735689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3aa8c-50f4-43c5-bb37-65f4220a2a83 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:23.735854 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3aa8c-50f4-43c5-bb37-65f4220a2a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:23.754437 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-fde3aa8c-50f4-43c5-bb37-65f4220a2a83 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:23.755603 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-fde3aa8c-50f4-43c5-bb37-65f4220a2a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:23.821450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 551/1136] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:59:23.846086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c9c86-2150-46ae-a67f-2b73c344ad8c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:23.867712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:23.949532 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2c9c86-2150-46ae-a67f-2b73c344ad8c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:23.983023 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83efa2ea-6daf-4813-a2dc-0ca940bfae8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:23.983591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83efa2ea-6daf-4813-a2dc-0ca940bfae8a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:23.983870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83efa2ea-6daf-4813-a2dc-0ca940bfae8a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:23.984143 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83efa2ea-6daf-4813-a2dc-0ca940bfae8a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:23.985447 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83efa2ea-6daf-4813-a2dc-0ca940bfae8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:23.986865 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83efa2ea-6daf-4813-a2dc-0ca940bfae8a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:23.988437 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 586/1137] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 09:59:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:23.994346 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3aa8c-50f4-43c5-bb37-65f4220a2a83 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:24.091509 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3aa8c-50f4-43c5-bb37-65f4220a2a83 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:24.093790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:24.126265 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355abdb-f2ce-4bbf-aa20-5f5e41971c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:24.126870 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355abdb-f2ce-4bbf-aa20-5f5e41971c49 None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:24.127154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355abdb-f2ce-4bbf-aa20-5f5e41971c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:24.127433 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355abdb-f2ce-4bbf-aa20-5f5e41971c49 None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:24.128130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355abdb-f2ce-4bbf-aa20-5f5e41971c49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:24.129594 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355abdb-f2ce-4bbf-aa20-5f5e41971c49 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:24.151700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 552/1138] 10.222.0.85 () {60 vars in 1132 bytes} [Tue Aug 2 09:59:23 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:59:26.218837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1119ac-45d4-4853-993f-f5ecbfacf70f None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:26.219428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1119ac-45d4-4853-993f-f5ecbfacf70f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:26.219531 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1119ac-45d4-4853-993f-f5ecbfacf70f None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:26.221507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 587/1139] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:59:26.227541 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33457d63-1baa-4d19-b9e8-08c3c872d3db None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:26.227985 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33457d63-1baa-4d19-b9e8-08c3c872d3db None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:26.228093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33457d63-1baa-4d19-b9e8-08c3c872d3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:26.247645 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-33457d63-1baa-4d19-b9e8-08c3c872d3db None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:26.248904 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-33457d63-1baa-4d19-b9e8-08c3c872d3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:26.333975 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 553/1140] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:59:26.357724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1119ac-45d4-4853-993f-f5ecbfacf70f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:26.456424 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:26.470170 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1119ac-45d4-4853-993f-f5ecbfacf70f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:26.503603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2976d06-d8af-49b6-ac5f-8a5a129c6e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:26.504226 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976d06-d8af-49b6-ac5f-8a5a129c6e22 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:26.504529 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976d06-d8af-49b6-ac5f-8a5a129c6e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:26.504799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2976d06-d8af-49b6-ac5f-8a5a129c6e22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:26.515617 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2976d06-d8af-49b6-ac5f-8a5a129c6e22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:59:26.520408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-d2976d06-d8af-49b6-ac5f-8a5a129c6e22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:59:26.520408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:26.520408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:26.520408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:26.520408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:26.520408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:26.520408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:26.520408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:26.520408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:26.520408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:26.520408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:26.520408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:26.520408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:59:26.520408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:59:26.520408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:59:26.520408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:59:26.521579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:59:26.521579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:59:26.521579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:59:26.521579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:59:26.521579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:26.521579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:26.521579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:26.521579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:26.521579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:26.521579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:26.521579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:26.521579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:26.521579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:26.521579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:26.521579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:26.521579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:26.522784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:26.522784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:26.522784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:26.522784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:26.522784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:59:26.522784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:59:26.522784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:59:26.522784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:59:26.522784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:59:26.522784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:59:26.522784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:59:26.522784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:59:26.522784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 588/1141] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:59:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:59:26.527684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33457d63-1baa-4d19-b9e8-08c3c872d3db None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:26.613442 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:26.624034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33457d63-1baa-4d19-b9e8-08c3c872d3db None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:26.658276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211e910-5bfe-4530-8458-564dc598ba39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:26.658876 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211e910-5bfe-4530-8458-564dc598ba39 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:26.659157 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211e910-5bfe-4530-8458-564dc598ba39 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:26.659429 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211e910-5bfe-4530-8458-564dc598ba39 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:26.660134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211e910-5bfe-4530-8458-564dc598ba39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:26.660434 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211e910-5bfe-4530-8458-564dc598ba39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:26.661878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211e910-5bfe-4530-8458-564dc598ba39 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:26.669769 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 554/1142] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:59:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:26.675484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2976d06-d8af-49b6-ac5f-8a5a129c6e22 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:26.775800 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2976d06-d8af-49b6-ac5f-8a5a129c6e22 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:26.809627 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2a97e-3b83-47d7-85f7-91b62b4fb7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:26.810253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2a97e-3b83-47d7-85f7-91b62b4fb7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:26.810533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2a97e-3b83-47d7-85f7-91b62b4fb7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:26.810804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2a97e-3b83-47d7-85f7-91b62b4fb7f6 None admin] PATH_INFO: `/v3/users/bfae8564c6974039a0c7fe32bc54bc34` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:26.824073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2a97e-3b83-47d7-85f7-91b62b4fb7f6 None admin] RBAC: Authorizing `identity:get_user(user_id=bfae8564c6974039a0c7fe32bc54bc34)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:26.825582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2a97e-3b83-47d7-85f7-91b62b4fb7f6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:26.827200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 589/1143] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:59:26 2022] GET /identity/v3/users/bfae8564c6974039a0c7fe32bc54bc34 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:26.833036 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211e910-5bfe-4530-8458-564dc598ba39 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:26.933391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211e910-5bfe-4530-8458-564dc598ba39 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:26.966351 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408023e3-1496-4832-b744-01ea84112d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:26.966962 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408023e3-1496-4832-b744-01ea84112d51 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:26.967248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408023e3-1496-4832-b744-01ea84112d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:26.967523 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408023e3-1496-4832-b744-01ea84112d51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:26.989023 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:27.034023 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408023e3-1496-4832-b744-01ea84112d51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:27.035392 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408023e3-1496-4832-b744-01ea84112d51 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:27.141464 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 555/1144] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:59:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:59:27.147320 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2a97e-3b83-47d7-85f7-91b62b4fb7f6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:27.156194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:27.248933 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2a97e-3b83-47d7-85f7-91b62b4fb7f6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:27.296897 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a4ed1-2739-455f-843f-7b82203cfbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:27.297568 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a4ed1-2739-455f-843f-7b82203cfbb1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:27.297733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a4ed1-2739-455f-843f-7b82203cfbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:27.298008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a4ed1-2739-455f-843f-7b82203cfbb1 None admin] PATH_INFO: `/v3/projects/e4c42bc793324cd6ac791a85111186d2` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:27.299170 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a4ed1-2739-455f-843f-7b82203cfbb1 None admin] RBAC: Authorizing `identity:get_project(project_id=e4c42bc793324cd6ac791a85111186d2)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:27.300640 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a4ed1-2739-455f-843f-7b82203cfbb1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:27.302316 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 590/1145] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:59:27 2022] GET /identity/v3/projects/e4c42bc793324cd6ac791a85111186d2 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:27.308572 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408023e3-1496-4832-b744-01ea84112d51 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:27.359650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:27.405902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408023e3-1496-4832-b744-01ea84112d51 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:27.440737 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe7a8a-2c5f-481e-b5f3-d41b19e78303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:27.441353 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe7a8a-2c5f-481e-b5f3-d41b19e78303 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:27.441638 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe7a8a-2c5f-481e-b5f3-d41b19e78303 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:27.441917 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe7a8a-2c5f-481e-b5f3-d41b19e78303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:27.442702 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe7a8a-2c5f-481e-b5f3-d41b19e78303 None admin] RBAC: Adding query filter params (role.id=c15ca78eb3c9472f94e15e2d28c7f403, scope.project.id=e4c42bc793324cd6ac791a85111186d2, user.id=bfae8564c6974039a0c7fe32bc54bc34) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:27.443016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe7a8a-2c5f-481e-b5f3-d41b19e78303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:27.444445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe7a8a-2c5f-481e-b5f3-d41b19e78303 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:27.450002 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 556/1146] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:59:27 2022] GET /identity/v3/role_assignments?user.id=bfae8564c6974039a0c7fe32bc54bc34&scope.project.id=e4c42bc793324cd6ac791a85111186d2&role.id=c15ca78eb3c9472f94e15e2d28c7f403 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:29.547517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd0fd6-86f6-4a0c-b492-1ef0669b1aee None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:29.548030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd0fd6-86f6-4a0c-b492-1ef0669b1aee None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:29.548030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd0fd6-86f6-4a0c-b492-1ef0669b1aee None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:29.549355 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 591/1147] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:59:29.554320 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381802d-839b-4f25-98d7-e890202ab753 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:29.554685 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381802d-839b-4f25-98d7-e890202ab753 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:29.554873 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381802d-839b-4f25-98d7-e890202ab753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:29.573465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-1381802d-839b-4f25-98d7-e890202ab753 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:29.574629 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-1381802d-839b-4f25-98d7-e890202ab753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:29.638659 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 557/1148] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:59:29.660921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd0fd6-86f6-4a0c-b492-1ef0669b1aee None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:29.737971 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:29.763670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd0fd6-86f6-4a0c-b492-1ef0669b1aee None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:29.797203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daa55a-6423-45b9-a62c-07ccd494f8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:29.797887 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daa55a-6423-45b9-a62c-07ccd494f8ff None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:29.798118 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daa55a-6423-45b9-a62c-07ccd494f8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:29.798392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daa55a-6423-45b9-a62c-07ccd494f8ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:29.809296 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00daa55a-6423-45b9-a62c-07ccd494f8ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:59:29.814239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-00daa55a-6423-45b9-a62c-07ccd494f8ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:59:29.814239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:29.814239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:29.814239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:29.814239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:29.814239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:29.814239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:29.814239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:29.814239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:29.814239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:29.814239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:29.814239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:29.814239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:59:29.814239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:59:29.814239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:59:29.814239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:59:29.815330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:59:29.815330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:59:29.815330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:59:29.815330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:59:29.815330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:29.815330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:29.815330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:29.815330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:29.815330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:29.815330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:29.815330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:29.815330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:29.815330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:29.815330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:29.815330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:29.815330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:29.816575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:29.816575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:29.816575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:29.816575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:29.816575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:59:29.816575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:59:29.816575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:59:29.816575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:59:29.816575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:59:29.816575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:59:29.816575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:59:29.816575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:59:29.816575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 592/1149] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:59:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:59:29.821421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381802d-839b-4f25-98d7-e890202ab753 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:29.866664 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:29.919825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381802d-839b-4f25-98d7-e890202ab753 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:29.953403 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b0057-961c-4180-83c3-4ba4cccc17f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:29.954005 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b0057-961c-4180-83c3-4ba4cccc17f3 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:29.954287 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b0057-961c-4180-83c3-4ba4cccc17f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:29.954561 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b0057-961c-4180-83c3-4ba4cccc17f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:29.955272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b0057-961c-4180-83c3-4ba4cccc17f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:29.955578 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b0057-961c-4180-83c3-4ba4cccc17f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:29.956981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b0057-961c-4180-83c3-4ba4cccc17f3 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:29.965780 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 558/1150] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:59:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:29.971515 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daa55a-6423-45b9-a62c-07ccd494f8ff None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:30.070643 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daa55a-6423-45b9-a62c-07ccd494f8ff None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:30.105940 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec93ba-6678-43f8-aab7-e1a69746333c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:30.106556 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec93ba-6678-43f8-aab7-e1a69746333c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:30.106835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec93ba-6678-43f8-aab7-e1a69746333c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:30.107104 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec93ba-6678-43f8-aab7-e1a69746333c None admin] PATH_INFO: `/v3/users/bfae8564c6974039a0c7fe32bc54bc34` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:30.108249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec93ba-6678-43f8-aab7-e1a69746333c None admin] RBAC: Authorizing `identity:get_user(user_id=bfae8564c6974039a0c7fe32bc54bc34)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:30.109702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec93ba-6678-43f8-aab7-e1a69746333c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:30.111258 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 593/1151] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:59:29 2022] GET /identity/v3/users/bfae8564c6974039a0c7fe32bc54bc34 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:30.116876 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b0057-961c-4180-83c3-4ba4cccc17f3 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:30.216753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b0057-961c-4180-83c3-4ba4cccc17f3 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:30.225231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:30.252555 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4417a7-f112-41ea-9679-a5c02bb1ba6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:30.253186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4417a7-f112-41ea-9679-a5c02bb1ba6a None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:30.253471 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4417a7-f112-41ea-9679-a5c02bb1ba6a None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:30.253749 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4417a7-f112-41ea-9679-a5c02bb1ba6a None admin] PATH_INFO: `/v3/projects/e4c42bc793324cd6ac791a85111186d2` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:30.254897 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4417a7-f112-41ea-9679-a5c02bb1ba6a None admin] RBAC: Authorizing `identity:get_project(project_id=e4c42bc793324cd6ac791a85111186d2)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:30.256322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4417a7-f112-41ea-9679-a5c02bb1ba6a None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:30.258266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 559/1152] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:59:30 2022] GET /identity/v3/projects/e4c42bc793324cd6ac791a85111186d2 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:30.264392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec93ba-6678-43f8-aab7-e1a69746333c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:30.267253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:30.363771 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec93ba-6678-43f8-aab7-e1a69746333c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:30.396201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2e5f1-0b35-4ff5-8280-b958e7e3a85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:30.396875 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2e5f1-0b35-4ff5-8280-b958e7e3a85e None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:30.397153 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2e5f1-0b35-4ff5-8280-b958e7e3a85e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:30.397421 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2e5f1-0b35-4ff5-8280-b958e7e3a85e None admin] PATH_INFO: `/v3/projects/e4c42bc793324cd6ac791a85111186d2/users/bfae8564c6974039a0c7fe32bc54bc34/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:30.399326 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2e5f1-0b35-4ff5-8280-b958e7e3a85e None admin] RBAC: Authorizing `identity:create_grant(project_id=e4c42bc793324cd6ac791a85111186d2, user_id=bfae8564c6974039a0c7fe32bc54bc34, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:30.401275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2e5f1-0b35-4ff5-8280-b958e7e3a85e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:30.413846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 594/1153] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:59:30 2022] PUT /identity/v3/projects/e4c42bc793324cd6ac791a85111186d2/users/bfae8564c6974039a0c7fe32bc54bc34/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:59:32.382919 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d61cc9-ee7d-4b0f-b045-43842f6230ae None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:32.383452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d61cc9-ee7d-4b0f-b045-43842f6230ae None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:32.383452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d61cc9-ee7d-4b0f-b045-43842f6230ae None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:32.384845 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 560/1154] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:59:32.390113 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b14c2-bfc1-404e-8cdd-f53f392452c2 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:32.390521 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b14c2-bfc1-404e-8cdd-f53f392452c2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:32.390670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b14c2-bfc1-404e-8cdd-f53f392452c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:32.408484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-339b14c2-bfc1-404e-8cdd-f53f392452c2 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:32.409684 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-339b14c2-bfc1-404e-8cdd-f53f392452c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:32.465849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:32.477250 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 595/1155] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:59:32.500838 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d61cc9-ee7d-4b0f-b045-43842f6230ae None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:32.601642 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d61cc9-ee7d-4b0f-b045-43842f6230ae None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:32.635092 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df6728-6fcc-4a75-b59f-055229c4b41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:32.635818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df6728-6fcc-4a75-b59f-055229c4b41f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:32.636121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df6728-6fcc-4a75-b59f-055229c4b41f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:32.636407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df6728-6fcc-4a75-b59f-055229c4b41f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:32.646354 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df6728-6fcc-4a75-b59f-055229c4b41f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:59:32.651830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-82df6728-6fcc-4a75-b59f-055229c4b41f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:59:32.651830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:32.651830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:32.651830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:32.651830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:32.651830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:32.651830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:32.651830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:32.651830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:32.651830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:32.651830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:32.651830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:32.651830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:59:32.651830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:59:32.651830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:59:32.651830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:59:32.652931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:59:32.652931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:59:32.652931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:59:32.652931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:59:32.652931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:32.652931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:32.652931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:32.652931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:32.652931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:32.652931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:32.652931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:32.652931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:32.652931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:32.652931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:32.652931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:32.652931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:32.654118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:32.654118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:32.654118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:32.654118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:32.654118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:59:32.654118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:59:32.654118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:59:32.654118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:59:32.654118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:59:32.654118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:59:32.654118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:59:32.654118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:59:32.654118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 561/1156] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:59:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:59:32.659062 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b14c2-bfc1-404e-8cdd-f53f392452c2 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:32.756897 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b14c2-bfc1-404e-8cdd-f53f392452c2 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:32.790898 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90af8ec-907b-44e1-9177-f72449f6d519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:32.792627 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90af8ec-907b-44e1-9177-f72449f6d519 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:32.792914 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90af8ec-907b-44e1-9177-f72449f6d519 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:32.793191 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90af8ec-907b-44e1-9177-f72449f6d519 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:32.793904 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90af8ec-907b-44e1-9177-f72449f6d519 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:32.794234 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90af8ec-907b-44e1-9177-f72449f6d519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:32.795593 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90af8ec-907b-44e1-9177-f72449f6d519 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:32.803400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 596/1157] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:59:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:32.809222 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df6728-6fcc-4a75-b59f-055229c4b41f None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:32.844198 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:32.909880 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df6728-6fcc-4a75-b59f-055229c4b41f None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:32.944570 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d29759-2954-4340-ac0f-deb11597fcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:32.945232 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d29759-2954-4340-ac0f-deb11597fcef None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:32.945518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d29759-2954-4340-ac0f-deb11597fcef None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:32.945798 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d29759-2954-4340-ac0f-deb11597fcef None admin] PATH_INFO: `/v3/users/bfae8564c6974039a0c7fe32bc54bc34` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:32.947335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d29759-2954-4340-ac0f-deb11597fcef None admin] RBAC: Authorizing `identity:get_user(user_id=bfae8564c6974039a0c7fe32bc54bc34)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:32.949490 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d29759-2954-4340-ac0f-deb11597fcef None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:32.951101 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 562/1158] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:59:32 2022] GET /identity/v3/users/bfae8564c6974039a0c7fe32bc54bc34 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:32.956837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90af8ec-907b-44e1-9177-f72449f6d519 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:33.011251 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:33.055111 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90af8ec-907b-44e1-9177-f72449f6d519 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:33.087341 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c72f7c-4650-4bc0-8157-70ac7365f4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:33.087937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c72f7c-4650-4bc0-8157-70ac7365f4cb None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:33.088782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c72f7c-4650-4bc0-8157-70ac7365f4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:33.089056 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c72f7c-4650-4bc0-8157-70ac7365f4cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:33.152934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c72f7c-4650-4bc0-8157-70ac7365f4cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:33.154353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c72f7c-4650-4bc0-8157-70ac7365f4cb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:33.217519 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:33.262530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 597/1159] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:59:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:59:33.268440 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d29759-2954-4340-ac0f-deb11597fcef None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:33.367008 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d29759-2954-4340-ac0f-deb11597fcef None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:33.369809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:33.401670 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7b81d-5733-47a2-bddd-5b41c348c61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:33.402303 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7b81d-5733-47a2-bddd-5b41c348c61b None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:33.402588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7b81d-5733-47a2-bddd-5b41c348c61b None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:33.402866 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7b81d-5733-47a2-bddd-5b41c348c61b None admin] PATH_INFO: `/v3/projects/e4c42bc793324cd6ac791a85111186d2` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:33.404019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7b81d-5733-47a2-bddd-5b41c348c61b None admin] RBAC: Authorizing `identity:get_project(project_id=e4c42bc793324cd6ac791a85111186d2)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:33.405471 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7b81d-5733-47a2-bddd-5b41c348c61b None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:33.407124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 563/1160] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:59:33 2022] GET /identity/v3/projects/e4c42bc793324cd6ac791a85111186d2 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:33.413257 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c72f7c-4650-4bc0-8157-70ac7365f4cb None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:33.514551 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c72f7c-4650-4bc0-8157-70ac7365f4cb None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:33.547526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be993c-1213-418d-b82e-47e4b20cbbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:33.548128 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be993c-1213-418d-b82e-47e4b20cbbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:33.548409 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be993c-1213-418d-b82e-47e4b20cbbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:33.548710 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be993c-1213-418d-b82e-47e4b20cbbd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:33.549496 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be993c-1213-418d-b82e-47e4b20cbbd1 None admin] RBAC: Adding query filter params (role.id=c15ca78eb3c9472f94e15e2d28c7f403, scope.project.id=e4c42bc793324cd6ac791a85111186d2, user.id=bfae8564c6974039a0c7fe32bc54bc34) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:33.549808 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be993c-1213-418d-b82e-47e4b20cbbd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:33.551225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be993c-1213-418d-b82e-47e4b20cbbd1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:33.557442 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 598/1161] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:59:33 2022] GET /identity/v3/role_assignments?user.id=bfae8564c6974039a0c7fe32bc54bc34&scope.project.id=e4c42bc793324cd6ac791a85111186d2&role.id=c15ca78eb3c9472f94e15e2d28c7f403 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:35.628054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee68bf5-440f-41a7-9671-8ba9052bf4ed None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:35.628588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee68bf5-440f-41a7-9671-8ba9052bf4ed None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:35.628588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee68bf5-440f-41a7-9671-8ba9052bf4ed None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:35.629908 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 564/1162] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:59:35.637400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e70749-2945-49b5-a568-ecc2d70439f3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:35.637873 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e70749-2945-49b5-a568-ecc2d70439f3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:35.637976 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e70749-2945-49b5-a568-ecc2d70439f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:35.656384 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f5e70749-2945-49b5-a568-ecc2d70439f3 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:35.657599 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f5e70749-2945-49b5-a568-ecc2d70439f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:35.671750 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:35.728998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 599/1163] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:59:35.753380 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee68bf5-440f-41a7-9671-8ba9052bf4ed None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:35.875879 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee68bf5-440f-41a7-9671-8ba9052bf4ed None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:35.912529 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f24339-e90b-4c2e-87bc-2a9c40a52e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:35.913085 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f24339-e90b-4c2e-87bc-2a9c40a52e82 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:35.913370 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f24339-e90b-4c2e-87bc-2a9c40a52e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:35.913644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f24339-e90b-4c2e-87bc-2a9c40a52e82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:35.961302 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:35.992031 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f24339-e90b-4c2e-87bc-2a9c40a52e82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:35.993524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f24339-e90b-4c2e-87bc-2a9c40a52e82 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:36.101608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 565/1164] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:59:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:59:36.108112 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e70749-2945-49b5-a568-ecc2d70439f3 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:36.228070 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e70749-2945-49b5-a568-ecc2d70439f3 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:36.268189 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35efee23-80e3-4b5f-b66d-ee7991c02f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:36.268903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efee23-80e3-4b5f-b66d-ee7991c02f31 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:36.269182 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efee23-80e3-4b5f-b66d-ee7991c02f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:36.269454 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35efee23-80e3-4b5f-b66d-ee7991c02f31 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:36.277678 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efee23-80e3-4b5f-b66d-ee7991c02f31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:36.279482 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35efee23-80e3-4b5f-b66d-ee7991c02f31 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:36.293997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-35efee23-80e3-4b5f-b66d-ee7991c02f31 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 02 09:59:36.293997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:36.293997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 02 09:59:36.293997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 02 09:59:36.293997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 09:59:36.293997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 09:59:36.293997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 09:59:36.293997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 09:59:36.293997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 02 09:59:36.293997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:59:36.293997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 09:59:36.293997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:59:36.293997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:36.293997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:36.293997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:36.293997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:36.293997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:36.295334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:36.295334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:36.295334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:36.295334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:36.295334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:36.295334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:36.295334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 09:59:36.295334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 09:59:36.295334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 09:59:36.295334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 09:59:36.295334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:36.295334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:36.295334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:36.295334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:36.295334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:36.295334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:36.296373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:36.296373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:36.296373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:36.296373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:36.296373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:36.296373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:36.296373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:36.296373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:36.296373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:36.296373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:36.296373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 02 09:59:36.296373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 09:59:36.296373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 02 09:59:36.296373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:59:36.296373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 600/1165] 10.222.0.85 () {56 vars in 1117 bytes} [Tue Aug 2 09:59:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:59:36.300010 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f24339-e90b-4c2e-87bc-2a9c40a52e82 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:36.378974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:36.411333 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f24339-e90b-4c2e-87bc-2a9c40a52e82 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:36.453380 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be37f966-b6e8-4810-9137-072539ad6c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:36.454459 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37f966-b6e8-4810-9137-072539ad6c01 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:36.454932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37f966-b6e8-4810-9137-072539ad6c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:36.455215 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be37f966-b6e8-4810-9137-072539ad6c01 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:36.456350 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37f966-b6e8-4810-9137-072539ad6c01 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:36.456836 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37f966-b6e8-4810-9137-072539ad6c01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:36.458769 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be37f966-b6e8-4810-9137-072539ad6c01 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:36.469188 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 566/1166] 10.222.0.85 () {56 vars in 1115 bytes} [Tue Aug 2 09:59:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:38.603172 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9f0c2-6364-4ed4-bd73-ec7664eb3456 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:38.603715 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9f0c2-6364-4ed4-bd73-ec7664eb3456 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:38.603715 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9f0c2-6364-4ed4-bd73-ec7664eb3456 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:38.605742 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 601/1167] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:59:38.611001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dc6e4-44f3-4861-8406-b9df95b84b0f None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:38.611441 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dc6e4-44f3-4861-8406-b9df95b84b0f None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:38.611559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dc6e4-44f3-4861-8406-b9df95b84b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:38.629480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-e60dc6e4-44f3-4861-8406-b9df95b84b0f None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:38.630661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e60dc6e4-44f3-4861-8406-b9df95b84b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:38.697236 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 567/1168] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:59:38.725080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9f0c2-6364-4ed4-bd73-ec7664eb3456 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:38.739516 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:38.845238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9f0c2-6364-4ed4-bd73-ec7664eb3456 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:38.879230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93650ef2-af4e-40a8-bcae-98d2001d1b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:38.879756 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93650ef2-af4e-40a8-bcae-98d2001d1b86 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:38.880043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93650ef2-af4e-40a8-bcae-98d2001d1b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:38.880316 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93650ef2-af4e-40a8-bcae-98d2001d1b86 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:38.881056 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93650ef2-af4e-40a8-bcae-98d2001d1b86 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:38.882414 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93650ef2-af4e-40a8-bcae-98d2001d1b86 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:38.898564 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 602/1169] 10.222.0.85 () {60 vars in 1138 bytes} [Tue Aug 2 09:59:38 2022] POST /identity/v3/domains => generated 267 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:59:41.894410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc319a29-ad6a-4931-a11b-9d77071a800e None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:41.894959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc319a29-ad6a-4931-a11b-9d77071a800e None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:41.895465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc319a29-ad6a-4931-a11b-9d77071a800e None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:41.897459 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 568/1170] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:59:41.904426 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f506233-5dbd-43e1-9909-390d567ce068 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:41.904854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f506233-5dbd-43e1-9909-390d567ce068 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:41.905006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f506233-5dbd-43e1-9909-390d567ce068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:41.936482 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6f506233-5dbd-43e1-9909-390d567ce068 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:41.938212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6f506233-5dbd-43e1-9909-390d567ce068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:42.015831 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:42.023059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 603/1171] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:59:42.050754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc319a29-ad6a-4931-a11b-9d77071a800e None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:42.117398 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:42.154648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc319a29-ad6a-4931-a11b-9d77071a800e None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:42.195697 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f571d-bd02-49a8-bb4f-04d9dd50b729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:42.196333 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f571d-bd02-49a8-bb4f-04d9dd50b729 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:42.196645 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f571d-bd02-49a8-bb4f-04d9dd50b729 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:42.196920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f571d-bd02-49a8-bb4f-04d9dd50b729 None admin] PATH_INFO: `/v3/domains/fbf37b576c334324897f2055731ff762` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:42.207676 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f571d-bd02-49a8-bb4f-04d9dd50b729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fbf37b576c334324897f2055731ff762)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:42.209153 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f571d-bd02-49a8-bb4f-04d9dd50b729 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:42.210763 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 569/1172] 10.222.0.85 () {56 vars in 1183 bytes} [Tue Aug 2 09:59:42 2022] GET /identity/v3/domains/fbf37b576c334324897f2055731ff762 => generated 267 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:42.218043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f506233-5dbd-43e1-9909-390d567ce068 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:42.345004 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f506233-5dbd-43e1-9909-390d567ce068 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:42.394263 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e38423-c20c-4ab5-b5a5-0f6ef39e4526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:42.394873 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e38423-c20c-4ab5-b5a5-0f6ef39e4526 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:42.396080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e38423-c20c-4ab5-b5a5-0f6ef39e4526 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:42.396356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e38423-c20c-4ab5-b5a5-0f6ef39e4526 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:42.397066 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e38423-c20c-4ab5-b5a5-0f6ef39e4526 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:42.398485 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e38423-c20c-4ab5-b5a5-0f6ef39e4526 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:42.427922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 604/1173] 10.222.0.85 () {60 vars in 1141 bytes} [Tue Aug 2 09:59:42 2022] POST /identity/v3/projects => generated 361 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 09:59:44.799958 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc22e9-fb17-42a1-9990-c20c6b3147ba None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:44.800553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc22e9-fb17-42a1-9990-c20c6b3147ba None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:44.800553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc22e9-fb17-42a1-9990-c20c6b3147ba None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:44.801906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 570/1174] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:59:44.806957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec075e3-8b62-46ce-953f-ab8924071a17 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:44.807387 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec075e3-8b62-46ce-953f-ab8924071a17 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:44.807567 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec075e3-8b62-46ce-953f-ab8924071a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:44.825357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2ec075e3-8b62-46ce-953f-ab8924071a17 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:44.826555 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2ec075e3-8b62-46ce-953f-ab8924071a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:44.872985 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:44.895442 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 605/1175] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:59:44.920367 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc22e9-fb17-42a1-9990-c20c6b3147ba None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:45.018851 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc22e9-fb17-42a1-9990-c20c6b3147ba None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:45.045487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:45.054627 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fa548-0339-4aae-9f5f-f7fe4f9b3a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:45.055202 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fa548-0339-4aae-9f5f-f7fe4f9b3a4f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:45.055481 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fa548-0339-4aae-9f5f-f7fe4f9b3a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:45.055760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fa548-0339-4aae-9f5f-f7fe4f9b3a4f None admin] PATH_INFO: `/v3/domains/fbf37b576c334324897f2055731ff762` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:45.056928 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fa548-0339-4aae-9f5f-f7fe4f9b3a4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=fbf37b576c334324897f2055731ff762)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:45.058613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fa548-0339-4aae-9f5f-f7fe4f9b3a4f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:45.060193 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 571/1176] 10.222.0.85 () {56 vars in 1183 bytes} [Tue Aug 2 09:59:44 2022] GET /identity/v3/domains/fbf37b576c334324897f2055731ff762 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:45.066009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec075e3-8b62-46ce-953f-ab8924071a17 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:45.167777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec075e3-8b62-46ce-953f-ab8924071a17 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:45.204347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc47ba7-433a-45cc-8064-b506b24368e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:45.204983 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47ba7-433a-45cc-8064-b506b24368e8 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:45.205264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47ba7-433a-45cc-8064-b506b24368e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:45.205537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47ba7-433a-45cc-8064-b506b24368e8 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:45.206229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc47ba7-433a-45cc-8064-b506b24368e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:45.207656 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc47ba7-433a-45cc-8064-b506b24368e8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:45.229101 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 606/1177] 10.222.0.85 () {60 vars in 1132 bytes} [Tue Aug 2 09:59:45 2022] POST /identity/v3/users => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 09:59:47.289324 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67e663-6dbc-4064-86c9-67b7849037d6 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:47.289894 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67e663-6dbc-4064-86c9-67b7849037d6 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:47.289894 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67e663-6dbc-4064-86c9-67b7849037d6 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:47.291262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 572/1178] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:59:47.297470 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859aaf2f-125a-4baa-9302-3a20f6f03afb None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:47.297877 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859aaf2f-125a-4baa-9302-3a20f6f03afb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:47.298048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859aaf2f-125a-4baa-9302-3a20f6f03afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:47.317295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-859aaf2f-125a-4baa-9302-3a20f6f03afb None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:47.318491 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-859aaf2f-125a-4baa-9302-3a20f6f03afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:47.354639 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:47.405380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 607/1179] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:59:47.432917 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67e663-6dbc-4064-86c9-67b7849037d6 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:47.565552 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67e663-6dbc-4064-86c9-67b7849037d6 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:47.612033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9e1d3-7b24-488b-ac68-13bc7255ebd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:47.612691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9e1d3-7b24-488b-ac68-13bc7255ebd2 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:47.612977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9e1d3-7b24-488b-ac68-13bc7255ebd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:47.613255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9e1d3-7b24-488b-ac68-13bc7255ebd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:47.625748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9e1d3-7b24-488b-ac68-13bc7255ebd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:59:47.630681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-f2a9e1d3-7b24-488b-ac68-13bc7255ebd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:59:47.630681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:47.630681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:47.630681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:47.630681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:47.630681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:47.630681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:47.630681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:47.630681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:47.630681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:47.630681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:47.630681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:47.630681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:59:47.630681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:59:47.630681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:59:47.630681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:59:47.631857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:59:47.631857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:59:47.631857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:59:47.631857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:59:47.631857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:47.631857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:47.631857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:47.631857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:47.631857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:47.631857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:47.631857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:47.631857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:47.631857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:47.631857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:47.631857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:47.631857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:47.632825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:47.632825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:47.632825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:47.632825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:47.632825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:59:47.632825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:59:47.632825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:59:47.632825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:59:47.632825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:59:47.632825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:59:47.632825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:59:47.632825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:59:47.632825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 573/1180] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:59:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:59:47.639345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859aaf2f-125a-4baa-9302-3a20f6f03afb None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:47.769721 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859aaf2f-125a-4baa-9302-3a20f6f03afb None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:47.815744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d880fe-d7d4-43b3-b396-c134094c9070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:47.816338 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d880fe-d7d4-43b3-b396-c134094c9070 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:47.816659 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d880fe-d7d4-43b3-b396-c134094c9070 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:47.816939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d880fe-d7d4-43b3-b396-c134094c9070 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:47.817684 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d880fe-d7d4-43b3-b396-c134094c9070 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:47.817995 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d880fe-d7d4-43b3-b396-c134094c9070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:47.819426 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d880fe-d7d4-43b3-b396-c134094c9070 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:47.828830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 608/1181] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:59:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 09:59:47.834861 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9e1d3-7b24-488b-ac68-13bc7255ebd2 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:47.906236 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:47.968495 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9e1d3-7b24-488b-ac68-13bc7255ebd2 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:48.025107 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad022e6f-1fa1-4bdf-98df-6a7d17c6ba2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:48.025785 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad022e6f-1fa1-4bdf-98df-6a7d17c6ba2f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:48.026842 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad022e6f-1fa1-4bdf-98df-6a7d17c6ba2f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:48.027952 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad022e6f-1fa1-4bdf-98df-6a7d17c6ba2f None admin] PATH_INFO: `/v3/users/1ead9f6389504c31ad7a220de8782222` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:48.043824 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad022e6f-1fa1-4bdf-98df-6a7d17c6ba2f None admin] RBAC: Authorizing `identity:get_user(user_id=1ead9f6389504c31ad7a220de8782222)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:48.045291 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad022e6f-1fa1-4bdf-98df-6a7d17c6ba2f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:48.047006 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 574/1182] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:59:47 2022] GET /identity/v3/users/1ead9f6389504c31ad7a220de8782222 => generated 311 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:48.053213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d880fe-d7d4-43b3-b396-c134094c9070 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:48.086307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:48.198441 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d880fe-d7d4-43b3-b396-c134094c9070 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:48.240258 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f0247-d5fc-435b-a09d-6d039c33f26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:48.240905 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f0247-d5fc-435b-a09d-6d039c33f26b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:48.241187 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f0247-d5fc-435b-a09d-6d039c33f26b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:48.241461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f0247-d5fc-435b-a09d-6d039c33f26b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:48.320624 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f0247-d5fc-435b-a09d-6d039c33f26b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:48.322097 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f0247-d5fc-435b-a09d-6d039c33f26b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:48.348757 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:48.419191 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 609/1183] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:59:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 09:59:48.425106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad022e6f-1fa1-4bdf-98df-6a7d17c6ba2f None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:48.524195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad022e6f-1fa1-4bdf-98df-6a7d17c6ba2f None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:48.539769 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:48.563935 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840bf1d-c427-44fe-bd0a-4f7847380f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:48.564619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840bf1d-c427-44fe-bd0a-4f7847380f1f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:48.564902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840bf1d-c427-44fe-bd0a-4f7847380f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:48.565175 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840bf1d-c427-44fe-bd0a-4f7847380f1f None admin] PATH_INFO: `/v3/projects/20cd8d18a42e4ca581fab2395bf51d1e` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:48.566327 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840bf1d-c427-44fe-bd0a-4f7847380f1f None admin] RBAC: Authorizing `identity:get_project(project_id=20cd8d18a42e4ca581fab2395bf51d1e)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:48.567756 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840bf1d-c427-44fe-bd0a-4f7847380f1f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:48.569623 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 575/1184] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:59:48 2022] GET /identity/v3/projects/20cd8d18a42e4ca581fab2395bf51d1e => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:48.576755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f0247-d5fc-435b-a09d-6d039c33f26b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:48.681263 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f0247-d5fc-435b-a09d-6d039c33f26b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:48.709302 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:48.717864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732f9fb-78c1-48ef-93d8-bdededcfc6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:48.718484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732f9fb-78c1-48ef-93d8-bdededcfc6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:48.718761 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732f9fb-78c1-48ef-93d8-bdededcfc6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:48.719031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732f9fb-78c1-48ef-93d8-bdededcfc6a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:48.719821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732f9fb-78c1-48ef-93d8-bdededcfc6a9 None admin] RBAC: Adding query filter params (role.id=c15ca78eb3c9472f94e15e2d28c7f403, scope.project.id=20cd8d18a42e4ca581fab2395bf51d1e, user.id=1ead9f6389504c31ad7a220de8782222) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:48.720127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732f9fb-78c1-48ef-93d8-bdededcfc6a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:48.721738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9732f9fb-78c1-48ef-93d8-bdededcfc6a9 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:48.727558 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 610/1185] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:59:48 2022] GET /identity/v3/role_assignments?user.id=1ead9f6389504c31ad7a220de8782222&scope.project.id=20cd8d18a42e4ca581fab2395bf51d1e&role.id=c15ca78eb3c9472f94e15e2d28c7f403 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:50.950762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3c74c-40b6-4970-a57f-ec7a841510d2 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:50.951304 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3c74c-40b6-4970-a57f-ec7a841510d2 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:50.951424 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e3c74c-40b6-4970-a57f-ec7a841510d2 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:50.952770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 576/1186] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:59:50.958343 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8708b40-8168-4dc2-89b7-03bada623bd9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:50.958839 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8708b40-8168-4dc2-89b7-03bada623bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:50.958935 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8708b40-8168-4dc2-89b7-03bada623bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:50.980268 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f8708b40-8168-4dc2-89b7-03bada623bd9 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:50.983070 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f8708b40-8168-4dc2-89b7-03bada623bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:51.052023 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 611/1187] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:59:51.077265 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3c74c-40b6-4970-a57f-ec7a841510d2 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:51.179953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e3c74c-40b6-4970-a57f-ec7a841510d2 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:51.215601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0cd8b-07c3-445b-877c-8effc7b19231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:51.216170 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0cd8b-07c3-445b-877c-8effc7b19231 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:51.216453 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0cd8b-07c3-445b-877c-8effc7b19231 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:51.216757 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0cd8b-07c3-445b-877c-8effc7b19231 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:51.226787 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0cd8b-07c3-445b-877c-8effc7b19231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:59:51.231989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-9eb0cd8b-07c3-445b-877c-8effc7b19231 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:59:51.231989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:51.231989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:51.231989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:51.231989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:51.231989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:51.231989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:51.231989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:51.231989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:51.231989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:51.231989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:51.231989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:51.231989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:59:51.231989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:59:51.231989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:59:51.231989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:59:51.233130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:59:51.233130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:59:51.233130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:59:51.233130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:59:51.233130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:51.233130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:51.233130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:51.233130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:51.233130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:51.233130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:51.233130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:51.233130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:51.233130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:51.233130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:51.233130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:51.233130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:51.234150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:51.234150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:51.234150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:51.234150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:51.234150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:59:51.234150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:59:51.234150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:59:51.234150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:59:51.234150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:59:51.234150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:59:51.234150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:59:51.234150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 09:59:51.234150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 577/1188] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:59:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:59:51.239360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8708b40-8168-4dc2-89b7-03bada623bd9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:51.339980 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8708b40-8168-4dc2-89b7-03bada623bd9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:51.363561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:51.376903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4a1d7-97a6-40c3-b8d7-5d8c3d7cd2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:51.377537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4a1d7-97a6-40c3-b8d7-5d8c3d7cd2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:51.377823 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4a1d7-97a6-40c3-b8d7-5d8c3d7cd2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:51.378102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4a1d7-97a6-40c3-b8d7-5d8c3d7cd2f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:51.378856 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4a1d7-97a6-40c3-b8d7-5d8c3d7cd2f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:51.379211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4a1d7-97a6-40c3-b8d7-5d8c3d7cd2f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:51.380689 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4a1d7-97a6-40c3-b8d7-5d8c3d7cd2f5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:51.395962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 612/1189] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:59:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:51.402650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0cd8b-07c3-445b-877c-8effc7b19231 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:51.454165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:51.515795 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0cd8b-07c3-445b-877c-8effc7b19231 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:51.550095 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523402a-9007-4bef-a5f8-8e942d99a9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:51.550758 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523402a-9007-4bef-a5f8-8e942d99a9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:51.551056 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523402a-9007-4bef-a5f8-8e942d99a9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:51.551332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b523402a-9007-4bef-a5f8-8e942d99a9b4 None admin] PATH_INFO: `/v3/users/1ead9f6389504c31ad7a220de8782222` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:51.552519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523402a-9007-4bef-a5f8-8e942d99a9b4 None admin] RBAC: Authorizing `identity:get_user(user_id=1ead9f6389504c31ad7a220de8782222)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:51.553962 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b523402a-9007-4bef-a5f8-8e942d99a9b4 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:51.555578 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 578/1190] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:59:51 2022] GET /identity/v3/users/1ead9f6389504c31ad7a220de8782222 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:51.561680 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4a1d7-97a6-40c3-b8d7-5d8c3d7cd2f5 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:51.665232 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4a1d7-97a6-40c3-b8d7-5d8c3d7cd2f5 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:51.699626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914c38d-da3b-43be-806c-3bc930d6583f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:51.700257 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914c38d-da3b-43be-806c-3bc930d6583f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:51.700564 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914c38d-da3b-43be-806c-3bc930d6583f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:51.700841 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914c38d-da3b-43be-806c-3bc930d6583f None admin] PATH_INFO: `/v3/projects/20cd8d18a42e4ca581fab2395bf51d1e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:51.702028 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914c38d-da3b-43be-806c-3bc930d6583f None admin] RBAC: Authorizing `identity:get_project(project_id=20cd8d18a42e4ca581fab2395bf51d1e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:51.703476 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914c38d-da3b-43be-806c-3bc930d6583f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:51.705164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 613/1191] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:59:51 2022] GET /identity/v3/projects/20cd8d18a42e4ca581fab2395bf51d1e => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:51.711191 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523402a-9007-4bef-a5f8-8e942d99a9b4 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:51.811613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b523402a-9007-4bef-a5f8-8e942d99a9b4 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:51.820729 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:51.845885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c105f573-3af0-4bd5-b169-8ff46af80ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:51.846547 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105f573-3af0-4bd5-b169-8ff46af80ca6 None admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:51.846856 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105f573-3af0-4bd5-b169-8ff46af80ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:51.847131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c105f573-3af0-4bd5-b169-8ff46af80ca6 None admin] PATH_INFO: `/v3/projects/20cd8d18a42e4ca581fab2395bf51d1e/users/1ead9f6389504c31ad7a220de8782222/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:51.849119 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105f573-3af0-4bd5-b169-8ff46af80ca6 None admin] RBAC: Authorizing `identity:create_grant(project_id=20cd8d18a42e4ca581fab2395bf51d1e, user_id=1ead9f6389504c31ad7a220de8782222, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:51.850871 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c105f573-3af0-4bd5-b169-8ff46af80ca6 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:51.863462 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 579/1192] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 09:59:51 2022] PUT /identity/v3/projects/20cd8d18a42e4ca581fab2395bf51d1e/users/1ead9f6389504c31ad7a220de8782222/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 09:59:53.913924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e67e93-4448-46bf-af74-4e9732b0fa5a None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:53.914483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e67e93-4448-46bf-af74-4e9732b0fa5a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:53.914483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e67e93-4448-46bf-af74-4e9732b0fa5a None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:53.915863 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 614/1193] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 09:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 09:59:53.922545 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddb5fa-e6bc-4c3b-b9ea-87120451acd6 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:53.922990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddb5fa-e6bc-4c3b-b9ea-87120451acd6 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:53.923093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddb5fa-e6bc-4c3b-b9ea-87120451acd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:53.941859 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-f8ddb5fa-e6bc-4c3b-b9ea-87120451acd6 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 09:59:53.943040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f8ddb5fa-e6bc-4c3b-b9ea-87120451acd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 09:59:54.023489 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 580/1194] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 09:59:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 09:59:54.047515 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e67e93-4448-46bf-af74-4e9732b0fa5a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:54.100640 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:54.150482 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e67e93-4448-46bf-af74-4e9732b0fa5a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:54.183026 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345938c-fc03-48f7-bac1-ed8c66943994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:54.183658 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345938c-fc03-48f7-bac1-ed8c66943994 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:54.183934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345938c-fc03-48f7-bac1-ed8c66943994 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:54.184201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f345938c-fc03-48f7-bac1-ed8c66943994 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:54.193885 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f345938c-fc03-48f7-bac1-ed8c66943994 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 09:59:54.199219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-f345938c-fc03-48f7-bac1-ed8c66943994 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:59:54.199219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 09:59:54.199219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 09:59:54.199219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 09:59:54.199219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 09:59:54.199219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 09:59:54.199219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 09:59:54.199219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 09:59:54.199219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 09:59:54.199219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 09:59:54.199219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 09:59:54.199219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 09:59:54.199219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 09:59:54.199219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 09:59:54.199219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 09:59:54.199219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 09:59:54.200307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 09:59:54.200307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 09:59:54.200307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 09:59:54.200307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 09:59:54.200307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 09:59:54.200307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 09:59:54.200307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 09:59:54.200307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 09:59:54.200307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 09:59:54.200307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 09:59:54.200307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 09:59:54.200307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 09:59:54.200307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 09:59:54.200307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 09:59:54.200307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 09:59:54.200307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 09:59:54.201219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 09:59:54.201219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 09:59:54.201219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 09:59:54.201219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 09:59:54.201219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 09:59:54.201219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 09:59:54.201219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 09:59:54.201219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 09:59:54.201219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 09:59:54.201219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 09:59:54.201219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 09:59:54.201219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 09:59:54.201219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 615/1195] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 09:59:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 09:59:54.206499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddb5fa-e6bc-4c3b-b9ea-87120451acd6 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:54.301660 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:54.305869 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ddb5fa-e6bc-4c3b-b9ea-87120451acd6 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:54.341580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c26b72-dc7d-47a9-81ac-c4184d917c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:54.342182 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c26b72-dc7d-47a9-81ac-c4184d917c67 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:54.342474 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c26b72-dc7d-47a9-81ac-c4184d917c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:54.342738 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c26b72-dc7d-47a9-81ac-c4184d917c67 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:54.343458 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c26b72-dc7d-47a9-81ac-c4184d917c67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:54.343767 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c26b72-dc7d-47a9-81ac-c4184d917c67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:54.345153 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c26b72-dc7d-47a9-81ac-c4184d917c67 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:54.352939 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 581/1196] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 09:59:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:54.359082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345938c-fc03-48f7-bac1-ed8c66943994 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:54.458206 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f345938c-fc03-48f7-bac1-ed8c66943994 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:54.471756 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:54.492346 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5ea1c-d8d8-4370-b667-4aac6443896f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:54.493000 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5ea1c-d8d8-4370-b667-4aac6443896f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:54.493276 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5ea1c-d8d8-4370-b667-4aac6443896f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:54.493545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5ea1c-d8d8-4370-b667-4aac6443896f None admin] PATH_INFO: `/v3/users/1ead9f6389504c31ad7a220de8782222` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:54.494688 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5ea1c-d8d8-4370-b667-4aac6443896f None admin] RBAC: Authorizing `identity:get_user(user_id=1ead9f6389504c31ad7a220de8782222)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:54.496661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5ea1c-d8d8-4370-b667-4aac6443896f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:54.498233 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 616/1197] 10.222.0.85 () {56 vars in 1177 bytes} [Tue Aug 2 09:59:54 2022] GET /identity/v3/users/1ead9f6389504c31ad7a220de8782222 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:54.503935 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c26b72-dc7d-47a9-81ac-c4184d917c67 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:54.601700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c26b72-dc7d-47a9-81ac-c4184d917c67 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:54.634264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6264c31-3929-40f3-be42-1d33d66ab790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:54.634868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6264c31-3929-40f3-be42-1d33d66ab790 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:54.635153 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6264c31-3929-40f3-be42-1d33d66ab790 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:54.635432 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6264c31-3929-40f3-be42-1d33d66ab790 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:54.662561 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:54.702271 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6264c31-3929-40f3-be42-1d33d66ab790 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:54.703709 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6264c31-3929-40f3-be42-1d33d66ab790 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:54.800667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 582/1198] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 09:59:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 09:59:54.806412 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5ea1c-d8d8-4370-b667-4aac6443896f None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:54.907832 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5ea1c-d8d8-4370-b667-4aac6443896f None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:54.941242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaba63d-761a-43a8-8046-3a211e3f7bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:54.941860 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaba63d-761a-43a8-8046-3a211e3f7bfc None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:54.942144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaba63d-761a-43a8-8046-3a211e3f7bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:54.942424 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaba63d-761a-43a8-8046-3a211e3f7bfc None admin] PATH_INFO: `/v3/projects/20cd8d18a42e4ca581fab2395bf51d1e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:54.943603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaba63d-761a-43a8-8046-3a211e3f7bfc None admin] RBAC: Authorizing `identity:get_project(project_id=20cd8d18a42e4ca581fab2395bf51d1e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:54.945071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaba63d-761a-43a8-8046-3a211e3f7bfc None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:54.946733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 617/1199] 10.222.0.85 () {56 vars in 1186 bytes} [Tue Aug 2 09:59:54 2022] GET /identity/v3/projects/20cd8d18a42e4ca581fab2395bf51d1e => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 09:59:54.952961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6264c31-3929-40f3-be42-1d33d66ab790 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 09:59:55.010024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:59:55.050497 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6264c31-3929-40f3-be42-1d33d66ab790 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 09:59:55.083051 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7523700-44db-4be7-b279-160573e39199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 09:59:55.083593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7523700-44db-4be7-b279-160573e39199 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 09:59:55.083878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7523700-44db-4be7-b279-160573e39199 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 09:59:55.084154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7523700-44db-4be7-b279-160573e39199 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 09:59:55.084988 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7523700-44db-4be7-b279-160573e39199 None admin] RBAC: Adding query filter params (role.id=c15ca78eb3c9472f94e15e2d28c7f403, scope.project.id=20cd8d18a42e4ca581fab2395bf51d1e, user.id=1ead9f6389504c31ad7a220de8782222) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 09:59:55.085298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7523700-44db-4be7-b279-160573e39199 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 09:59:55.086733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7523700-44db-4be7-b279-160573e39199 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 09:59:55.093112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 583/1200] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 09:59:54 2022] GET /identity/v3/role_assignments?user.id=1ead9f6389504c31ad7a220de8782222&scope.project.id=20cd8d18a42e4ca581fab2395bf51d1e&role.id=c15ca78eb3c9472f94e15e2d28c7f403 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:00:04.937115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=76 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:00:05.090492 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=38 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:00:51.113792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ce8c6-e355-4ed5-b998-f907b9f86b82 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:51.113792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ce8c6-e355-4ed5-b998-f907b9f86b82 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:51.113792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ce8c6-e355-4ed5-b998-f907b9f86b82 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:51.113792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 618/1201] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:00:51.123401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef789fd-55a5-400e-9212-b105e19226d1 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:51.123401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef789fd-55a5-400e-9212-b105e19226d1 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:51.123401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef789fd-55a5-400e-9212-b105e19226d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:51.143377 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-7ef789fd-55a5-400e-9212-b105e19226d1 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:00:51.144732 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7ef789fd-55a5-400e-9212-b105e19226d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:00:51.235444 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 584/1202] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:00:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 10:00:51.269127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ce8c6-e355-4ed5-b998-f907b9f86b82 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:00:51.398969 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ce8c6-e355-4ed5-b998-f907b9f86b82 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:00:51.438275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c67d1-d5f8-48bf-a505-7fd3c1b06311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:00:51.438954 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c67d1-d5f8-48bf-a505-7fd3c1b06311 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:51.439837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c67d1-d5f8-48bf-a505-7fd3c1b06311 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:51.440166 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c67d1-d5f8-48bf-a505-7fd3c1b06311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:51.456020 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c67d1-d5f8-48bf-a505-7fd3c1b06311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:00:51.457974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c67d1-d5f8-48bf-a505-7fd3c1b06311 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:00:51.475752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-632c67d1-d5f8-48bf-a505-7fd3c1b06311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:00:51.475752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:00:51.475752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:00:51.475752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:00:51.475752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:00:51.475752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:00:51.475752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:00:51.475752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:00:51.475752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:00:51.475752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:00:51.475752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:00:51.475752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:00:51.475752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 10:00:51.475752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 10:00:51.475752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 10:00:51.477071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 10:00:51.477071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:00:51.477071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:00:51.477071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:00:51.477071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:00:51.477071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:00:51.477071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:00:51.477071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:00:51.477071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 10:00:51.477071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:00:51.477071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:00:51.477071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:00:51.477071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:00:51.477071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:00:51.477071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:00:51.477071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:00:51.477071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:00:51.478037 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 10:00:51.478037 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 10:00:51.478037 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:00:51.478037 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 10:00:51.478037 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 619/1203] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 10:00:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:00:51.484330 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef789fd-55a5-400e-9212-b105e19226d1 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:00:51.622498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef789fd-55a5-400e-9212-b105e19226d1 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:00:51.668073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:00:51.677220 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7568a-94a7-4c95-b614-e42ae8d513de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:00:51.677869 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7568a-94a7-4c95-b614-e42ae8d513de None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:51.678151 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7568a-94a7-4c95-b614-e42ae8d513de None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:51.678428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7568a-94a7-4c95-b614-e42ae8d513de None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:51.679164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7568a-94a7-4c95-b614-e42ae8d513de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:00:51.679500 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7568a-94a7-4c95-b614-e42ae8d513de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:00:51.682613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e7568a-94a7-4c95-b614-e42ae8d513de None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:00:51.698671 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 585/1204] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 10:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:00:51.706337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c67d1-d5f8-48bf-a505-7fd3c1b06311 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:00:51.778516 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:00:51.841548 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c67d1-d5f8-48bf-a505-7fd3c1b06311 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:00:51.888164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e28d6-dfaf-4b0e-b322-b5bcb6e6f633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:00:51.888908 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e28d6-dfaf-4b0e-b322-b5bcb6e6f633 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:51.889484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e28d6-dfaf-4b0e-b322-b5bcb6e6f633 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:51.889904 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e28d6-dfaf-4b0e-b322-b5bcb6e6f633 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:51.890857 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e28d6-dfaf-4b0e-b322-b5bcb6e6f633 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:00:51.892935 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111e28d6-dfaf-4b0e-b322-b5bcb6e6f633 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:00:51.924900 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 620/1205] 10.222.0.85 () {60 vars in 1132 bytes} [Tue Aug 2 10:00:51 2022] POST /identity/v3/users => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:00:54.389235 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01524b-0a17-4032-a87a-fff8b206817b None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:54.390056 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01524b-0a17-4032-a87a-fff8b206817b None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:54.390056 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01524b-0a17-4032-a87a-fff8b206817b None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:54.391709 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 586/1206] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:00:54.397595 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14de61-a20c-4af3-abdb-9407fefbba59 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:54.398036 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14de61-a20c-4af3-abdb-9407fefbba59 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:54.398140 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14de61-a20c-4af3-abdb-9407fefbba59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:54.418293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ce14de61-a20c-4af3-abdb-9407fefbba59 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:00:54.419713 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ce14de61-a20c-4af3-abdb-9407fefbba59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:00:54.500636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 621/1207] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:00:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 10:00:54.527567 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01524b-0a17-4032-a87a-fff8b206817b None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:00:54.661963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01524b-0a17-4032-a87a-fff8b206817b None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:00:54.710183 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4b89b-ecd1-4397-b6ca-061e970bf428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:00:54.710840 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4b89b-ecd1-4397-b6ca-061e970bf428 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:54.711116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4b89b-ecd1-4397-b6ca-061e970bf428 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:54.711390 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa4b89b-ecd1-4397-b6ca-061e970bf428 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:54.725001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa4b89b-ecd1-4397-b6ca-061e970bf428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 10:00:54.730267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-8aa4b89b-ecd1-4397-b6ca-061e970bf428 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 10:00:54.730267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:00:54.730267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:00:54.730267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:00:54.730267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:00:54.730267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:00:54.730267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:00:54.730267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:00:54.730267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:00:54.730267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:00:54.730267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:00:54.730267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:00:54.730267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 10:00:54.730267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 10:00:54.730267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 10:00:54.730267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 10:00:54.731266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 10:00:54.731266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 10:00:54.731266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 10:00:54.731266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 10:00:54.731266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:00:54.731266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:00:54.731266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:00:54.731266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:00:54.731266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:00:54.731266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:00:54.731266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:00:54.731266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 10:00:54.731266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:00:54.731266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:00:54.731266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:00:54.731266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:00:54.732197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:00:54.732197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:00:54.732197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:00:54.732197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:00:54.732197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 10:00:54.732197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 10:00:54.732197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 10:00:54.732197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 10:00:54.732197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 10:00:54.732197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 10:00:54.732197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 10:00:54.732197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:00:54.736828 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 587/1208] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 10:00:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:00:54.738894 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14de61-a20c-4af3-abdb-9407fefbba59 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:00:54.788005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:00:54.871104 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14de61-a20c-4af3-abdb-9407fefbba59 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:00:54.920565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d916bb-d7ca-4a6d-a5c6-e8ceeccd44df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:00:54.921160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d916bb-d7ca-4a6d-a5c6-e8ceeccd44df None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:54.921481 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d916bb-d7ca-4a6d-a5c6-e8ceeccd44df None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:54.921825 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d916bb-d7ca-4a6d-a5c6-e8ceeccd44df None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:54.922677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d916bb-d7ca-4a6d-a5c6-e8ceeccd44df None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:00:54.923162 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d916bb-d7ca-4a6d-a5c6-e8ceeccd44df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:00:54.925495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d916bb-d7ca-4a6d-a5c6-e8ceeccd44df None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:00:54.935257 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 622/1209] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 10:00:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:00:54.942252 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4b89b-ecd1-4397-b6ca-061e970bf428 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:00:55.004878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:00:55.074526 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa4b89b-ecd1-4397-b6ca-061e970bf428 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:00:55.123573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909f57e-0b65-46ae-bf7e-58b14bb4d3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:00:55.124254 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909f57e-0b65-46ae-bf7e-58b14bb4d3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:55.126606 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909f57e-0b65-46ae-bf7e-58b14bb4d3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:55.126606 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909f57e-0b65-46ae-bf7e-58b14bb4d3e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:55.139133 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909f57e-0b65-46ae-bf7e-58b14bb4d3e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:00:55.141038 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909f57e-0b65-46ae-bf7e-58b14bb4d3e3 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:00:55.160035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-c909f57e-0b65-46ae-bf7e-58b14bb4d3e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:00:55.160035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:00:55.160035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:00:55.160035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:00:55.160035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:00:55.160035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:00:55.160035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:00:55.160035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:00:55.160035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:00:55.160035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:00:55.160035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:00:55.160035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:00:55.160035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 10:00:55.160035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 10:00:55.160035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 10:00:55.161195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 10:00:55.161195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:00:55.161195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:00:55.161195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:00:55.161195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:00:55.161195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:00:55.161195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:00:55.161195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:00:55.161195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 10:00:55.161195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:00:55.161195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:00:55.161195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:00:55.161195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:00:55.161195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:00:55.161195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:00:55.161195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:00:55.161195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:00:55.162444 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 10:00:55.162444 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 10:00:55.162444 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:00:55.162444 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:00:55.162444 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 588/1210] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 10:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 10:00:55.167797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d916bb-d7ca-4a6d-a5c6-e8ceeccd44df None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:00:55.291262 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:00:55.295473 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d916bb-d7ca-4a6d-a5c6-e8ceeccd44df None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:00:55.338672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d147fb-592e-4a9b-9258-389b5d1530ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:00:55.339252 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d147fb-592e-4a9b-9258-389b5d1530ec None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:55.339599 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d147fb-592e-4a9b-9258-389b5d1530ec None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:55.339887 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d147fb-592e-4a9b-9258-389b5d1530ec None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:55.340664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d147fb-592e-4a9b-9258-389b5d1530ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:00:55.341002 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d147fb-592e-4a9b-9258-389b5d1530ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:00:55.342669 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d147fb-592e-4a9b-9258-389b5d1530ec None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:00:55.361999 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 623/1211] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 10:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:00:55.363133 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909f57e-0b65-46ae-bf7e-58b14bb4d3e3 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:00:55.493381 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909f57e-0b65-46ae-bf7e-58b14bb4d3e3 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:00:55.501098 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:00:55.532290 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c3831-7f6d-4856-a82f-bb59b9d7e754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:00:55.533590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c3831-7f6d-4856-a82f-bb59b9d7e754 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:55.534235 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c3831-7f6d-4856-a82f-bb59b9d7e754 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:55.534431 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c3831-7f6d-4856-a82f-bb59b9d7e754 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:55.543527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c3831-7f6d-4856-a82f-bb59b9d7e754 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:00:55.545444 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c3831-7f6d-4856-a82f-bb59b9d7e754 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:00:55.559557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-995c3831-7f6d-4856-a82f-bb59b9d7e754 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 10:00:55.559557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:00:55.559557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:00:55.559557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:00:55.559557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:00:55.559557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:00:55.559557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:00:55.559557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:00:55.559557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:00:55.559557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:00:55.559557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:00:55.559557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:00:55.559557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 10:00:55.559557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 10:00:55.559557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 10:00:55.559557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 10:00:55.560630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:00:55.560630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:00:55.560630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 10:00:55.560630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 10:00:55.560630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 10:00:55.560630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 10:00:55.560630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:00:55.560630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:00:55.560630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:00:55.560630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:00:55.560630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:00:55.560630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 10:00:55.560630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:00:55.560630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:00:55.560630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:00:55.560630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:00:55.560630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:00:55.560630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:00:55.561602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:00:55.561602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:00:55.561602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 10:00:55.561602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 10:00:55.561602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 10:00:55.561602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 10:00:55.561602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 10:00:55.561602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 10:00:55.561602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 10:00:55.561602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:00:55.561602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 589/1212] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 10:00:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:00:55.568050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d147fb-592e-4a9b-9258-389b5d1530ec None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:00:55.688987 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d147fb-592e-4a9b-9258-389b5d1530ec None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:00:55.728791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482d0af-c65c-46df-a79b-886afdceed51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:00:55.729685 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482d0af-c65c-46df-a79b-886afdceed51 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:55.730179 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482d0af-c65c-46df-a79b-886afdceed51 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:55.730442 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482d0af-c65c-46df-a79b-886afdceed51 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:55.731341 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482d0af-c65c-46df-a79b-886afdceed51 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:00:55.731676 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482d0af-c65c-46df-a79b-886afdceed51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:00:55.733349 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c482d0af-c65c-46df-a79b-886afdceed51 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:00:55.755050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 624/1213] 10.222.0.85 () {56 vars in 1143 bytes} [Tue Aug 2 10:00:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:00:55.760909 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c3831-7f6d-4856-a82f-bb59b9d7e754 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:00:55.885352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c3831-7f6d-4856-a82f-bb59b9d7e754 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:00:55.926678 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d88a8a-0ad6-4dc8-91b6-586a5bec419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:00:55.927329 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d88a8a-0ad6-4dc8-91b6-586a5bec419f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:55.927644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d88a8a-0ad6-4dc8-91b6-586a5bec419f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:55.927941 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d88a8a-0ad6-4dc8-91b6-586a5bec419f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:55.961884 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:00:56.012506 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d88a8a-0ad6-4dc8-91b6-586a5bec419f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:00:56.013982 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d88a8a-0ad6-4dc8-91b6-586a5bec419f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:00:56.133647 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 590/1214] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 10:00:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 10:00:56.139873 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482d0af-c65c-46df-a79b-886afdceed51 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:00:56.161324 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:00:56.262134 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482d0af-c65c-46df-a79b-886afdceed51 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:00:56.305913 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5aff65-cb92-4d60-b1eb-fb5c4c1f27b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:00:56.305913 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aff65-cb92-4d60-b1eb-fb5c4c1f27b6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:56.305913 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aff65-cb92-4d60-b1eb-fb5c4c1f27b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:56.305913 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5aff65-cb92-4d60-b1eb-fb5c4c1f27b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:56.316943 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5aff65-cb92-4d60-b1eb-fb5c4c1f27b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:00:56.318739 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5aff65-cb92-4d60-b1eb-fb5c4c1f27b6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:00:56.337160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-4f5aff65-cb92-4d60-b1eb-fb5c4c1f27b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:00:56.337160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:00:56.337160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:00:56.337160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:00:56.337160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:00:56.337160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:00:56.337160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:00:56.337160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:00:56.337160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:00:56.337160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:00:56.337160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:00:56.337160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:00:56.337160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 10:00:56.337160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 10:00:56.337160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 10:00:56.338151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 10:00:56.338151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:00:56.338151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:00:56.338151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:00:56.338151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:00:56.338151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:00:56.338151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:00:56.338151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:00:56.338151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 10:00:56.338151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:00:56.338151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:00:56.338151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:00:56.338151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:00:56.338151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:00:56.338151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:00:56.338151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:00:56.338151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:00:56.343652 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 10:00:56.343652 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 10:00:56.343652 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:00:56.343652 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 10:00:56.343652 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 625/1215] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 10:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:00:56.346095 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d88a8a-0ad6-4dc8-91b6-586a5bec419f None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:00:56.423545 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:00:56.467142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d88a8a-0ad6-4dc8-91b6-586a5bec419f None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:00:56.504241 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a1750-c39f-4d87-bb72-271ddb8a8529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:00:56.504933 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a1750-c39f-4d87-bb72-271ddb8a8529 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:56.505164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a1750-c39f-4d87-bb72-271ddb8a8529 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:56.505440 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a1750-c39f-4d87-bb72-271ddb8a8529 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:56.506289 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a1750-c39f-4d87-bb72-271ddb8a8529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:00:56.506588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a1750-c39f-4d87-bb72-271ddb8a8529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:00:56.508225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a1750-c39f-4d87-bb72-271ddb8a8529 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:00:56.522647 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 591/1216] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 10:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:00:56.528842 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5aff65-cb92-4d60-b1eb-fb5c4c1f27b6 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:00:56.609960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:00:56.652273 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5aff65-cb92-4d60-b1eb-fb5c4c1f27b6 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:00:56.694221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93accd8d-d86f-4523-9f18-43e20ae7db21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:00:56.695207 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93accd8d-d86f-4523-9f18-43e20ae7db21 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:56.695842 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93accd8d-d86f-4523-9f18-43e20ae7db21 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:56.696173 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93accd8d-d86f-4523-9f18-43e20ae7db21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:56.704976 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93accd8d-d86f-4523-9f18-43e20ae7db21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:00:56.706585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93accd8d-d86f-4523-9f18-43e20ae7db21 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:00:56.719135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-93accd8d-d86f-4523-9f18-43e20ae7db21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 10:00:56.719135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:00:56.719135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:00:56.719135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:00:56.719135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:00:56.719135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:00:56.719135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:00:56.719135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:00:56.719135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:00:56.719135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:00:56.719135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:00:56.719135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:00:56.719135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 10:00:56.719135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 10:00:56.719135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 10:00:56.720102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 10:00:56.720102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:00:56.720102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:00:56.720102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:00:56.720102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:00:56.720102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:00:56.720102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:00:56.720102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:00:56.720102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 10:00:56.720102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:00:56.720102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:00:56.720102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:00:56.720102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:00:56.720102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:00:56.720102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:00:56.720102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:00:56.720102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:00:56.726317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 10:00:56.726317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 10:00:56.726317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 10:00:56.726317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 10:00:56.726317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 10:00:56.726317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 10:00:56.726317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 10:00:56.726317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 10:00:56.726317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 626/1217] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 10:00:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 10:00:56.726942 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a1750-c39f-4d87-bb72-271ddb8a8529 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:00:56.847742 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a1750-c39f-4d87-bb72-271ddb8a8529 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:00:56.878071 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:00:56.901325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3bd22-5189-4fea-8bd9-2e70f41040dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:00:56.902061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3bd22-5189-4fea-8bd9-2e70f41040dc None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:56.902346 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3bd22-5189-4fea-8bd9-2e70f41040dc None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:56.902755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3bd22-5189-4fea-8bd9-2e70f41040dc None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:56.903959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3bd22-5189-4fea-8bd9-2e70f41040dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:00:56.904403 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3bd22-5189-4fea-8bd9-2e70f41040dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:00:56.905874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3bd22-5189-4fea-8bd9-2e70f41040dc None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:00:56.925567 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 592/1218] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 10:00:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:00:56.932855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93accd8d-d86f-4523-9f18-43e20ae7db21 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:00:57.057232 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93accd8d-d86f-4523-9f18-43e20ae7db21 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:00:57.096580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:00:57.104204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74461ae-f535-46d2-94fb-4e75bc3c421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:00:57.105054 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74461ae-f535-46d2-94fb-4e75bc3c421f None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:57.105464 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74461ae-f535-46d2-94fb-4e75bc3c421f None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:57.105896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74461ae-f535-46d2-94fb-4e75bc3c421f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:57.106899 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74461ae-f535-46d2-94fb-4e75bc3c421f None admin] RBAC: Adding query filter params (role.id=e30f587367384737a72bbcc2e35d62ad, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=a2a420cc676e4f2bb2766826a1de3b41) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:00:57.107301 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74461ae-f535-46d2-94fb-4e75bc3c421f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:00:57.108989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74461ae-f535-46d2-94fb-4e75bc3c421f None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:00:57.115979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 627/1219] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 10:00:56 2022] GET /identity/v3/role_assignments?user.id=a2a420cc676e4f2bb2766826a1de3b41&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=e30f587367384737a72bbcc2e35d62ad => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:00:59.273948 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62631898-66df-49c0-a38b-c8722bd764f7 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:59.273948 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62631898-66df-49c0-a38b-c8722bd764f7 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:59.273948 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62631898-66df-49c0-a38b-c8722bd764f7 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:59.273948 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 593/1220] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:00:59.279720 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6894c-d34d-438e-9cfa-bb024ba8f5fc None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:59.280149 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6894c-d34d-438e-9cfa-bb024ba8f5fc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:59.280280 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6894c-d34d-438e-9cfa-bb024ba8f5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:59.301378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-bdf6894c-d34d-438e-9cfa-bb024ba8f5fc None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:00:59.302577 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bdf6894c-d34d-438e-9cfa-bb024ba8f5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:00:59.374592 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 628/1221] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:00:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 10:00:59.402073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62631898-66df-49c0-a38b-c8722bd764f7 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:00:59.516031 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62631898-66df-49c0-a38b-c8722bd764f7 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:00:59.553833 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56442df5-334e-4922-9d15-7ba2f8eff733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:00:59.554754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56442df5-334e-4922-9d15-7ba2f8eff733 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:59.555074 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56442df5-334e-4922-9d15-7ba2f8eff733 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:59.555554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56442df5-334e-4922-9d15-7ba2f8eff733 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:59.569275 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56442df5-334e-4922-9d15-7ba2f8eff733 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 10:00:59.576743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-56442df5-334e-4922-9d15-7ba2f8eff733 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 10:00:59.576743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:00:59.576743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:00:59.576743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:00:59.576743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:00:59.576743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:00:59.576743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:00:59.576743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:00:59.576743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:00:59.576743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:00:59.576743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:00:59.576743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:00:59.576743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 10:00:59.576743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 10:00:59.576743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 10:00:59.576743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 10:00:59.577874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 10:00:59.577874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 10:00:59.577874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 10:00:59.577874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 10:00:59.577874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:00:59.577874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:00:59.577874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:00:59.577874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:00:59.577874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:00:59.577874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:00:59.577874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:00:59.577874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 10:00:59.577874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:00:59.577874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:00:59.577874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:00:59.577874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:00:59.578719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:00:59.578719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:00:59.578719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:00:59.578719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:00:59.578719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 10:00:59.578719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 10:00:59.578719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 10:00:59.578719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 10:00:59.578719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 10:00:59.578719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 10:00:59.578719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 10:00:59.578719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:00:59.578719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 594/1222] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 10:00:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:00:59.584914 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6894c-d34d-438e-9cfa-bb024ba8f5fc None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:00:59.689739 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6894c-d34d-438e-9cfa-bb024ba8f5fc None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:00:59.714487 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:00:59.726744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca41fa-b140-4fc2-af80-8354a130fbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:00:59.726744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca41fa-b140-4fc2-af80-8354a130fbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:59.726744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca41fa-b140-4fc2-af80-8354a130fbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:59.727164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca41fa-b140-4fc2-af80-8354a130fbe0 None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:59.727787 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca41fa-b140-4fc2-af80-8354a130fbe0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:00:59.728092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca41fa-b140-4fc2-af80-8354a130fbe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:00:59.729487 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca41fa-b140-4fc2-af80-8354a130fbe0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:00:59.738342 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 629/1223] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 10:00:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:00:59.744011 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56442df5-334e-4922-9d15-7ba2f8eff733 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:00:59.793920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:00:59.856941 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56442df5-334e-4922-9d15-7ba2f8eff733 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:00:59.896716 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce13c42-ffe8-4160-90f4-2fc0cc8b405e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:00:59.897404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce13c42-ffe8-4160-90f4-2fc0cc8b405e None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:00:59.897714 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce13c42-ffe8-4160-90f4-2fc0cc8b405e None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:00:59.898017 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce13c42-ffe8-4160-90f4-2fc0cc8b405e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:00:59.910149 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce13c42-ffe8-4160-90f4-2fc0cc8b405e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:00:59.911884 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce13c42-ffe8-4160-90f4-2fc0cc8b405e None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:00:59.930445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-dce13c42-ffe8-4160-90f4-2fc0cc8b405e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:00:59.930445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:00:59.930445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:00:59.930445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:00:59.930445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:00:59.930445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:00:59.930445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:00:59.930445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:00:59.930445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:00:59.930445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:00:59.930445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:00:59.930445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:00:59.930445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 10:00:59.930445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 10:00:59.930445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 10:00:59.931553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 10:00:59.931553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:00:59.931553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:00:59.931553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:00:59.931553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:00:59.931553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:00:59.931553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:00:59.931553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:00:59.931553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 10:00:59.931553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:00:59.931553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:00:59.931553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:00:59.931553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:00:59.931553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:00:59.931553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:00:59.931553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:00:59.931553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:00:59.932743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 10:00:59.932743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 10:00:59.932743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:00:59.932743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:00:59.932743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 595/1224] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 10:00:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:00:59.937605 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca41fa-b140-4fc2-af80-8354a130fbe0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:00.047800 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca41fa-b140-4fc2-af80-8354a130fbe0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:00.086856 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3b562-6636-4411-bdbd-15cfab86470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:00.087465 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3b562-6636-4411-bdbd-15cfab86470b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:00.087748 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3b562-6636-4411-bdbd-15cfab86470b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:00.088020 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3b562-6636-4411-bdbd-15cfab86470b None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:00.088751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3b562-6636-4411-bdbd-15cfab86470b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:00.089055 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3b562-6636-4411-bdbd-15cfab86470b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:00.090411 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3b562-6636-4411-bdbd-15cfab86470b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:00.103832 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 630/1225] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 10:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:00.110458 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce13c42-ffe8-4160-90f4-2fc0cc8b405e None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:00.216334 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:00.223658 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce13c42-ffe8-4160-90f4-2fc0cc8b405e None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:00.259586 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d7159-71fd-4bbb-bf1c-1ffdd24f0e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:00.260398 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d7159-71fd-4bbb-bf1c-1ffdd24f0e3d None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:00.260712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d7159-71fd-4bbb-bf1c-1ffdd24f0e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:00.261054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d7159-71fd-4bbb-bf1c-1ffdd24f0e3d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:00.269787 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d7159-71fd-4bbb-bf1c-1ffdd24f0e3d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:00.271347 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d7159-71fd-4bbb-bf1c-1ffdd24f0e3d None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:00.283910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-8f0d7159-71fd-4bbb-bf1c-1ffdd24f0e3d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 10:01:00.283910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:00.283910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:00.283910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:00.283910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:00.283910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:00.283910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:00.283910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:00.283910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:00.283910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:00.283910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:00.283910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:00.283910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 10:01:00.283910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 10:01:00.283910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 10:01:00.283910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 10:01:00.285853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:00.285853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:00.285853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 10:01:00.285853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 10:01:00.285853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 10:01:00.285853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 10:01:00.285853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:00.285853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:00.285853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:00.285853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:00.285853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:00.285853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:00.285853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:00.285853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:00.285853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:00.285853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:00.285853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:00.285853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:00.287221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:00.287221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:00.287221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 10:01:00.287221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 10:01:00.287221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 10:01:00.287221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 10:01:00.287221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 10:01:00.287221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 10:01:00.287221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 10:01:00.287221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:01:00.287221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 596/1226] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 10:01:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:00.292019 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3b562-6636-4411-bdbd-15cfab86470b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:00.348099 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:00.410115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3b562-6636-4411-bdbd-15cfab86470b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:00.447568 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000b5b1-1fd6-4efb-b3d2-98cd34b6e720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:00.448178 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000b5b1-1fd6-4efb-b3d2-98cd34b6e720 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:00.448476 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000b5b1-1fd6-4efb-b3d2-98cd34b6e720 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:00.448751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000b5b1-1fd6-4efb-b3d2-98cd34b6e720 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:00.449552 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000b5b1-1fd6-4efb-b3d2-98cd34b6e720 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:00.449858 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000b5b1-1fd6-4efb-b3d2-98cd34b6e720 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:00.451283 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000b5b1-1fd6-4efb-b3d2-98cd34b6e720 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:00.469213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 631/1227] 10.222.0.85 () {56 vars in 1143 bytes} [Tue Aug 2 10:01:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:00.475816 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d7159-71fd-4bbb-bf1c-1ffdd24f0e3d None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:00.592025 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d7159-71fd-4bbb-bf1c-1ffdd24f0e3d None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:00.629503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6c743-4164-41bf-bb11-ebd1688482fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:00.630170 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6c743-4164-41bf-bb11-ebd1688482fa None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:00.630416 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6c743-4164-41bf-bb11-ebd1688482fa None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:00.630796 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6c743-4164-41bf-bb11-ebd1688482fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:00.642327 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6c743-4164-41bf-bb11-ebd1688482fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:00.644895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6c743-4164-41bf-bb11-ebd1688482fa None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:00.663039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-85f6c743-4164-41bf-bb11-ebd1688482fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:01:00.663039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:00.663039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:00.663039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:00.663039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:00.663039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:00.663039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:00.663039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:00.663039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:00.663039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:00.663039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:00.663039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:00.663039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 10:01:00.663039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 10:01:00.663039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 10:01:00.664127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 10:01:00.664127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:00.664127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:00.664127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:00.664127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:00.664127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:00.664127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:00.664127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:00.664127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:00.664127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:00.664127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:00.664127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:00.664127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:00.664127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:00.664127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:00.664127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:00.664127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:00.665306 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 10:01:00.665306 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 10:01:00.665306 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:01:00.665306 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:01:00.665306 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 597/1228] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 10:01:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 10:01:00.670680 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000b5b1-1fd6-4efb-b3d2-98cd34b6e720 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:00.777786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000b5b1-1fd6-4efb-b3d2-98cd34b6e720 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:00.780104 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:00.823436 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f28c5-2cc4-4b17-83f9-abcf6d96d4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:00.824188 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f28c5-2cc4-4b17-83f9-abcf6d96d4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:00.824493 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f28c5-2cc4-4b17-83f9-abcf6d96d4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:00.824815 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f28c5-2cc4-4b17-83f9-abcf6d96d4f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:00.825700 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f28c5-2cc4-4b17-83f9-abcf6d96d4f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:00.826093 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f28c5-2cc4-4b17-83f9-abcf6d96d4f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:00.827698 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f28c5-2cc4-4b17-83f9-abcf6d96d4f8 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:00.840845 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 632/1229] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 10:01:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 10:01:00.847445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6c743-4164-41bf-bb11-ebd1688482fa None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:00.858104 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:00.974071 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6c743-4164-41bf-bb11-ebd1688482fa None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:01.016779 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76f91f-9d82-4316-ab3b-d08ea5e0e8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:01.017474 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76f91f-9d82-4316-ab3b-d08ea5e0e8ed None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:01.017873 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76f91f-9d82-4316-ab3b-d08ea5e0e8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:01.018141 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76f91f-9d82-4316-ab3b-d08ea5e0e8ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:01.027075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76f91f-9d82-4316-ab3b-d08ea5e0e8ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:01.028985 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76f91f-9d82-4316-ab3b-d08ea5e0e8ed None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:01.041788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-6a76f91f-9d82-4316-ab3b-d08ea5e0e8ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 10:01:01.041788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:01.041788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:01.041788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:01.041788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:01.041788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:01.041788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:01.041788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:01.041788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:01.041788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:01.041788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:01.041788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:01.041788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 10:01:01.041788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 10:01:01.041788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 10:01:01.042760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 10:01:01.042760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:01.042760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:01.042760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:01.042760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:01.042760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:01.042760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:01.042760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:01.042760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:01.042760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:01.042760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:01.042760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:01.042760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:01.042760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:01.042760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:01.042760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:01.042760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:01.043646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 10:01:01.043646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 10:01:01.043646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 10:01:01.043646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 10:01:01.043646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 10:01:01.043646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 10:01:01.043646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 10:01:01.043646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:01:01.043646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 598/1230] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 10:01:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:01.048745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f28c5-2cc4-4b17-83f9-abcf6d96d4f8 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:01.161796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f28c5-2cc4-4b17-83f9-abcf6d96d4f8 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:01.199115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b4ed9-6476-46a7-8b91-ea80cc7e93eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:01.199727 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b4ed9-6476-46a7-8b91-ea80cc7e93eb None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:01.200005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b4ed9-6476-46a7-8b91-ea80cc7e93eb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:01.200276 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b4ed9-6476-46a7-8b91-ea80cc7e93eb None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:01.201060 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b4ed9-6476-46a7-8b91-ea80cc7e93eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:01.201365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b4ed9-6476-46a7-8b91-ea80cc7e93eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:01.202776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b4ed9-6476-46a7-8b91-ea80cc7e93eb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:01.215857 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 633/1231] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 10:01:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:01.222572 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76f91f-9d82-4316-ab3b-d08ea5e0e8ed None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:01.290786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:01.328872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76f91f-9d82-4316-ab3b-d08ea5e0e8ed None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:01.367803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3c6f0-ce2b-438f-b8f4-deeac76e3de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:01.368492 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3c6f0-ce2b-438f-b8f4-deeac76e3de1 None admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:01.368780 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3c6f0-ce2b-438f-b8f4-deeac76e3de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:01.369058 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3c6f0-ce2b-438f-b8f4-deeac76e3de1 None admin] PATH_INFO: `/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/a2a420cc676e4f2bb2766826a1de3b41/roles/e30f587367384737a72bbcc2e35d62ad` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:01.386525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3c6f0-ce2b-438f-b8f4-deeac76e3de1 None admin] RBAC: Authorizing `identity:create_grant(project_id=701d7ad0b7594984885e7bfe8a236937, user_id=a2a420cc676e4f2bb2766826a1de3b41, role_id=e30f587367384737a72bbcc2e35d62ad)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:01.388323 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3c6f0-ce2b-438f-b8f4-deeac76e3de1 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:01.405414 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 599/1232] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 10:01:01 2022] PUT /identity/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/a2a420cc676e4f2bb2766826a1de3b41/roles/e30f587367384737a72bbcc2e35d62ad => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:01:03.532614 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307c065-ceba-4437-86d6-8f6a1f8bdf93 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:03.533208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307c065-ceba-4437-86d6-8f6a1f8bdf93 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:03.533208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307c065-ceba-4437-86d6-8f6a1f8bdf93 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:03.534978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 634/1233] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:01:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 10:01:03.542960 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a0e8f-21e8-411f-8c1e-03816c1161c5 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:03.543432 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a0e8f-21e8-411f-8c1e-03816c1161c5 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:03.543807 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a0e8f-21e8-411f-8c1e-03816c1161c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:03.566784 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-686a0e8f-21e8-411f-8c1e-03816c1161c5 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:01:03.567970 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-686a0e8f-21e8-411f-8c1e-03816c1161c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:01:03.639744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 600/1234] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:01:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 10:01:03.664947 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307c065-ceba-4437-86d6-8f6a1f8bdf93 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:03.694094 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:03.777526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307c065-ceba-4437-86d6-8f6a1f8bdf93 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:03.814210 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758a28f-24a7-4486-af5a-c5d7ec6647a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:03.815598 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758a28f-24a7-4486-af5a-c5d7ec6647a4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:03.816145 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758a28f-24a7-4486-af5a-c5d7ec6647a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:03.816494 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758a28f-24a7-4486-af5a-c5d7ec6647a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:03.827507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758a28f-24a7-4486-af5a-c5d7ec6647a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 10:01:03.834925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-0758a28f-24a7-4486-af5a-c5d7ec6647a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 10:01:03.834925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:03.834925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:03.834925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:03.834925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:03.834925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:03.834925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:03.834925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:03.834925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:03.834925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:03.834925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:03.834925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:03.834925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 10:01:03.834925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 10:01:03.834925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 10:01:03.834925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 10:01:03.836033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 10:01:03.836033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 10:01:03.836033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 10:01:03.836033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 10:01:03.836033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:03.836033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:03.836033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:03.836033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:03.836033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:03.836033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:03.836033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:03.836033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:03.836033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:03.836033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:03.836033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:03.836033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:03.837017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:03.837017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:03.837017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:03.837017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:03.837017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 10:01:03.837017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 10:01:03.837017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 10:01:03.837017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 10:01:03.837017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 10:01:03.837017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 10:01:03.837017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 10:01:03.837017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 10:01:03.837017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 635/1235] 10.222.0.85 () {56 vars in 1102 bytes} [Tue Aug 2 10:01:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:03.842671 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a0e8f-21e8-411f-8c1e-03816c1161c5 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:03.898033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:03.967657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a0e8f-21e8-411f-8c1e-03816c1161c5 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:04.007229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980014e5-37e9-4bb7-9247-ffed3b807817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:04.007937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980014e5-37e9-4bb7-9247-ffed3b807817 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:04.008286 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980014e5-37e9-4bb7-9247-ffed3b807817 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:04.008918 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980014e5-37e9-4bb7-9247-ffed3b807817 None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:04.009712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980014e5-37e9-4bb7-9247-ffed3b807817 None admin] RBAC: Adding query filter params (name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:04.010142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980014e5-37e9-4bb7-9247-ffed3b807817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:04.011747 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980014e5-37e9-4bb7-9247-ffed3b807817 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:04.021427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 601/1236] 10.222.0.85 () {56 vars in 1103 bytes} [Tue Aug 2 10:01:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:04.027777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758a28f-24a7-4486-af5a-c5d7ec6647a4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:04.126587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:04.147629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758a28f-24a7-4486-af5a-c5d7ec6647a4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:04.187056 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed1697-97f3-4344-ae43-958d9ed8438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:04.187780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed1697-97f3-4344-ae43-958d9ed8438c None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:04.188064 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed1697-97f3-4344-ae43-958d9ed8438c None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:04.188331 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed1697-97f3-4344-ae43-958d9ed8438c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:04.199337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed1697-97f3-4344-ae43-958d9ed8438c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:04.200884 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed1697-97f3-4344-ae43-958d9ed8438c None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:04.216031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-40ed1697-97f3-4344-ae43-958d9ed8438c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:01:04.216031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:04.216031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:04.216031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:04.216031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:04.216031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:04.216031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:04.216031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:04.216031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:04.216031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:04.216031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:04.216031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:04.216031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 10:01:04.216031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 10:01:04.216031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 10:01:04.217239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 10:01:04.217239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:04.217239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:04.217239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:04.217239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:04.217239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:04.217239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:04.217239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:04.217239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:04.217239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:04.217239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:04.217239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:04.217239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:04.217239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:04.217239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:04.217239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:04.217239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:04.218265 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 10:01:04.218265 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 10:01:04.218265 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:01:04.218265 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 10:01:04.218265 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 636/1237] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 10:01:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 10:01:04.223854 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980014e5-37e9-4bb7-9247-ffed3b807817 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:04.343886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980014e5-37e9-4bb7-9247-ffed3b807817 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:04.358241 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:04.389463 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb6cea-e6b0-45c2-a090-1fc9cc3113f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:04.390013 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb6cea-e6b0-45c2-a090-1fc9cc3113f2 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:04.390301 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb6cea-e6b0-45c2-a090-1fc9cc3113f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:04.390828 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb6cea-e6b0-45c2-a090-1fc9cc3113f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:04.391522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb6cea-e6b0-45c2-a090-1fc9cc3113f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:04.391827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb6cea-e6b0-45c2-a090-1fc9cc3113f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:04.393868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb6cea-e6b0-45c2-a090-1fc9cc3113f2 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:04.409519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 602/1238] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 10:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:04.415510 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed1697-97f3-4344-ae43-958d9ed8438c None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:04.529275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed1697-97f3-4344-ae43-958d9ed8438c None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:04.568088 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25ae97-9006-42d3-9dba-839d4aa14d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:04.568929 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25ae97-9006-42d3-9dba-839d4aa14d58 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:04.569174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25ae97-9006-42d3-9dba-839d4aa14d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:04.569359 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25ae97-9006-42d3-9dba-839d4aa14d58 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:04.572508 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:04.578371 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25ae97-9006-42d3-9dba-839d4aa14d58 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:04.580068 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25ae97-9006-42d3-9dba-839d4aa14d58 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:04.593319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-ab25ae97-9006-42d3-9dba-839d4aa14d58 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 10:01:04.593319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:04.593319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:04.593319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:04.593319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:04.593319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:04.593319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:04.593319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:04.593319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:04.593319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:04.593319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:04.593319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:04.593319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 10:01:04.593319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 10:01:04.593319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 10:01:04.593319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 10:01:04.594701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:04.594701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:04.594701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 10:01:04.594701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 10:01:04.594701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 10:01:04.594701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 10:01:04.594701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:04.594701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:04.594701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:04.594701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:04.594701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:04.594701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:04.594701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:04.594701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:04.594701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:04.594701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:04.594701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:04.594701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:04.595697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:04.595697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:04.595697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 10:01:04.595697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 10:01:04.595697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 10:01:04.595697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 10:01:04.595697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 10:01:04.595697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 10:01:04.595697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 10:01:04.595697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 10:01:04.595697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 637/1239] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 10:01:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:04.601628 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb6cea-e6b0-45c2-a090-1fc9cc3113f2 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:04.715644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb6cea-e6b0-45c2-a090-1fc9cc3113f2 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:04.753364 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadd248-e3eb-49a8-9f65-13e2a6d34a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:04.753978 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadd248-e3eb-49a8-9f65-13e2a6d34a5f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:04.754259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadd248-e3eb-49a8-9f65-13e2a6d34a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:04.754535 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadd248-e3eb-49a8-9f65-13e2a6d34a5f None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:04.755396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aadd248-e3eb-49a8-9f65-13e2a6d34a5f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:04.755746 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aadd248-e3eb-49a8-9f65-13e2a6d34a5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:04.757217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aadd248-e3eb-49a8-9f65-13e2a6d34a5f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:04.774776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 603/1240] 10.222.0.85 () {56 vars in 1143 bytes} [Tue Aug 2 10:01:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:04.780885 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25ae97-9006-42d3-9dba-839d4aa14d58 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:04.899495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25ae97-9006-42d3-9dba-839d4aa14d58 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:04.943476 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddc15b-04af-45cd-9a8f-f5710ec8bfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:04.944055 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddc15b-04af-45cd-9a8f-f5710ec8bfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:04.944333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddc15b-04af-45cd-9a8f-f5710ec8bfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:04.944673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddc15b-04af-45cd-9a8f-f5710ec8bfb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:05.021629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:05.029238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddc15b-04af-45cd-9a8f-f5710ec8bfb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:05.031334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddc15b-04af-45cd-9a8f-f5710ec8bfb4 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:05.136702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 638/1241] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 10:01:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 10:01:05.143190 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadd248-e3eb-49a8-9f65-13e2a6d34a5f None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:05.175231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:05.254917 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadd248-e3eb-49a8-9f65-13e2a6d34a5f None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:05.292137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae1f27-6b78-40a4-a948-42ec14624898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:05.292877 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae1f27-6b78-40a4-a948-42ec14624898 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:05.293008 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae1f27-6b78-40a4-a948-42ec14624898 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:05.293282 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae1f27-6b78-40a4-a948-42ec14624898 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:05.306430 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae1f27-6b78-40a4-a948-42ec14624898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:05.308141 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae1f27-6b78-40a4-a948-42ec14624898 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:05.325741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-d2ae1f27-6b78-40a4-a948-42ec14624898 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:01:05.325741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:05.325741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:05.325741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:05.325741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:05.325741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:05.325741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:05.325741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:05.325741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:05.325741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:05.325741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:05.325741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:05.325741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 10:01:05.325741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 10:01:05.325741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 10:01:05.326818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 10:01:05.326818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:05.326818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:05.326818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:05.326818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:05.326818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:05.326818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:05.326818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:05.326818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:05.326818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:05.326818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:05.326818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:05.326818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:05.326818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:05.326818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:05.326818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:05.326818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:05.327725 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 10:01:05.327725 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 10:01:05.327725 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:01:05.327725 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:01:05.327725 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 604/1242] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 10:01:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:05.333146 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddc15b-04af-45cd-9a8f-f5710ec8bfb4 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:05.445558 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:05.453836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddc15b-04af-45cd-9a8f-f5710ec8bfb4 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:05.498054 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27039d-b109-4852-8eb7-afbf755aea8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:05.498825 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27039d-b109-4852-8eb7-afbf755aea8a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:05.499128 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27039d-b109-4852-8eb7-afbf755aea8a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:05.499389 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27039d-b109-4852-8eb7-afbf755aea8a None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:05.500146 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27039d-b109-4852-8eb7-afbf755aea8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:05.500469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27039d-b109-4852-8eb7-afbf755aea8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:05.502101 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27039d-b109-4852-8eb7-afbf755aea8a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:05.516700 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 639/1243] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 10:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 10:01:05.523502 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae1f27-6b78-40a4-a948-42ec14624898 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:05.614784 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:05.639519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae1f27-6b78-40a4-a948-42ec14624898 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:05.683985 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0892a23-3746-4614-9354-5d0b7999ea1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:05.684827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0892a23-3746-4614-9354-5d0b7999ea1d None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:05.685198 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0892a23-3746-4614-9354-5d0b7999ea1d None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:05.685655 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0892a23-3746-4614-9354-5d0b7999ea1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:05.695570 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0892a23-3746-4614-9354-5d0b7999ea1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:05.697472 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0892a23-3746-4614-9354-5d0b7999ea1d None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:05.711631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-b0892a23-3746-4614-9354-5d0b7999ea1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 10:01:05.711631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:05.711631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:05.711631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:05.711631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:05.711631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:05.711631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:05.711631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:05.711631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:05.711631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:05.711631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:05.711631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:05.711631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 10:01:05.711631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 10:01:05.711631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 10:01:05.712802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 10:01:05.712802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:05.712802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:05.712802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:05.712802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:05.712802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:05.712802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:05.712802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:05.712802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:05.712802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:05.712802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:05.712802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:05.712802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:05.712802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:05.712802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:05.712802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:05.712802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:05.713721 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 10:01:05.713721 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 10:01:05.713721 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 10:01:05.713721 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 10:01:05.713721 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 10:01:05.713721 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 10:01:05.713721 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 10:01:05.713721 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:01:05.713721 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 605/1244] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 10:01:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:05.718653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27039d-b109-4852-8eb7-afbf755aea8a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:05.827511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27039d-b109-4852-8eb7-afbf755aea8a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:05.865132 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda3620-119b-42f8-b119-4f87a9ab35c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:05.865772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda3620-119b-42f8-b119-4f87a9ab35c6 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:05.865959 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda3620-119b-42f8-b119-4f87a9ab35c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:05.866236 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda3620-119b-42f8-b119-4f87a9ab35c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:05.866985 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda3620-119b-42f8-b119-4f87a9ab35c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:05.867292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda3620-119b-42f8-b119-4f87a9ab35c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:05.868909 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda3620-119b-42f8-b119-4f87a9ab35c6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:05.885170 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 640/1245] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 10:01:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 10:01:05.892174 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0892a23-3746-4614-9354-5d0b7999ea1d None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:06.018078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0892a23-3746-4614-9354-5d0b7999ea1d None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:06.056835 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd073f4-6960-47f4-a7f6-98ad49815546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:06.057641 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd073f4-6960-47f4-a7f6-98ad49815546 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:06.058044 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd073f4-6960-47f4-a7f6-98ad49815546 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:06.058358 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd073f4-6960-47f4-a7f6-98ad49815546 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:06.059414 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd073f4-6960-47f4-a7f6-98ad49815546 None admin] RBAC: Adding query filter params (role.id=e30f587367384737a72bbcc2e35d62ad, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=a2a420cc676e4f2bb2766826a1de3b41) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:06.059809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd073f4-6960-47f4-a7f6-98ad49815546 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:06.061268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd073f4-6960-47f4-a7f6-98ad49815546 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:06.068441 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 606/1246] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 10:01:05 2022] GET /identity/v3/role_assignments?user.id=a2a420cc676e4f2bb2766826a1de3b41&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=e30f587367384737a72bbcc2e35d62ad => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:08.475526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78fb4d-75d5-403f-a3f9-9eb317c418e4 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:08.476085 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78fb4d-75d5-403f-a3f9-9eb317c418e4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:08.476085 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78fb4d-75d5-403f-a3f9-9eb317c418e4 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:08.477855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 641/1247] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:01:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:01:08.488045 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541d61c-b55a-4be3-b683-b471add42df2 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:08.488045 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541d61c-b55a-4be3-b683-b471add42df2 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:08.488045 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541d61c-b55a-4be3-b683-b471add42df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:08.493272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:08.510479 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-3541d61c-b55a-4be3-b683-b471add42df2 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:01:08.512086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-3541d61c-b55a-4be3-b683-b471add42df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:01:08.593796 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 607/1248] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:01:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 10:01:08.622894 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78fb4d-75d5-403f-a3f9-9eb317c418e4 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:08.648577 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:08.758890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78fb4d-75d5-403f-a3f9-9eb317c418e4 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:08.799291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fb033-2fc4-4d2c-aec7-8e1941f040c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:08.800996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fb033-2fc4-4d2c-aec7-8e1941f040c2 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:08.801328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fb033-2fc4-4d2c-aec7-8e1941f040c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:08.801559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523fb033-2fc4-4d2c-aec7-8e1941f040c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:08.812154 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523fb033-2fc4-4d2c-aec7-8e1941f040c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 10:01:08.818230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-523fb033-2fc4-4d2c-aec7-8e1941f040c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 10:01:08.818230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:08.818230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:08.818230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:08.818230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:08.818230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:08.818230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:08.818230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:08.818230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:08.818230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:08.818230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:08.818230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:08.818230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 10:01:08.818230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 10:01:08.818230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 10:01:08.818230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 10:01:08.819363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 10:01:08.819363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 10:01:08.819363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 10:01:08.819363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 10:01:08.819363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:08.819363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:08.819363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:08.819363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:08.819363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:08.819363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:08.819363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:08.819363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:08.819363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:08.819363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:08.819363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:08.819363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:08.820390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:08.820390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:08.820390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:08.820390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:08.820390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 10:01:08.820390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 10:01:08.820390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 10:01:08.820390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 10:01:08.820390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 10:01:08.820390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 10:01:08.820390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 10:01:08.820390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 10:01:08.820390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 642/1249] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 10:01:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:08.825682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541d61c-b55a-4be3-b683-b471add42df2 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:08.944962 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541d61c-b55a-4be3-b683-b471add42df2 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:08.980544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:08.986444 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea176c-d834-4f90-87a7-c6bc4fe4d6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:08.987867 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea176c-d834-4f90-87a7-c6bc4fe4d6df None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:08.989421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea176c-d834-4f90-87a7-c6bc4fe4d6df None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:08.989421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea176c-d834-4f90-87a7-c6bc4fe4d6df None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:08.989421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea176c-d834-4f90-87a7-c6bc4fe4d6df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:08.989752 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea176c-d834-4f90-87a7-c6bc4fe4d6df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:08.991070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea176c-d834-4f90-87a7-c6bc4fe4d6df None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:09.004734 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 608/1250] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 10:01:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 10:01:09.009666 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fb033-2fc4-4d2c-aec7-8e1941f040c2 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:09.105317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:09.133265 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523fb033-2fc4-4d2c-aec7-8e1941f040c2 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:09.174930 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602a8bd-70d2-451a-a316-e3a24153aacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:09.175580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602a8bd-70d2-451a-a316-e3a24153aacf None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:09.175873 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602a8bd-70d2-451a-a316-e3a24153aacf None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:09.176183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602a8bd-70d2-451a-a316-e3a24153aacf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:09.188051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602a8bd-70d2-451a-a316-e3a24153aacf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:09.189553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602a8bd-70d2-451a-a316-e3a24153aacf None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:09.207335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-3602a8bd-70d2-451a-a316-e3a24153aacf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:01:09.207335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:09.207335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:09.207335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:09.207335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:09.207335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:09.207335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:09.207335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:09.207335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:09.207335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:09.207335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:09.207335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:09.207335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 10:01:09.207335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 10:01:09.207335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 10:01:09.208451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 10:01:09.208451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:09.208451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:09.208451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:09.208451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:09.208451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:09.208451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:09.208451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:09.208451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:09.208451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:09.208451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:09.208451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:09.208451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:09.208451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:09.208451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:09.208451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:09.208451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:09.209457 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 10:01:09.209457 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 10:01:09.209457 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:01:09.209457 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 10:01:09.209457 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 643/1251] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 10:01:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:09.214682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea176c-d834-4f90-87a7-c6bc4fe4d6df None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:09.337559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea176c-d834-4f90-87a7-c6bc4fe4d6df None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:09.375730 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7897751-5925-49ed-a013-829eaa418cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:09.376372 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7897751-5925-49ed-a013-829eaa418cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:09.376666 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7897751-5925-49ed-a013-829eaa418cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:09.376941 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7897751-5925-49ed-a013-829eaa418cf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:09.377637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7897751-5925-49ed-a013-829eaa418cf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:09.378614 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7897751-5925-49ed-a013-829eaa418cf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:09.379992 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7897751-5925-49ed-a013-829eaa418cf1 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:09.395406 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 609/1252] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 10:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:09.401440 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602a8bd-70d2-451a-a316-e3a24153aacf None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:09.529916 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602a8bd-70d2-451a-a316-e3a24153aacf None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:09.561537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:09.572166 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c02b0-09c3-4d40-ba2f-b35f12c0208a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:09.572908 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c02b0-09c3-4d40-ba2f-b35f12c0208a None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:09.573592 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c02b0-09c3-4d40-ba2f-b35f12c0208a None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:09.573893 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c02b0-09c3-4d40-ba2f-b35f12c0208a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:09.583172 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c02b0-09c3-4d40-ba2f-b35f12c0208a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:09.584764 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c02b0-09c3-4d40-ba2f-b35f12c0208a None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:09.598461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-a83c02b0-09c3-4d40-ba2f-b35f12c0208a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 10:01:09.598461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:09.598461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:09.598461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:09.598461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:09.598461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:09.598461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:09.598461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:09.598461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:09.598461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:09.598461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:09.598461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:09.598461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 10:01:09.598461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 10:01:09.598461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 10:01:09.598461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 10:01:09.599791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:09.599791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:09.599791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 10:01:09.599791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 10:01:09.599791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 10:01:09.599791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 10:01:09.599791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:09.599791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:09.599791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:09.599791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:09.599791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:09.599791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:09.599791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:09.599791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:09.599791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:09.599791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:09.599791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:09.599791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:09.601001 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:09.601001 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:09.601001 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 10:01:09.601001 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 10:01:09.601001 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 10:01:09.601001 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 10:01:09.601001 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 10:01:09.601001 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 10:01:09.601001 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 10:01:09.601001 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 10:01:09.604937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 644/1253] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 10:01:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:09.605913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7897751-5925-49ed-a013-829eaa418cf1 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:09.669172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:09.725502 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7897751-5925-49ed-a013-829eaa418cf1 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:09.763977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b0ed9-0c9c-42e0-bbc8-4c606508a393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:09.764619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b0ed9-0c9c-42e0-bbc8-4c606508a393 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:09.764901 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b0ed9-0c9c-42e0-bbc8-4c606508a393 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:09.765173 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b0ed9-0c9c-42e0-bbc8-4c606508a393 None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:09.765962 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b0ed9-0c9c-42e0-bbc8-4c606508a393 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:09.766525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b0ed9-0c9c-42e0-bbc8-4c606508a393 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:09.767950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b0ed9-0c9c-42e0-bbc8-4c606508a393 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:09.786453 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 610/1254] 10.222.0.85 () {56 vars in 1143 bytes} [Tue Aug 2 10:01:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:09.792487 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c02b0-09c3-4d40-ba2f-b35f12c0208a None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:09.926499 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c02b0-09c3-4d40-ba2f-b35f12c0208a None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:09.977323 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b3456-cc23-4d74-ad0b-f773bc130ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:09.977949 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b3456-cc23-4d74-ad0b-f773bc130ebc None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:09.978235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b3456-cc23-4d74-ad0b-f773bc130ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:09.978512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b3456-cc23-4d74-ad0b-f773bc130ebc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:10.036189 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:10.049528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b3456-cc23-4d74-ad0b-f773bc130ebc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:10.051443 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b3456-cc23-4d74-ad0b-f773bc130ebc None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:10.172633 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 645/1255] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 10:01:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 10:01:10.178587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b0ed9-0c9c-42e0-bbc8-4c606508a393 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:10.310048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b0ed9-0c9c-42e0-bbc8-4c606508a393 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:10.326050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:10.352288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cafce6-1ad0-4929-8f6a-3e5d5432c094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:10.353093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cafce6-1ad0-4929-8f6a-3e5d5432c094 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:10.353410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cafce6-1ad0-4929-8f6a-3e5d5432c094 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:10.353785 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cafce6-1ad0-4929-8f6a-3e5d5432c094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:10.364621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cafce6-1ad0-4929-8f6a-3e5d5432c094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:10.366083 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cafce6-1ad0-4929-8f6a-3e5d5432c094 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:10.385049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-e6cafce6-1ad0-4929-8f6a-3e5d5432c094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:01:10.385049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:10.385049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:10.385049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:10.385049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:10.385049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:10.385049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:10.385049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:10.385049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:10.385049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:10.385049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:10.385049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:10.385049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 10:01:10.385049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 10:01:10.385049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 10:01:10.386212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 10:01:10.386212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:10.386212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:10.386212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:10.386212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:10.386212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:10.386212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:10.386212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:10.386212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:10.386212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:10.386212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:10.386212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:10.386212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:10.386212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:10.386212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:10.386212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:10.386212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:10.392200 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 10:01:10.392200 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 10:01:10.392200 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:01:10.392200 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:01:10.392200 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 611/1256] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 10:01:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:10.392671 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b3456-cc23-4d74-ad0b-f773bc130ebc None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:10.493900 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:10.507169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b3456-cc23-4d74-ad0b-f773bc130ebc None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:10.545008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cb8d5-1e15-4473-81dd-c447eea350bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:10.545660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cb8d5-1e15-4473-81dd-c447eea350bb None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:10.545897 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cb8d5-1e15-4473-81dd-c447eea350bb None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:10.546172 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584cb8d5-1e15-4473-81dd-c447eea350bb None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:10.546863 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cb8d5-1e15-4473-81dd-c447eea350bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:10.547172 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cb8d5-1e15-4473-81dd-c447eea350bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:10.548559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584cb8d5-1e15-4473-81dd-c447eea350bb None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:10.561468 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 646/1257] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 10:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:10.567137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cafce6-1ad0-4929-8f6a-3e5d5432c094 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:10.680184 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cafce6-1ad0-4929-8f6a-3e5d5432c094 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:10.719938 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376961d-132c-4a00-aaf1-d206a25d4a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:10.720623 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376961d-132c-4a00-aaf1-d206a25d4a8f None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:10.720909 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376961d-132c-4a00-aaf1-d206a25d4a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:10.721181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376961d-132c-4a00-aaf1-d206a25d4a8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:10.729654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376961d-132c-4a00-aaf1-d206a25d4a8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:10.731329 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376961d-132c-4a00-aaf1-d206a25d4a8f None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:10.743596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-6376961d-132c-4a00-aaf1-d206a25d4a8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 10:01:10.743596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:10.743596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:10.743596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:10.743596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:10.743596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:10.743596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:10.743596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:10.743596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:10.743596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:10.743596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:10.743596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:10.743596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 10:01:10.743596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 10:01:10.743596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 10:01:10.744782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 10:01:10.744782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:10.744782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:10.744782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:10.744782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:10.744782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:10.744782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:10.744782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:10.744782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:10.744782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:10.744782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:10.744782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:10.744782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:10.744782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:10.744782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:10.744782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:10.744782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:10.745885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 10:01:10.745885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 10:01:10.745885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 10:01:10.745885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 10:01:10.745885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 10:01:10.745885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 10:01:10.745885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 10:01:10.745885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:01:10.745885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 612/1258] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 10:01:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 10:01:10.750623 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cb8d5-1e15-4473-81dd-c447eea350bb None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:10.858921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584cb8d5-1e15-4473-81dd-c447eea350bb None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:10.900006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb35c5-d240-4429-906e-b33567b58c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:10.900654 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb35c5-d240-4429-906e-b33567b58c99 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:10.901071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb35c5-d240-4429-906e-b33567b58c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:10.901237 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb35c5-d240-4429-906e-b33567b58c99 None admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:10.902202 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb35c5-d240-4429-906e-b33567b58c99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:10.902495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb35c5-d240-4429-906e-b33567b58c99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:10.904046 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb35c5-d240-4429-906e-b33567b58c99 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:10.925213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 647/1259] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 10:01:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:10.932261 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376961d-132c-4a00-aaf1-d206a25d4a8f None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:10.967632 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:11.087686 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376961d-132c-4a00-aaf1-d206a25d4a8f None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:11.129987 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca14e2b-5495-4112-9613-d6eba460cfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:11.130733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca14e2b-5495-4112-9613-d6eba460cfdd None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:11.131142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca14e2b-5495-4112-9613-d6eba460cfdd None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:11.131552 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca14e2b-5495-4112-9613-d6eba460cfdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:11.132909 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca14e2b-5495-4112-9613-d6eba460cfdd None admin] RBAC: Adding query filter params (role.id=c15ca78eb3c9472f94e15e2d28c7f403, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=a2a420cc676e4f2bb2766826a1de3b41) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:11.133455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca14e2b-5495-4112-9613-d6eba460cfdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:11.136095 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca14e2b-5495-4112-9613-d6eba460cfdd None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:11.145219 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 613/1260] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 10:01:10 2022] GET /identity/v3/role_assignments?user.id=a2a420cc676e4f2bb2766826a1de3b41&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=c15ca78eb3c9472f94e15e2d28c7f403 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:13.173316 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9413c7f-56f2-4f19-861b-8ff75156f4ce None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:13.173850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9413c7f-56f2-4f19-861b-8ff75156f4ce None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:13.173850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9413c7f-56f2-4f19-861b-8ff75156f4ce None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:13.175765 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 648/1261] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:01:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:01:13.181047 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1f966-3074-47c0-ba42-056da2972620 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:13.181442 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1f966-3074-47c0-ba42-056da2972620 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:13.181612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1f966-3074-47c0-ba42-056da2972620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:13.200949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-e3b1f966-3074-47c0-ba42-056da2972620 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:01:13.202137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e3b1f966-3074-47c0-ba42-056da2972620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:01:13.267261 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 614/1262] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:01:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 10:01:13.289564 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9413c7f-56f2-4f19-861b-8ff75156f4ce None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:13.302602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:13.393020 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9413c7f-56f2-4f19-861b-8ff75156f4ce None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:13.426838 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218f112-6154-4a02-92df-c9fddf0dafe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:13.427473 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218f112-6154-4a02-92df-c9fddf0dafe9 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:13.427750 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218f112-6154-4a02-92df-c9fddf0dafe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:13.428021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218f112-6154-4a02-92df-c9fddf0dafe9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:13.437879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218f112-6154-4a02-92df-c9fddf0dafe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 10:01:13.442998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5218f112-6154-4a02-92df-c9fddf0dafe9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 10:01:13.442998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:13.442998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:13.442998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:13.442998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:13.442998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:13.442998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:13.442998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:13.442998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:13.442998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:13.442998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:13.442998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:13.442998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 10:01:13.442998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 10:01:13.442998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 10:01:13.442998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 10:01:13.444080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 10:01:13.444080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 10:01:13.444080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 10:01:13.444080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 10:01:13.444080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:13.444080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:13.444080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:13.444080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:13.444080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:13.444080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:13.444080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:13.444080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:13.444080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:13.444080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:13.444080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:13.444080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:13.445330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:13.445330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:13.445330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:13.445330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:13.445330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 10:01:13.445330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 10:01:13.445330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 10:01:13.445330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 10:01:13.445330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 10:01:13.445330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 10:01:13.445330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 10:01:13.445330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 10:01:13.445330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 649/1263] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 10:01:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:13.450122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1f966-3074-47c0-ba42-056da2972620 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:13.468309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:13.552844 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1f966-3074-47c0-ba42-056da2972620 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:13.585162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1c2cb-a0c3-4864-a419-8cab5256c6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:13.585755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1c2cb-a0c3-4864-a419-8cab5256c6be None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:13.586037 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1c2cb-a0c3-4864-a419-8cab5256c6be None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:13.586310 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1c2cb-a0c3-4864-a419-8cab5256c6be None admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:13.587020 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1c2cb-a0c3-4864-a419-8cab5256c6be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:13.587326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1c2cb-a0c3-4864-a419-8cab5256c6be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:13.588704 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1c2cb-a0c3-4864-a419-8cab5256c6be None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:13.596482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 615/1264] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 10:01:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:13.602863 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218f112-6154-4a02-92df-c9fddf0dafe9 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:13.669499 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:13.704509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218f112-6154-4a02-92df-c9fddf0dafe9 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:13.739538 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489eb49-5456-419a-8cf4-54fb8297a2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:13.740164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489eb49-5456-419a-8cf4-54fb8297a2ba None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:13.740443 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489eb49-5456-419a-8cf4-54fb8297a2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:13.740744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489eb49-5456-419a-8cf4-54fb8297a2ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:13.750418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489eb49-5456-419a-8cf4-54fb8297a2ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:13.751858 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489eb49-5456-419a-8cf4-54fb8297a2ba None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:13.766059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-9489eb49-5456-419a-8cf4-54fb8297a2ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:01:13.766059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:13.766059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:13.766059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:13.766059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:13.766059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:13.766059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:13.766059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:13.766059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:13.766059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:13.766059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:13.766059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:13.766059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 10:01:13.766059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 10:01:13.766059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 10:01:13.767378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 10:01:13.767378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:13.767378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:13.767378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:13.767378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:13.767378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:13.767378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:13.767378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:13.767378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:13.767378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:13.767378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:13.767378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:13.767378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:13.767378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:13.767378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:13.767378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:13.767378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:13.769213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 10:01:13.769213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 10:01:13.769213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:01:13.769213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 10:01:13.769213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 650/1265] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 10:01:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:13.773704 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1c2cb-a0c3-4864-a419-8cab5256c6be None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:13.852329 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:13.871131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1c2cb-a0c3-4864-a419-8cab5256c6be None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:13.908762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e2c63-6467-45c3-b19e-8acc4b482ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:13.910115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e2c63-6467-45c3-b19e-8acc4b482ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:13.910465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e2c63-6467-45c3-b19e-8acc4b482ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:13.910765 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e2c63-6467-45c3-b19e-8acc4b482ef6 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:13.911612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e2c63-6467-45c3-b19e-8acc4b482ef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:13.911965 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e2c63-6467-45c3-b19e-8acc4b482ef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:13.913653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e2c63-6467-45c3-b19e-8acc4b482ef6 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:13.932638 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 616/1266] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 10:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:13.933676 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489eb49-5456-419a-8cf4-54fb8297a2ba None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:14.041758 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489eb49-5456-419a-8cf4-54fb8297a2ba None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:14.060480 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:14.074669 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009db3b8-bdaf-46b3-827d-768551d97a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:14.075295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009db3b8-bdaf-46b3-827d-768551d97a1d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:14.075576 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009db3b8-bdaf-46b3-827d-768551d97a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:14.075850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009db3b8-bdaf-46b3-827d-768551d97a1d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:14.083603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009db3b8-bdaf-46b3-827d-768551d97a1d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:14.085060 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009db3b8-bdaf-46b3-827d-768551d97a1d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:14.095918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-009db3b8-bdaf-46b3-827d-768551d97a1d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 10:01:14.095918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:14.095918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:14.095918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:14.095918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:14.095918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:14.095918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:14.095918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:14.095918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:14.095918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:14.095918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:14.095918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:14.095918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 10:01:14.095918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 10:01:14.095918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 10:01:14.095918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 10:01:14.097703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:14.097703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:14.097703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 10:01:14.097703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 10:01:14.097703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 10:01:14.097703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 10:01:14.097703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:14.097703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:14.097703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:14.097703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:14.097703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:14.097703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:14.097703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:14.097703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:14.097703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:14.097703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:14.097703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:14.097703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:14.099295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:14.099295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:14.099295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 10:01:14.099295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 10:01:14.099295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 10:01:14.099295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 10:01:14.099295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 10:01:14.099295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 10:01:14.099295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 10:01:14.099295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 10:01:14.099295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 651/1267] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 10:01:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:14.103535 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e2c63-6467-45c3-b19e-8acc4b482ef6 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:14.203342 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e2c63-6467-45c3-b19e-8acc4b482ef6 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:14.237178 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343be68-8f2f-404f-a6b9-b8caaaa7de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:14.238261 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343be68-8f2f-404f-a6b9-b8caaaa7de5d None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:14.238547 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343be68-8f2f-404f-a6b9-b8caaaa7de5d None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:14.238824 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343be68-8f2f-404f-a6b9-b8caaaa7de5d None admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:14.239615 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343be68-8f2f-404f-a6b9-b8caaaa7de5d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:14.239926 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343be68-8f2f-404f-a6b9-b8caaaa7de5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:14.241381 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343be68-8f2f-404f-a6b9-b8caaaa7de5d None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:14.249698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:14.258906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 617/1268] 10.222.0.85 () {56 vars in 1143 bytes} [Tue Aug 2 10:01:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:14.264718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009db3b8-bdaf-46b3-827d-768551d97a1d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:14.370755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009db3b8-bdaf-46b3-827d-768551d97a1d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:14.403263 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29cf03-aad7-4a9d-8733-2e3d325da48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:14.403892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29cf03-aad7-4a9d-8733-2e3d325da48e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:14.404172 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29cf03-aad7-4a9d-8733-2e3d325da48e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:14.404443 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29cf03-aad7-4a9d-8733-2e3d325da48e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:14.418551 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29cf03-aad7-4a9d-8733-2e3d325da48e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:14.420011 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29cf03-aad7-4a9d-8733-2e3d325da48e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:14.434495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-4b29cf03-aad7-4a9d-8733-2e3d325da48e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:01:14.434495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:14.434495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:14.434495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:14.434495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:14.434495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:14.434495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:14.434495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:14.434495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:14.434495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:14.434495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:14.434495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:14.434495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 10:01:14.434495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 10:01:14.434495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 10:01:14.435620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 10:01:14.435620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:14.435620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:14.435620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:14.435620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:14.435620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:14.435620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:14.435620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:14.435620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:14.435620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:14.435620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:14.435620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:14.435620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:14.435620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:14.435620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:14.435620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:14.435620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:14.436838 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 10:01:14.436838 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 10:01:14.436838 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:01:14.436838 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 10:01:14.436838 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 652/1269] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 10:01:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:14.442036 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343be68-8f2f-404f-a6b9-b8caaaa7de5d None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:14.540580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343be68-8f2f-404f-a6b9-b8caaaa7de5d None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:14.574730 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b04ee-136e-40fa-a1b5-d7b20365c563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:14.575270 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b04ee-136e-40fa-a1b5-d7b20365c563 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:14.575553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b04ee-136e-40fa-a1b5-d7b20365c563 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:14.575827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b04ee-136e-40fa-a1b5-d7b20365c563 None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:14.576539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b04ee-136e-40fa-a1b5-d7b20365c563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:14.576845 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b04ee-136e-40fa-a1b5-d7b20365c563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:14.578209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b04ee-136e-40fa-a1b5-d7b20365c563 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:14.589249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 618/1270] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 10:01:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:14.594850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29cf03-aad7-4a9d-8733-2e3d325da48e None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:14.626816 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:14.695149 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29cf03-aad7-4a9d-8733-2e3d325da48e None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:14.728286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca24eaa-30f6-4c36-8ec6-344ad9f560bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:14.728936 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca24eaa-30f6-4c36-8ec6-344ad9f560bc None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:14.729218 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca24eaa-30f6-4c36-8ec6-344ad9f560bc None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:14.729492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca24eaa-30f6-4c36-8ec6-344ad9f560bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:14.735971 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca24eaa-30f6-4c36-8ec6-344ad9f560bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:14.737434 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca24eaa-30f6-4c36-8ec6-344ad9f560bc None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:14.750092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-5ca24eaa-30f6-4c36-8ec6-344ad9f560bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 10:01:14.750092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:14.750092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:14.750092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:14.750092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:14.750092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:14.750092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:14.750092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:14.750092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:14.750092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:14.750092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:14.750092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:14.750092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 10:01:14.750092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 10:01:14.750092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 10:01:14.751183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 10:01:14.751183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:14.751183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:14.751183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:14.751183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:14.751183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:14.751183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:14.751183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:14.751183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:14.751183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:14.751183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:14.751183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:14.751183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:14.751183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:14.751183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:14.751183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:14.751183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:14.752266 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 10:01:14.752266 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 10:01:14.752266 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 10:01:14.752266 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 10:01:14.752266 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 10:01:14.752266 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 10:01:14.752266 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 10:01:14.752266 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 10:01:14.752266 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 653/1271] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 10:01:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:14.757850 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b04ee-136e-40fa-a1b5-d7b20365c563 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:14.817516 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:14.858809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b04ee-136e-40fa-a1b5-d7b20365c563 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:14.894862 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da3065-94d4-4742-b285-6c82028b8cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:14.895589 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da3065-94d4-4742-b285-6c82028b8cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:14.895890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da3065-94d4-4742-b285-6c82028b8cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:14.896238 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da3065-94d4-4742-b285-6c82028b8cf1 None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:14.897151 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da3065-94d4-4742-b285-6c82028b8cf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:14.897537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da3065-94d4-4742-b285-6c82028b8cf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:14.899291 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da3065-94d4-4742-b285-6c82028b8cf1 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:14.914295 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 619/1272] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 10:01:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:14.920488 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca24eaa-30f6-4c36-8ec6-344ad9f560bc None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:15.010670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:15.020353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca24eaa-30f6-4c36-8ec6-344ad9f560bc None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:15.052360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc9ca3-2168-4963-b5c5-4106d05e4572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:15.053024 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc9ca3-2168-4963-b5c5-4106d05e4572 None admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:15.053302 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc9ca3-2168-4963-b5c5-4106d05e4572 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:15.053572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc9ca3-2168-4963-b5c5-4106d05e4572 None admin] PATH_INFO: `/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/a2a420cc676e4f2bb2766826a1de3b41/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:15.055444 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc9ca3-2168-4963-b5c5-4106d05e4572 None admin] RBAC: Authorizing `identity:create_grant(project_id=701d7ad0b7594984885e7bfe8a236937, user_id=a2a420cc676e4f2bb2766826a1de3b41, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:15.056897 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc9ca3-2168-4963-b5c5-4106d05e4572 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:15.069768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 654/1273] 10.222.0.85 () {58 vars in 1439 bytes} [Tue Aug 2 10:01:14 2022] PUT /identity/v3/projects/701d7ad0b7594984885e7bfe8a236937/users/a2a420cc676e4f2bb2766826a1de3b41/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:01:17.061673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7190f-e59f-4fb1-a92a-32125b1cb005 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:17.062234 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7190f-e59f-4fb1-a92a-32125b1cb005 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:17.062234 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7190f-e59f-4fb1-a92a-32125b1cb005 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:17.063571 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 620/1274] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:01:17.069951 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa3232-b7ba-4fb5-920e-a3f8bec2c722 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:17.070382 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa3232-b7ba-4fb5-920e-a3f8bec2c722 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:17.070509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa3232-b7ba-4fb5-920e-a3f8bec2c722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:17.088484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-82aa3232-b7ba-4fb5-920e-a3f8bec2c722 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:01:17.089708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-82aa3232-b7ba-4fb5-920e-a3f8bec2c722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:01:17.154930 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 655/1275] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:01:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 10:01:17.179806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7190f-e59f-4fb1-a92a-32125b1cb005 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:17.279127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7190f-e59f-4fb1-a92a-32125b1cb005 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:17.297069 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:17.314915 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bb287-c3c5-444c-b840-0087f7d4118d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:17.315488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bb287-c3c5-444c-b840-0087f7d4118d None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:17.315776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bb287-c3c5-444c-b840-0087f7d4118d None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:17.316252 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700bb287-c3c5-444c-b840-0087f7d4118d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:17.329535 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700bb287-c3c5-444c-b840-0087f7d4118d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 10:01:17.337511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-700bb287-c3c5-444c-b840-0087f7d4118d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 10:01:17.337511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:17.337511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:17.337511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:17.337511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:17.337511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:17.337511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:17.337511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:17.337511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:17.337511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:17.337511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:17.337511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:17.337511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 10:01:17.337511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 10:01:17.337511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 10:01:17.337511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 10:01:17.338733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 10:01:17.338733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 10:01:17.338733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 10:01:17.338733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 10:01:17.338733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:17.338733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:17.338733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:17.338733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:17.338733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:17.338733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:17.338733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:17.338733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:17.338733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:17.338733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:17.338733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:17.338733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:17.339696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:17.339696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:17.339696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:17.339696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:17.339696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 10:01:17.339696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 10:01:17.339696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 10:01:17.339696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 10:01:17.339696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 10:01:17.339696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 10:01:17.339696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 10:01:17.339696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:01:17.339696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 621/1276] 10.222.0.85 () {56 vars in 1096 bytes} [Tue Aug 2 10:01:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:17.345388 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa3232-b7ba-4fb5-920e-a3f8bec2c722 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:17.426457 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:17.444924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa3232-b7ba-4fb5-920e-a3f8bec2c722 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:17.478963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a170c3-c800-45c6-8e66-36e30c07dd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:17.479576 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a170c3-c800-45c6-8e66-36e30c07dd2b None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:17.479859 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a170c3-c800-45c6-8e66-36e30c07dd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:17.480135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a170c3-c800-45c6-8e66-36e30c07dd2b None admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:17.480879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a170c3-c800-45c6-8e66-36e30c07dd2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:17.481185 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a170c3-c800-45c6-8e66-36e30c07dd2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:17.482540 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a170c3-c800-45c6-8e66-36e30c07dd2b None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:17.490963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 656/1277] 10.222.0.85 () {56 vars in 1099 bytes} [Tue Aug 2 10:01:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:17.496723 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bb287-c3c5-444c-b840-0087f7d4118d None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:17.594231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700bb287-c3c5-444c-b840-0087f7d4118d None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:17.627108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41059aea-7bd2-408f-a5e8-f95e64eb0ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:17.627734 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41059aea-7bd2-408f-a5e8-f95e64eb0ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:17.628020 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41059aea-7bd2-408f-a5e8-f95e64eb0ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:17.628299 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41059aea-7bd2-408f-a5e8-f95e64eb0ef7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:17.638085 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41059aea-7bd2-408f-a5e8-f95e64eb0ef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:17.639529 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41059aea-7bd2-408f-a5e8-f95e64eb0ef7 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:17.654514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-41059aea-7bd2-408f-a5e8-f95e64eb0ef7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:01:17.654514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:17.654514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:17.654514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:17.654514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:17.654514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:17.654514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:17.654514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:17.654514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:17.654514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:17.654514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:17.654514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:17.654514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 10:01:17.654514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 10:01:17.654514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 10:01:17.655597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 10:01:17.655597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:17.655597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:17.655597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:17.655597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:17.655597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:17.655597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:17.655597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:17.655597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:17.655597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:17.655597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:17.655597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:17.655597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:17.655597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:17.655597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:17.655597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:17.655597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:17.656886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 10:01:17.656886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 10:01:17.656886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:01:17.656886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:01:17.656886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 622/1278] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 10:01:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:17.662123 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a170c3-c800-45c6-8e66-36e30c07dd2b None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:17.761496 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a170c3-c800-45c6-8e66-36e30c07dd2b None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:17.793727 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a8f3a-566c-4e87-b14e-d1d651f73c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:17.794328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a8f3a-566c-4e87-b14e-d1d651f73c8d None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:17.794609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a8f3a-566c-4e87-b14e-d1d651f73c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:17.794883 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a8f3a-566c-4e87-b14e-d1d651f73c8d None admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:17.795571 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a8f3a-566c-4e87-b14e-d1d651f73c8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:17.795879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a8f3a-566c-4e87-b14e-d1d651f73c8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:17.797264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a8f3a-566c-4e87-b14e-d1d651f73c8d None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:17.809135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 657/1279] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 10:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:17.814806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41059aea-7bd2-408f-a5e8-f95e64eb0ef7 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:17.845234 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:17.919682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41059aea-7bd2-408f-a5e8-f95e64eb0ef7 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:17.959313 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf1a47-ccc6-40f8-9da6-a212b8f97be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:17.960045 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf1a47-ccc6-40f8-9da6-a212b8f97be4 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:17.960359 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf1a47-ccc6-40f8-9da6-a212b8f97be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:17.960722 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf1a47-ccc6-40f8-9da6-a212b8f97be4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:17.968272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf1a47-ccc6-40f8-9da6-a212b8f97be4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:17.969756 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf1a47-ccc6-40f8-9da6-a212b8f97be4 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:17.981396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-d3cf1a47-ccc6-40f8-9da6-a212b8f97be4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 10:01:17.981396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:17.981396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:17.981396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:17.981396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:17.981396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:17.981396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:17.981396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:17.981396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:17.981396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:17.981396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:17.981396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:17.981396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 10:01:17.981396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 10:01:17.981396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 10:01:17.981396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 10:01:17.982539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:17.982539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:17.982539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 10:01:17.982539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 10:01:17.982539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 10:01:17.982539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 10:01:17.982539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:17.982539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:17.982539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:17.982539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:17.982539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:17.982539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:17.982539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:17.982539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:17.982539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:17.982539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:17.982539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:17.982539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:17.983817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:17.983817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:17.983817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 10:01:17.983817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 10:01:17.983817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 10:01:17.983817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 10:01:17.983817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 10:01:17.983817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 10:01:17.983817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 10:01:17.983817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:01:17.983817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 623/1280] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 10:01:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:17.989195 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a8f3a-566c-4e87-b14e-d1d651f73c8d None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:17.993191 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:18.090194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a8f3a-566c-4e87-b14e-d1d651f73c8d None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:18.123269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9605456-a3e3-4677-9e5e-ac821e27c8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:18.123794 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9605456-a3e3-4677-9e5e-ac821e27c8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:18.124076 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9605456-a3e3-4677-9e5e-ac821e27c8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:18.124350 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9605456-a3e3-4677-9e5e-ac821e27c8e7 None admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:18.125163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9605456-a3e3-4677-9e5e-ac821e27c8e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:18.125471 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9605456-a3e3-4677-9e5e-ac821e27c8e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:18.126881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9605456-a3e3-4677-9e5e-ac821e27c8e7 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:18.145205 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 658/1281] 10.222.0.85 () {56 vars in 1143 bytes} [Tue Aug 2 10:01:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:18.150860 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf1a47-ccc6-40f8-9da6-a212b8f97be4 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:18.241419 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:18.251191 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf1a47-ccc6-40f8-9da6-a212b8f97be4 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:18.285788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963aeea-16db-4f00-8eff-12be9305cf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:18.286397 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963aeea-16db-4f00-8eff-12be9305cf40 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:18.286679 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963aeea-16db-4f00-8eff-12be9305cf40 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:18.286961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963aeea-16db-4f00-8eff-12be9305cf40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:18.352904 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963aeea-16db-4f00-8eff-12be9305cf40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:18.354349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963aeea-16db-4f00-8eff-12be9305cf40 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:18.458332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:18.468818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 624/1282] 10.222.0.85 () {58 vars in 1282 bytes} [Tue Aug 2 10:01:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 10:01:18.476019 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9605456-a3e3-4677-9e5e-ac821e27c8e7 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:18.538784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:18.576571 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9605456-a3e3-4677-9e5e-ac821e27c8e7 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:18.611303 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7138dc-45db-4c47-ba87-84e411d02da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:18.611927 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7138dc-45db-4c47-ba87-84e411d02da0 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:18.612207 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7138dc-45db-4c47-ba87-84e411d02da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:18.612498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7138dc-45db-4c47-ba87-84e411d02da0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:18.622943 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7138dc-45db-4c47-ba87-84e411d02da0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:18.624377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7138dc-45db-4c47-ba87-84e411d02da0 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:18.639586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-8a7138dc-45db-4c47-ba87-84e411d02da0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:01:18.639586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:18.639586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:18.639586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:18.639586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:18.639586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:18.639586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:18.639586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:18.639586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:18.639586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:18.639586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:18.639586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:18.639586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 10:01:18.639586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 10:01:18.639586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 10:01:18.640687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 10:01:18.640687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:18.640687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:18.640687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:18.640687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:18.640687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:18.640687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:18.640687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:18.640687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:18.640687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:18.640687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:18.640687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:18.640687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:18.640687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:18.640687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:18.640687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:18.640687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:18.641797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 10:01:18.641797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 10:01:18.641797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 10:01:18.641797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 10:01:18.641797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 659/1283] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 10:01:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:18.648736 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963aeea-16db-4f00-8eff-12be9305cf40 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:18.764855 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963aeea-16db-4f00-8eff-12be9305cf40 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:18.803798 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf3cef-edeb-4fcc-8ec9-70471429066d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:18.804405 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf3cef-edeb-4fcc-8ec9-70471429066d None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:18.804715 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf3cef-edeb-4fcc-8ec9-70471429066d None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:18.804991 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf3cef-edeb-4fcc-8ec9-70471429066d None admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:18.805673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf3cef-edeb-4fcc-8ec9-70471429066d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:18.805977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf3cef-edeb-4fcc-8ec9-70471429066d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:18.807329 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf3cef-edeb-4fcc-8ec9-70471429066d None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:18.818778 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 625/1284] 10.222.0.85 () {56 vars in 1109 bytes} [Tue Aug 2 10:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:18.824865 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7138dc-45db-4c47-ba87-84e411d02da0 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:18.927662 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7138dc-45db-4c47-ba87-84e411d02da0 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:18.940674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:18.962569 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf032da5-dde1-4034-a1fe-424e77747693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:18.963200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf032da5-dde1-4034-a1fe-424e77747693 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:18.963484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf032da5-dde1-4034-a1fe-424e77747693 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:18.963767 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf032da5-dde1-4034-a1fe-424e77747693 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:18.970279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf032da5-dde1-4034-a1fe-424e77747693 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:18.971717 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf032da5-dde1-4034-a1fe-424e77747693 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:18.983105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application [None req-bf032da5-dde1-4034-a1fe-424e77747693 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 10:01:18.983105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:18.983105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:18.983105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:18.983105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:18.983105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:18.983105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:18.983105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:18.983105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:18.983105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:18.983105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:18.983105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:18.983105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 10:01:18.983105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 10:01:18.983105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 10:01:18.984184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 10:01:18.984184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:18.984184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:18.984184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:18.984184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:18.984184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:18.984184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:18.984184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:18.984184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:18.984184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:18.984184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:18.984184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:18.984184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:18.984184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:18.984184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:18.984184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:18.984184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:18.985141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 10:01:18.985141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 10:01:18.985141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 10:01:18.985141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 10:01:18.985141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 10:01:18.985141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 10:01:18.985141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 10:01:18.985141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: ERROR keystone.server.flask.application Aug 02 10:01:18.985141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 660/1285] 10.222.0.85 () {56 vars in 1111 bytes} [Tue Aug 2 10:01:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:18.991229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf3cef-edeb-4fcc-8ec9-70471429066d None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:19.041630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:19.091806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf3cef-edeb-4fcc-8ec9-70471429066d None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:19.137138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b440c-f448-4410-aadf-97faee1442f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:19.138207 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b440c-f448-4410-aadf-97faee1442f3 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:19.138728 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b440c-f448-4410-aadf-97faee1442f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:19.139222 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b440c-f448-4410-aadf-97faee1442f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:19.140663 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b440c-f448-4410-aadf-97faee1442f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:19.141233 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b440c-f448-4410-aadf-97faee1442f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:19.144104 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b440c-f448-4410-aadf-97faee1442f3 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:19.158687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 626/1286] 10.222.0.85 () {56 vars in 1148 bytes} [Tue Aug 2 10:01:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:19.164924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf032da5-dde1-4034-a1fe-424e77747693 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:19.267310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf032da5-dde1-4034-a1fe-424e77747693 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:19.302454 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fecc61d-5e64-4ae6-824e-d2755dfb8187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:19.303065 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecc61d-5e64-4ae6-824e-d2755dfb8187 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:19.303347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecc61d-5e64-4ae6-824e-d2755dfb8187 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:19.303623 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fecc61d-5e64-4ae6-824e-d2755dfb8187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:19.304423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecc61d-5e64-4ae6-824e-d2755dfb8187 None admin] RBAC: Adding query filter params (role.id=c15ca78eb3c9472f94e15e2d28c7f403, scope.project.id=701d7ad0b7594984885e7bfe8a236937, user.id=a2a420cc676e4f2bb2766826a1de3b41) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:19.304768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecc61d-5e64-4ae6-824e-d2755dfb8187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:19.306196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fecc61d-5e64-4ae6-824e-d2755dfb8187 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:19.311942 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 661/1287] 10.222.0.85 () {56 vars in 1374 bytes} [Tue Aug 2 10:01:19 2022] GET /identity/v3/role_assignments?user.id=a2a420cc676e4f2bb2766826a1de3b41&scope.project.id=701d7ad0b7594984885e7bfe8a236937&role.id=c15ca78eb3c9472f94e15e2d28c7f403 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:21.341787 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608d73b-0f73-4da7-9950-6f60068313cc None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:21.342337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608d73b-0f73-4da7-9950-6f60068313cc None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:21.342337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608d73b-0f73-4da7-9950-6f60068313cc None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:21.343670 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 627/1288] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:01:21.349957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626957d-3469-4bd7-be3b-42a89f98db41 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:21.350516 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626957d-3469-4bd7-be3b-42a89f98db41 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:21.350797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626957d-3469-4bd7-be3b-42a89f98db41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:21.371964 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4626957d-3469-4bd7-be3b-42a89f98db41 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:01:21.373193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4626957d-3469-4bd7-be3b-42a89f98db41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:01:21.410581 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:21.458925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 662/1289] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:01:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 10:01:21.485944 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608d73b-0f73-4da7-9950-6f60068313cc None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:21.629884 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608d73b-0f73-4da7-9950-6f60068313cc None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:21.641835 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:21.669621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78cfee-fe4c-49ee-94f4-ee66a912f72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:21.670256 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78cfee-fe4c-49ee-94f4-ee66a912f72d None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:21.670539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78cfee-fe4c-49ee-94f4-ee66a912f72d None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:21.670811 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78cfee-fe4c-49ee-94f4-ee66a912f72d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:21.671434 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78cfee-fe4c-49ee-94f4-ee66a912f72d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:21.672820 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78cfee-fe4c-49ee-94f4-ee66a912f72d None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:21.683868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-ac78cfee-fe4c-49ee-94f4-ee66a912f72d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 10:01:21.683868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:21.683868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 10:01:21.683868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 10:01:21.683868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 10:01:21.683868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 10:01:21.683868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 10:01:21.683868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 10:01:21.683868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 10:01:21.683868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:01:21.683868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 10:01:21.683868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:01:21.683868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:21.683868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:21.683868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:21.683868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:21.683868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:21.685185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:21.685185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:21.685185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:21.685185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:21.685185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:21.685185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:21.685185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 10:01:21.685185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 10:01:21.685185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 10:01:21.685185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 10:01:21.685185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:21.685185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:21.685185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:21.685185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:21.685185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:21.685185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:21.686042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:21.686042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:21.686042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:21.686042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:21.686042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:21.686042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:21.686042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:21.686042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:21.686042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:21.686042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:21.686042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 10:01:21.686042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 10:01:21.686042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 10:01:21.686042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:01:21.686042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 628/1290] 10.222.0.85 () {56 vars in 1117 bytes} [Tue Aug 2 10:01:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:21.692031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626957d-3469-4bd7-be3b-42a89f98db41 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:21.813307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626957d-3469-4bd7-be3b-42a89f98db41 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:21.848943 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602e78e-b9f8-469c-b925-f7db237c00d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:21.849559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602e78e-b9f8-469c-b925-f7db237c00d5 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:21.849841 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602e78e-b9f8-469c-b925-f7db237c00d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:21.850119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602e78e-b9f8-469c-b925-f7db237c00d5 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:21.850799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602e78e-b9f8-469c-b925-f7db237c00d5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:21.851107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602e78e-b9f8-469c-b925-f7db237c00d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:21.852494 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602e78e-b9f8-469c-b925-f7db237c00d5 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:21.857742 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 663/1291] 10.222.0.85 () {56 vars in 1116 bytes} [Tue Aug 2 10:01:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:21.864722 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78cfee-fe4c-49ee-94f4-ee66a912f72d None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:21.996671 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78cfee-fe4c-49ee-94f4-ee66a912f72d None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:22.035548 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c38a5-d4cd-45fa-b1e5-375109d5ce49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:22.036159 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c38a5-d4cd-45fa-b1e5-375109d5ce49 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:22.036542 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c38a5-d4cd-45fa-b1e5-375109d5ce49 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:22.036817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c38a5-d4cd-45fa-b1e5-375109d5ce49 None admin] PATH_INFO: `/v3/services` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:22.037497 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c38a5-d4cd-45fa-b1e5-375109d5ce49 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:22.037800 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c38a5-d4cd-45fa-b1e5-375109d5ce49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:22.039154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c38a5-d4cd-45fa-b1e5-375109d5ce49 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:22.043937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 629/1292] 10.222.0.85 () {56 vars in 1116 bytes} [Tue Aug 2 10:01:21 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:24.057873 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8a426-0089-4b95-b9c5-60dd1a1f5ba1 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:24.058430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8a426-0089-4b95-b9c5-60dd1a1f5ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:24.058430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff8a426-0089-4b95-b9c5-60dd1a1f5ba1 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:24.059752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 664/1293] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:01:24.064790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fe9e7-df10-4a21-9b54-6ba3ae4d4679 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:24.065221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fe9e7-df10-4a21-9b54-6ba3ae4d4679 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:24.065355 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fe9e7-df10-4a21-9b54-6ba3ae4d4679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:24.083770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-0d7fe9e7-df10-4a21-9b54-6ba3ae4d4679 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:01:24.085085 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-0d7fe9e7-df10-4a21-9b54-6ba3ae4d4679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:01:24.116559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:24.156233 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 630/1294] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:01:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 10:01:24.181123 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8a426-0089-4b95-b9c5-60dd1a1f5ba1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:24.212032 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:24.281528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff8a426-0089-4b95-b9c5-60dd1a1f5ba1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:24.314977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cea27-c8a0-44ba-8a50-bf68a5afe3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:24.315524 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cea27-c8a0-44ba-8a50-bf68a5afe3c6 None admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:24.315800 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cea27-c8a0-44ba-8a50-bf68a5afe3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:24.316071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cea27-c8a0-44ba-8a50-bf68a5afe3c6 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:24.317357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45cea27-c8a0-44ba-8a50-bf68a5afe3c6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:24.318760 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45cea27-c8a0-44ba-8a50-bf68a5afe3c6 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:24.333528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 665/1295] 10.222.0.85 () {60 vars in 1141 bytes} [Tue Aug 2 10:01:24 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:01:26.377888 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a839fe-2379-4b2a-b0d6-7ba4cfb220d5 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:26.378413 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a839fe-2379-4b2a-b0d6-7ba4cfb220d5 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:26.378504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a839fe-2379-4b2a-b0d6-7ba4cfb220d5 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:26.380030 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 631/1296] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:01:26.385181 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8afed2-562b-4e61-8bc7-7f433546314d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:26.385601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8afed2-562b-4e61-8bc7-7f433546314d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:26.385740 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8afed2-562b-4e61-8bc7-7f433546314d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:26.404098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ea8afed2-562b-4e61-8bc7-7f433546314d None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:01:26.405312 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ea8afed2-562b-4e61-8bc7-7f433546314d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:01:26.477647 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 666/1297] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:01:26 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 10:01:26.500391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a839fe-2379-4b2a-b0d6-7ba4cfb220d5 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:26.599996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a839fe-2379-4b2a-b0d6-7ba4cfb220d5 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:26.634254 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee3f3f-1d68-4844-8b6e-b604b450b57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:26.634885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee3f3f-1d68-4844-8b6e-b604b450b57a None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:26.635169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee3f3f-1d68-4844-8b6e-b604b450b57a None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:26.635445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee3f3f-1d68-4844-8b6e-b604b450b57a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:26.636076 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee3f3f-1d68-4844-8b6e-b604b450b57a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:26.637476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee3f3f-1d68-4844-8b6e-b604b450b57a None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:26.646750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-9dee3f3f-1d68-4844-8b6e-b604b450b57a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 10:01:26.646750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:26.646750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 10:01:26.646750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 10:01:26.646750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 10:01:26.646750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 10:01:26.646750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 10:01:26.646750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 10:01:26.646750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 10:01:26.646750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:01:26.646750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 10:01:26.646750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:01:26.646750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:26.646750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:26.646750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:26.646750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:26.646750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:26.647920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:26.647920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:26.647920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:26.647920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:26.647920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:26.647920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:26.647920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 10:01:26.647920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 10:01:26.647920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 10:01:26.647920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 10:01:26.647920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:26.647920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:26.647920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:26.647920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:26.647920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:26.647920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:26.649135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:26.649135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:26.649135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:26.649135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:26.649135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:26.649135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:26.649135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:26.649135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:26.649135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:26.649135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:26.649135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 10:01:26.649135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 10:01:26.649135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 10:01:26.649135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:01:26.649135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 632/1298] 10.222.0.85 () {56 vars in 1117 bytes} [Tue Aug 2 10:01:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:26.653892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8afed2-562b-4e61-8bc7-7f433546314d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:26.672477 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:26.752991 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8afed2-562b-4e61-8bc7-7f433546314d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:26.786950 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9ecda-44ba-4235-ba57-2580f4dd8e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:26.787435 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9ecda-44ba-4235-ba57-2580f4dd8e47 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:26.787714 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9ecda-44ba-4235-ba57-2580f4dd8e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:26.787984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a9ecda-44ba-4235-ba57-2580f4dd8e47 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:26.788680 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9ecda-44ba-4235-ba57-2580f4dd8e47 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:26.788985 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9ecda-44ba-4235-ba57-2580f4dd8e47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:26.790343 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a9ecda-44ba-4235-ba57-2580f4dd8e47 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:26.795334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 667/1299] 10.222.0.85 () {56 vars in 1116 bytes} [Tue Aug 2 10:01:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:26.801306 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee3f3f-1d68-4844-8b6e-b604b450b57a None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:26.833229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:26.905333 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee3f3f-1d68-4844-8b6e-b604b450b57a None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:26.938639 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4fbce-ccad-41c6-ad39-6281cfbf5a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:26.939239 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4fbce-ccad-41c6-ad39-6281cfbf5a92 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:26.939519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4fbce-ccad-41c6-ad39-6281cfbf5a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:26.939795 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4fbce-ccad-41c6-ad39-6281cfbf5a92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:26.940565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4fbce-ccad-41c6-ad39-6281cfbf5a92 None admin] RBAC: Adding query filter params (interface=public, service_id=daaea9bd36ba4b6e8d9699994795e842, region_id=RegionOne) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:26.940875 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4fbce-ccad-41c6-ad39-6281cfbf5a92 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:26.942300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4fbce-ccad-41c6-ad39-6281cfbf5a92 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:26.947146 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 633/1300] 10.222.0.85 () {56 vars in 1251 bytes} [Tue Aug 2 10:01:26 2022] GET /identity/v3/endpoints?service_id=daaea9bd36ba4b6e8d9699994795e842&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:26.953010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9ecda-44ba-4235-ba57-2580f4dd8e47 None admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:27.033574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:27.053120 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a9ecda-44ba-4235-ba57-2580f4dd8e47 None admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:27.089547 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b304cab-25f8-4693-b36b-8e05fc6eaf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:27.090155 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b304cab-25f8-4693-b36b-8e05fc6eaf2e None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:27.090436 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b304cab-25f8-4693-b36b-8e05fc6eaf2e None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:27.090711 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b304cab-25f8-4693-b36b-8e05fc6eaf2e None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:27.091363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b304cab-25f8-4693-b36b-8e05fc6eaf2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:27.092746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b304cab-25f8-4693-b36b-8e05fc6eaf2e None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:27.100451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 668/1301] 10.222.0.85 () {56 vars in 1087 bytes} [Tue Aug 2 10:01:26 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:01:29.072738 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec43e2-264e-4831-bbb7-ac9804d530c5 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:29.073302 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec43e2-264e-4831-bbb7-ac9804d530c5 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:29.073302 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec43e2-264e-4831-bbb7-ac9804d530c5 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:29.074640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 634/1302] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:01:29.079672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662d1a3-fbad-45e5-ad27-304e18dd45d9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:29.080163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662d1a3-fbad-45e5-ad27-304e18dd45d9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:29.080264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662d1a3-fbad-45e5-ad27-304e18dd45d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:29.098371 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1662d1a3-fbad-45e5-ad27-304e18dd45d9 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:01:29.099567 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1662d1a3-fbad-45e5-ad27-304e18dd45d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:01:29.165529 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 669/1303] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:01:29 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 10:01:29.187686 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec43e2-264e-4831-bbb7-ac9804d530c5 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:29.282093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:29.289617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec43e2-264e-4831-bbb7-ac9804d530c5 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:29.323995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b735367-2dc6-4de1-8517-bd71adb79cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:29.324600 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b735367-2dc6-4de1-8517-bd71adb79cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:29.324889 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b735367-2dc6-4de1-8517-bd71adb79cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:29.325169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b735367-2dc6-4de1-8517-bd71adb79cc5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:29.325797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b735367-2dc6-4de1-8517-bd71adb79cc5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:29.327161 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b735367-2dc6-4de1-8517-bd71adb79cc5 None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:29.336001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application [None req-9b735367-2dc6-4de1-8517-bd71adb79cc5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 10:01:29.336001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:29.336001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 10:01:29.336001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 10:01:29.336001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 10:01:29.336001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 10:01:29.336001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 10:01:29.336001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 10:01:29.336001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 10:01:29.336001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:01:29.336001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 10:01:29.336001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:01:29.336001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 10:01:29.336001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 10:01:29.336001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 10:01:29.336001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 10:01:29.336001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 10:01:29.337221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 10:01:29.337221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 10:01:29.337221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 10:01:29.337221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 10:01:29.337221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 10:01:29.337221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 10:01:29.337221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 10:01:29.337221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 10:01:29.337221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 10:01:29.337221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 10:01:29.337221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 10:01:29.337221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 10:01:29.337221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 10:01:29.337221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 10:01:29.337221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 10:01:29.337221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 10:01:29.338134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 10:01:29.338134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application with Lock( Aug 02 10:01:29.338134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 10:01:29.338134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self._enter() Aug 02 10:01:29.338134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 10:01:29.338134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 10:01:29.338134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 10:01:29.338134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application return self.creator() Aug 02 10:01:29.338134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 10:01:29.338134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application created_value = creator( Aug 02 10:01:29.338134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 10:01:29.338134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 10:01:29.338134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 10:01:29.338134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: ERROR keystone.server.flask.application Aug 02 10:01:29.338134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 635/1304] 10.222.0.85 () {56 vars in 1117 bytes} [Tue Aug 2 10:01:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 10:01:29.343218 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662d1a3-fbad-45e5-ad27-304e18dd45d9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:29.419397 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:29.444036 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662d1a3-fbad-45e5-ad27-304e18dd45d9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:29.478128 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ff5d7-5284-40a3-b393-a14ff01722b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:29.478730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ff5d7-5284-40a3-b393-a14ff01722b1 None admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:29.479013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ff5d7-5284-40a3-b393-a14ff01722b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:29.479286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ff5d7-5284-40a3-b393-a14ff01722b1 None admin] PATH_INFO: `/v3/services` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:29.479960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ff5d7-5284-40a3-b393-a14ff01722b1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:01:29.480264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ff5d7-5284-40a3-b393-a14ff01722b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:29.481667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ff5d7-5284-40a3-b393-a14ff01722b1 None admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:29.486701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 670/1305] 10.222.0.85 () {56 vars in 1116 bytes} [Tue Aug 2 10:01:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:01:29.493389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b735367-2dc6-4de1-8517-bd71adb79cc5 None admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:01:29.602085 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b735367-2dc6-4de1-8517-bd71adb79cc5 None admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:01:29.643103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53789a9-5e73-4541-94ca-3c4e19d80fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:01:29.643970 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53789a9-5e73-4541-94ca-3c4e19d80fca None admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:01:29.644256 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53789a9-5e73-4541-94ca-3c4e19d80fca None admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:01:29.644708 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53789a9-5e73-4541-94ca-3c4e19d80fca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:01:29.645802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53789a9-5e73-4541-94ca-3c4e19d80fca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:01:29.647930 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53789a9-5e73-4541-94ca-3c4e19d80fca None admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:01:29.669900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 636/1306] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:01:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:01:39.483705 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=30 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:01:39.666004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:02:32.904187 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ad6a-5ee9-40c2-bae8-c53aaae6426f None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:32.905495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ad6a-5ee9-40c2-bae8-c53aaae6426f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:32.905991 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8ad6a-5ee9-40c2-bae8-c53aaae6426f None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:32.911443 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 671/1307] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:02:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:02:32.912856 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b8437-ba8c-4e3f-a468-6b6dc7cf97e4 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:32.913272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b8437-ba8c-4e3f-a468-6b6dc7cf97e4 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:32.913479 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b8437-ba8c-4e3f-a468-6b6dc7cf97e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:32.996672 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-732b8437-ba8c-4e3f-a468-6b6dc7cf97e4 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:02:32.997904 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-732b8437-ba8c-4e3f-a468-6b6dc7cf97e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:33.114733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 637/1308] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:02:33.177530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64525bd0-1433-4d0b-8b86-d70ab47ce834 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:33.177813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64525bd0-1433-4d0b-8b86-d70ab47ce834 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:33.178096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64525bd0-1433-4d0b-8b86-d70ab47ce834 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:33.179746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 672/1309] 10.222.0.85 () {54 vars in 965 bytes} [Tue Aug 2 10:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:02:33.187624 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4694d-34de-4925-b311-4aa0311efb19 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:33.187923 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4694d-34de-4925-b311-4aa0311efb19 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:33.188206 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4694d-34de-4925-b311-4aa0311efb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:33.320630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-d3b4694d-34de-4925-b311-4aa0311efb19 None None] MFA Rules not processed for user `828eb58cdce44ca8827f1ce2be7c19d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:02:33.321858 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-d3b4694d-34de-4925-b311-4aa0311efb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:33.358102 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:02:33.457576 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 638/1310] 10.222.0.85 () {58 vars in 1062 bytes} [Tue Aug 2 10:02:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:02:33.458291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64525bd0-1433-4d0b-8b86-d70ab47ce834 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:02:33.460287 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-64525bd0-1433-4d0b-8b86-d70ab47ce834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:33.598788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64525bd0-1433-4d0b-8b86-d70ab47ce834 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:02:33.684008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f56c2-ba97-49f3-9fc0-5b9f2080b0cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:02:33.684552 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f56c2-ba97-49f3-9fc0-5b9f2080b0cf service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:33.684835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f56c2-ba97-49f3-9fc0-5b9f2080b0cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:33.685111 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f56c2-ba97-49f3-9fc0-5b9f2080b0cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:33.686982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-879f56c2-ba97-49f3-9fc0-5b9f2080b0cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:33.750510 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:02:33.819549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f56c2-ba97-49f3-9fc0-5b9f2080b0cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:02:33.821102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f56c2-ba97-49f3-9fc0-5b9f2080b0cf service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:02:33.846004 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 673/1311] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:02:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:02:36.284325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b6505-736c-4a0a-925b-1a1148f75ceb None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:36.284912 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b6505-736c-4a0a-925b-1a1148f75ceb None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:36.284912 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b6505-736c-4a0a-925b-1a1148f75ceb None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:36.286304 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 639/1312] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:02:36.298240 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3067f-f8cd-48fc-b52c-dd325e1f61c2 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:36.298240 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3067f-f8cd-48fc-b52c-dd325e1f61c2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:36.298240 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3067f-f8cd-48fc-b52c-dd325e1f61c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:36.390195 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-77f3067f-f8cd-48fc-b52c-dd325e1f61c2 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:02:36.391459 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-77f3067f-f8cd-48fc-b52c-dd325e1f61c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:36.498163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 674/1313] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:02:36.550986 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adcb0e-f97d-4f50-8bc5-48af0c5a1e31 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:36.551291 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adcb0e-f97d-4f50-8bc5-48af0c5a1e31 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:36.551643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22adcb0e-f97d-4f50-8bc5-48af0c5a1e31 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:36.553128 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 640/1314] 10.222.0.85 () {54 vars in 965 bytes} [Tue Aug 2 10:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:02:36.560086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4d24f-9b2b-4fbb-aafd-10c0818cf3e8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:36.560384 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4d24f-9b2b-4fbb-aafd-10c0818cf3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:36.560693 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4d24f-9b2b-4fbb-aafd-10c0818cf3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:36.573018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:02:36.640273 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1ec4d24f-9b2b-4fbb-aafd-10c0818cf3e8 None None] MFA Rules not processed for user `828eb58cdce44ca8827f1ce2be7c19d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:02:36.641511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1ec4d24f-9b2b-4fbb-aafd-10c0818cf3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:36.720821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 675/1315] 10.222.0.85 () {58 vars in 1062 bytes} [Tue Aug 2 10:02:36 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:02:36.729640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adcb0e-f97d-4f50-8bc5-48af0c5a1e31 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:02:36.731483 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-22adcb0e-f97d-4f50-8bc5-48af0c5a1e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:36.836642 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22adcb0e-f97d-4f50-8bc5-48af0c5a1e31 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:02:36.905900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:02:36.908210 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed744f-eaa4-418e-94c8-ebd610c93834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:02:36.908887 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed744f-eaa4-418e-94c8-ebd610c93834 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:36.909445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed744f-eaa4-418e-94c8-ebd610c93834 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:36.909893 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed744f-eaa4-418e-94c8-ebd610c93834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:36.911784 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-c5ed744f-eaa4-418e-94c8-ebd610c93834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:37.021573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed744f-eaa4-418e-94c8-ebd610c93834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:02:37.023019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed744f-eaa4-418e-94c8-ebd610c93834 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:02:37.041359 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 641/1316] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:02:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:02:39.609509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec042e60-f833-4a65-850b-a3d8a3735ba5 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:39.610030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec042e60-f833-4a65-850b-a3d8a3735ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:39.610030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec042e60-f833-4a65-850b-a3d8a3735ba5 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:39.611338 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 676/1317] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:02:39.616383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b208f6a-be97-452f-831f-10f651f661e4 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:39.616798 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b208f6a-be97-452f-831f-10f651f661e4 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:39.616956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b208f6a-be97-452f-831f-10f651f661e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:39.681634 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-8b208f6a-be97-452f-831f-10f651f661e4 None None] MFA Rules not processed for user `931bf62912bf4be1b0054eaf8b68847c`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:02:39.682829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-8b208f6a-be97-452f-831f-10f651f661e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:39.733751 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:02:39.778877 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 642/1318] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:02:39 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:02:39.819934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec042e60-f833-4a65-850b-a3d8a3735ba5 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:02:39.821504 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ec042e60-f833-4a65-850b-a3d8a3735ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:39.930751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec042e60-f833-4a65-850b-a3d8a3735ba5 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:02:39.934545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:02:40.008388 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512c719-327f-4664-95e2-5aa9d693c92f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:02:40.009031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c719-327f-4664-95e2-5aa9d693c92f service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:40.009311 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c719-327f-4664-95e2-5aa9d693c92f service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:40.009583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512c719-327f-4664-95e2-5aa9d693c92f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:40.011235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f512c719-327f-4664-95e2-5aa9d693c92f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:40.119532 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512c719-327f-4664-95e2-5aa9d693c92f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:02:40.121725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512c719-327f-4664-95e2-5aa9d693c92f service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:02:40.140384 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 677/1319] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:02:39 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:02:42.920172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701caf0-fbf6-4f06-a1c3-ed705e7f9338 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:42.920730 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701caf0-fbf6-4f06-a1c3-ed705e7f9338 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:42.920730 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701caf0-fbf6-4f06-a1c3-ed705e7f9338 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:42.922163 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 643/1320] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:02:42.927264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684ccf0-a9ed-4245-be93-2ed56401ada9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:42.927671 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684ccf0-a9ed-4245-be93-2ed56401ada9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:42.927822 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684ccf0-a9ed-4245-be93-2ed56401ada9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:42.969306 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:02:42.995016 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d684ccf0-a9ed-4245-be93-2ed56401ada9 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:02:42.996855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d684ccf0-a9ed-4245-be93-2ed56401ada9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:43.093056 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 678/1321] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:02:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:02:43.132183 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701caf0-fbf6-4f06-a1c3-ed705e7f9338 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:02:43.133747 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-c701caf0-fbf6-4f06-a1c3-ed705e7f9338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:43.235463 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701caf0-fbf6-4f06-a1c3-ed705e7f9338 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:02:43.306439 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d25515-c570-4acf-9eef-a74e5c2d36b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:02:43.307050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d25515-c570-4acf-9eef-a74e5c2d36b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:43.307330 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d25515-c570-4acf-9eef-a74e5c2d36b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:43.307601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d25515-c570-4acf-9eef-a74e5c2d36b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:43.310088 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-49d25515-c570-4acf-9eef-a74e5c2d36b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:43.318415 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:02:43.420443 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d25515-c570-4acf-9eef-a74e5c2d36b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:02:43.421905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d25515-c570-4acf-9eef-a74e5c2d36b9 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:02:43.439723 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 644/1322] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:02:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:02:46.158597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c060b0-1179-449e-918c-47c32aeafcc4 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:46.159174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c060b0-1179-449e-918c-47c32aeafcc4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:46.159174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c060b0-1179-449e-918c-47c32aeafcc4 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:46.160533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 679/1323] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:02:46.165751 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d9010-7d62-4b9e-90f1-dab5ddf2418a None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:46.166135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d9010-7d62-4b9e-90f1-dab5ddf2418a None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:46.166316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d9010-7d62-4b9e-90f1-dab5ddf2418a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:46.232982 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-0d6d9010-7d62-4b9e-90f1-dab5ddf2418a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:02:46.234215 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-0d6d9010-7d62-4b9e-90f1-dab5ddf2418a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:46.299299 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:02:46.344099 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 645/1324] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:02:46.381564 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c060b0-1179-449e-918c-47c32aeafcc4 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:02:46.383119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a5c060b0-1179-449e-918c-47c32aeafcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:46.494330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c060b0-1179-449e-918c-47c32aeafcc4 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:02:46.507489 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:02:46.583096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b274da-4fd1-42ed-8fc9-ab7036168cf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:02:46.583843 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b274da-4fd1-42ed-8fc9-ab7036168cf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:46.584127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b274da-4fd1-42ed-8fc9-ab7036168cf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:46.584409 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b274da-4fd1-42ed-8fc9-ab7036168cf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:46.586112 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d9b274da-4fd1-42ed-8fc9-ab7036168cf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:46.716327 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b274da-4fd1-42ed-8fc9-ab7036168cf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:02:46.717826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b274da-4fd1-42ed-8fc9-ab7036168cf3 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:02:46.737090 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 680/1325] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:02:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:02:48.805980 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b591f0-4156-45cd-8340-bc9aa7d51b43 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:48.806538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b591f0-4156-45cd-8340-bc9aa7d51b43 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:48.806538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b591f0-4156-45cd-8340-bc9aa7d51b43 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:48.807812 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 646/1326] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:02:48.813736 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bd953-5abb-4d32-87b9-2af37caa6632 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:48.814148 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bd953-5abb-4d32-87b9-2af37caa6632 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:48.814425 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bd953-5abb-4d32-87b9-2af37caa6632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:48.862703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:02:48.881125 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-501bd953-5abb-4d32-87b9-2af37caa6632 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:02:48.882317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-501bd953-5abb-4d32-87b9-2af37caa6632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:48.980525 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 681/1327] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:02:49.017183 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b591f0-4156-45cd-8340-bc9aa7d51b43 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:02:49.018751 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-79b591f0-4156-45cd-8340-bc9aa7d51b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:49.122091 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b591f0-4156-45cd-8340-bc9aa7d51b43 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:02:49.195150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd716aa-3da4-4b7b-914e-7309eb223e49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:02:49.195777 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd716aa-3da4-4b7b-914e-7309eb223e49 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:49.196059 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd716aa-3da4-4b7b-914e-7309eb223e49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:49.196334 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd716aa-3da4-4b7b-914e-7309eb223e49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:49.198093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-1fd716aa-3da4-4b7b-914e-7309eb223e49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:49.219315 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:02:49.320546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd716aa-3da4-4b7b-914e-7309eb223e49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:02:49.321985 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd716aa-3da4-4b7b-914e-7309eb223e49 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:02:49.341519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 647/1328] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:02:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:02:51.442888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a54243-2514-4392-a4e6-9f7acb24d5a8 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:51.443442 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a54243-2514-4392-a4e6-9f7acb24d5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:51.443442 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a54243-2514-4392-a4e6-9f7acb24d5a8 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:51.444839 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 682/1329] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:02:51.450022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083e70f-4ea8-41f2-a0fd-818a54712dd5 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:51.450498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083e70f-4ea8-41f2-a0fd-818a54712dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:51.450719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083e70f-4ea8-41f2-a0fd-818a54712dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:51.519820 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-4083e70f-4ea8-41f2-a0fd-818a54712dd5 None None] MFA Rules not processed for user `931bf62912bf4be1b0054eaf8b68847c`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:02:51.521221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4083e70f-4ea8-41f2-a0fd-818a54712dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:51.596496 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:02:51.632360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 648/1330] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:02:51 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:02:51.672990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a54243-2514-4392-a4e6-9f7acb24d5a8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:02:51.674631 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-35a54243-2514-4392-a4e6-9f7acb24d5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:51.790724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a54243-2514-4392-a4e6-9f7acb24d5a8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:02:51.811046 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:02:51.866302 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460a540-b0b6-4bd4-b0d7-e9052a591e99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:02:51.866838 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460a540-b0b6-4bd4-b0d7-e9052a591e99 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:51.867123 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460a540-b0b6-4bd4-b0d7-e9052a591e99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:51.867398 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460a540-b0b6-4bd4-b0d7-e9052a591e99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:51.869100 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6460a540-b0b6-4bd4-b0d7-e9052a591e99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:51.980723 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460a540-b0b6-4bd4-b0d7-e9052a591e99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:02:51.982193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460a540-b0b6-4bd4-b0d7-e9052a591e99 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:02:52.000737 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 683/1331] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:02:51 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:02:54.281738 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbe26d-4673-4b1a-8659-786598194c75 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:54.282273 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbe26d-4673-4b1a-8659-786598194c75 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:54.282273 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbe26d-4673-4b1a-8659-786598194c75 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:54.283644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 649/1332] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:02:54.288768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03afcb-7978-4ba5-a7b7-3f4dca6c232f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:54.289174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03afcb-7978-4ba5-a7b7-3f4dca6c232f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:54.289320 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03afcb-7978-4ba5-a7b7-3f4dca6c232f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:54.351974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:02:54.355111 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2f03afcb-7978-4ba5-a7b7-3f4dca6c232f None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:02:54.357905 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2f03afcb-7978-4ba5-a7b7-3f4dca6c232f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:54.453851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 684/1333] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:02:54.489812 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbe26d-4673-4b1a-8659-786598194c75 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:02:54.491332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-9dcbe26d-4673-4b1a-8659-786598194c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:54.595790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbe26d-4673-4b1a-8659-786598194c75 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:02:54.667406 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81dfb1-f1c7-49d4-9255-2e6c936e577c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:02:54.668007 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81dfb1-f1c7-49d4-9255-2e6c936e577c service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:54.668292 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81dfb1-f1c7-49d4-9255-2e6c936e577c service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:54.668598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81dfb1-f1c7-49d4-9255-2e6c936e577c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:54.671076 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7e81dfb1-f1c7-49d4-9255-2e6c936e577c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:54.697172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:02:54.785035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81dfb1-f1c7-49d4-9255-2e6c936e577c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:02:54.786473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81dfb1-f1c7-49d4-9255-2e6c936e577c service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:02:54.805752 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 650/1334] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:02:56.849106 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842cfe6-a550-4349-9af5-5234f345fe75 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:56.849662 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842cfe6-a550-4349-9af5-5234f345fe75 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:56.849662 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f842cfe6-a550-4349-9af5-5234f345fe75 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:56.851010 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 685/1335] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:02:56.856061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae241d4-9893-4d43-a70d-a0960e874956 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:56.856484 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae241d4-9893-4d43-a70d-a0960e874956 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:56.857300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae241d4-9893-4d43-a70d-a0960e874956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:56.925885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-dae241d4-9893-4d43-a70d-a0960e874956 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:02:56.927093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-dae241d4-9893-4d43-a70d-a0960e874956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:57.000915 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:02:57.023478 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 651/1336] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:02:57.064286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842cfe6-a550-4349-9af5-5234f345fe75 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:02:57.065975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f842cfe6-a550-4349-9af5-5234f345fe75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:57.168425 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f842cfe6-a550-4349-9af5-5234f345fe75 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:02:57.197507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:02:57.244490 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472e6fc-5dd8-4218-bcaa-e184bc79d26f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:02:57.245121 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472e6fc-5dd8-4218-bcaa-e184bc79d26f service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:57.245402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472e6fc-5dd8-4218-bcaa-e184bc79d26f service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:57.245678 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472e6fc-5dd8-4218-bcaa-e184bc79d26f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:57.247283 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7472e6fc-5dd8-4218-bcaa-e184bc79d26f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:57.358303 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472e6fc-5dd8-4218-bcaa-e184bc79d26f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:02:57.359781 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472e6fc-5dd8-4218-bcaa-e184bc79d26f service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:02:57.377576 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 686/1337] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:02:59.802856 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192fb80-c0f4-426a-aba7-92685c6af585 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:59.803388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192fb80-c0f4-426a-aba7-92685c6af585 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:59.803388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192fb80-c0f4-426a-aba7-92685c6af585 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:59.804818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 652/1338] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:02:59.810459 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d11e67-d5f5-40fa-bde8-cdb3107a8bd1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:02:59.810459 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d11e67-d5f5-40fa-bde8-cdb3107a8bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:02:59.811401 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d11e67-d5f5-40fa-bde8-cdb3107a8bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:02:59.881729 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-24d11e67-d5f5-40fa-bde8-cdb3107a8bd1 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:02:59.882942 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-24d11e67-d5f5-40fa-bde8-cdb3107a8bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:02:59.891677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:02:59.985553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 687/1339] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:02:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:00.021579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192fb80-c0f4-426a-aba7-92685c6af585 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:03:00.023110 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-1192fb80-c0f4-426a-aba7-92685c6af585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:00.126645 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192fb80-c0f4-426a-aba7-92685c6af585 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:03:00.199549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee5d25-de15-4da7-bc32-1c7c992c9ca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:03:00.200160 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee5d25-de15-4da7-bc32-1c7c992c9ca9 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:00.200443 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee5d25-de15-4da7-bc32-1c7c992c9ca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:00.202876 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee5d25-de15-4da7-bc32-1c7c992c9ca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:00.204588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-9aee5d25-de15-4da7-bc32-1c7c992c9ca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:00.240697 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:00.315905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee5d25-de15-4da7-bc32-1c7c992c9ca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:03:00.317377 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee5d25-de15-4da7-bc32-1c7c992c9ca9 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:03:00.336108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 653/1340] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:03:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:03:04.271990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f720f2-fb39-46e6-ac2d-be76492c316a None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:04.272544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f720f2-fb39-46e6-ac2d-be76492c316a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:04.272642 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f720f2-fb39-46e6-ac2d-be76492c316a None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:04.274143 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 688/1341] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:04.279330 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa54588-2eec-47af-9943-0fd1bdd94b67 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:04.280073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa54588-2eec-47af-9943-0fd1bdd94b67 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:04.280407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa54588-2eec-47af-9943-0fd1bdd94b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:04.351046 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-0fa54588-2eec-47af-9943-0fd1bdd94b67 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:04.352268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-0fa54588-2eec-47af-9943-0fd1bdd94b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:04.440301 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:04.452125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 654/1342] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:04.490810 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f720f2-fb39-46e6-ac2d-be76492c316a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:03:04.492332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-26f720f2-fb39-46e6-ac2d-be76492c316a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:04.598220 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f720f2-fb39-46e6-ac2d-be76492c316a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:03:04.635793 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:04.673264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab7228-3ca7-4af7-b91f-16fad2da88bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:03:04.673876 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab7228-3ca7-4af7-b91f-16fad2da88bb service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:04.674153 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab7228-3ca7-4af7-b91f-16fad2da88bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:04.674424 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab7228-3ca7-4af7-b91f-16fad2da88bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:04.676060 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0cab7228-3ca7-4af7-b91f-16fad2da88bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:04.790482 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab7228-3ca7-4af7-b91f-16fad2da88bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:03:04.791933 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab7228-3ca7-4af7-b91f-16fad2da88bb service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:03:04.812686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 689/1343] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:03:07.762485 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e4690-ad53-4835-a456-6b79b5d86e07 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:07.762994 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e4690-ad53-4835-a456-6b79b5d86e07 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:07.762994 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e4690-ad53-4835-a456-6b79b5d86e07 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:07.765084 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 655/1344] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:07.770426 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65cdb0-2774-4429-9111-b47c60561527 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:07.770889 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65cdb0-2774-4429-9111-b47c60561527 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:07.771112 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65cdb0-2774-4429-9111-b47c60561527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:07.838153 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5a65cdb0-2774-4429-9111-b47c60561527 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:07.839378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5a65cdb0-2774-4429-9111-b47c60561527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:07.858104 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:07.945959 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 690/1345] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:03:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:07.985428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e4690-ad53-4835-a456-6b79b5d86e07 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:03:07.986960 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ca2e4690-ad53-4835-a456-6b79b5d86e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:08.097038 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e4690-ad53-4835-a456-6b79b5d86e07 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:03:08.176676 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9b996-3998-4249-9fb9-a4b5ee168c02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:03:08.177310 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9b996-3998-4249-9fb9-a4b5ee168c02 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:08.177592 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9b996-3998-4249-9fb9-a4b5ee168c02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:08.177866 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9b996-3998-4249-9fb9-a4b5ee168c02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:08.179610 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-def9b996-3998-4249-9fb9-a4b5ee168c02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:08.224277 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:08.297727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9b996-3998-4249-9fb9-a4b5ee168c02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:03:08.300049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9b996-3998-4249-9fb9-a4b5ee168c02 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:03:08.319533 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 656/1346] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:03:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:03:12.603819 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5176daf-7467-44d6-a517-acf4e8dd6b2b None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:12.604361 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5176daf-7467-44d6-a517-acf4e8dd6b2b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:12.604361 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5176daf-7467-44d6-a517-acf4e8dd6b2b None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:12.605792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 691/1347] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:12.611499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36fc72-69a2-48ad-8d05-5e964c81f19c None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:12.612011 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36fc72-69a2-48ad-8d05-5e964c81f19c None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:12.612115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36fc72-69a2-48ad-8d05-5e964c81f19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:12.682160 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-ec36fc72-69a2-48ad-8d05-5e964c81f19c None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:12.683300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ec36fc72-69a2-48ad-8d05-5e964c81f19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:12.796605 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:12.808587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 657/1348] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:12.839684 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5176daf-7467-44d6-a517-acf4e8dd6b2b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:03:12.841393 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b5176daf-7467-44d6-a517-acf4e8dd6b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:12.965566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5176daf-7467-44d6-a517-acf4e8dd6b2b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:03:13.017250 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:13.045748 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e4e99-02be-4411-87e1-336777dcc937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:03:13.046999 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e4e99-02be-4411-87e1-336777dcc937 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:13.047285 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e4e99-02be-4411-87e1-336777dcc937 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:13.047560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e4e99-02be-4411-87e1-336777dcc937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:13.049227 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-594e4e99-02be-4411-87e1-336777dcc937 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:13.167530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e4e99-02be-4411-87e1-336777dcc937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:03:13.169050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e4e99-02be-4411-87e1-336777dcc937 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:03:13.187836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 692/1349] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:03:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:03:18.126491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7756da-443f-4b41-a8c4-697a031dc0aa None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:18.127055 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7756da-443f-4b41-a8c4-697a031dc0aa None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:18.127303 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7756da-443f-4b41-a8c4-697a031dc0aa None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:18.128815 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 658/1350] 10.222.0.85 () {54 vars in 921 bytes} [Tue Aug 2 10:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 10:03:18.139238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c8c4e-dde2-4145-8d75-24fd2a741ae1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:18.139735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c8c4e-dde2-4145-8d75-24fd2a741ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:18.139735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c8c4e-dde2-4145-8d75-24fd2a741ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:18.226182 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-cd4c8c4e-dde2-4145-8d75-24fd2a741ae1 None None] MFA Rules not processed for user `a2a420cc676e4f2bb2766826a1de3b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:18.227376 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cd4c8c4e-dde2-4145-8d75-24fd2a741ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:18.248902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:18.360161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 693/1351] 10.222.0.85 () {58 vars in 1018 bytes} [Tue Aug 2 10:03:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:22.389831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad4a24-b2a8-4be0-8ca9-389a997b8785 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:22.390417 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad4a24-b2a8-4be0-8ca9-389a997b8785 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:22.390417 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad4a24-b2a8-4be0-8ca9-389a997b8785 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:22.391916 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 659/1352] 10.222.0.85 () {54 vars in 921 bytes} [Tue Aug 2 10:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:22.397592 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87245dc-a8e4-4bd6-8cac-1a96206ffa7b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:22.398516 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87245dc-a8e4-4bd6-8cac-1a96206ffa7b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:22.399012 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87245dc-a8e4-4bd6-8cac-1a96206ffa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:22.487786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e87245dc-a8e4-4bd6-8cac-1a96206ffa7b None None] MFA Rules not processed for user `a2a420cc676e4f2bb2766826a1de3b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:22.489250 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e87245dc-a8e4-4bd6-8cac-1a96206ffa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:22.568281 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:22.608064 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 694/1353] 10.222.0.85 () {58 vars in 1018 bytes} [Tue Aug 2 10:03:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:24.200026 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c08dd-4c52-4fc1-98c0-56a5dbdc3370 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:24.200624 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c08dd-4c52-4fc1-98c0-56a5dbdc3370 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:24.200624 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c08dd-4c52-4fc1-98c0-56a5dbdc3370 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:24.202027 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 660/1354] 10.222.0.85 () {54 vars in 921 bytes} [Tue Aug 2 10:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:24.207099 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369344c-d851-48f7-9bbd-1ae4176ef4b9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:24.207523 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369344c-d851-48f7-9bbd-1ae4176ef4b9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:24.207656 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369344c-d851-48f7-9bbd-1ae4176ef4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:24.286583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8369344c-d851-48f7-9bbd-1ae4176ef4b9 None None] MFA Rules not processed for user `a2a420cc676e4f2bb2766826a1de3b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:24.288056 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8369344c-d851-48f7-9bbd-1ae4176ef4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:24.402992 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 695/1355] 10.222.0.85 () {58 vars in 1018 bytes} [Tue Aug 2 10:03:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:27.677540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae97b1e-3935-4ea1-bd52-5a0b768fcd15 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:27.678101 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae97b1e-3935-4ea1-bd52-5a0b768fcd15 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:27.678101 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae97b1e-3935-4ea1-bd52-5a0b768fcd15 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:27.679422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 661/1356] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:27.685670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150f2ac-4830-4cb0-8ab8-43358ce95bf1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:27.686870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150f2ac-4830-4cb0-8ab8-43358ce95bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:27.687392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150f2ac-4830-4cb0-8ab8-43358ce95bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:27.735261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:27.773422 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1150f2ac-4830-4cb0-8ab8-43358ce95bf1 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:27.774951 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1150f2ac-4830-4cb0-8ab8-43358ce95bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:27.889457 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 696/1357] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:27.945645 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e2823-d549-41a3-b05e-5374347f9092 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:27.946307 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e2823-d549-41a3-b05e-5374347f9092 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:27.946858 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e2823-d549-41a3-b05e-5374347f9092 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:27.948701 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 662/1358] 10.222.0.85 () {54 vars in 962 bytes} [Tue Aug 2 10:03:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:27.957607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ca7e6-e719-4c40-95ca-898435bbbfe9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:27.958496 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ca7e6-e719-4c40-95ca-898435bbbfe9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:27.959035 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ca7e6-e719-4c40-95ca-898435bbbfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:28.050220 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f21ca7e6-e719-4c40-95ca-898435bbbfe9 None None] MFA Rules not processed for user `310867deefd34a598cfef2f3e4245ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:28.051491 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f21ca7e6-e719-4c40-95ca-898435bbbfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:28.120844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:28.214324 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 697/1359] 10.222.0.85 () {58 vars in 1059 bytes} [Tue Aug 2 10:03:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:28.224069 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e2823-d549-41a3-b05e-5374347f9092 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:03:28.225598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e13e2823-d549-41a3-b05e-5374347f9092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:28.395167 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e2823-d549-41a3-b05e-5374347f9092 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:03:28.475927 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:28.519445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1d71a-6ef5-476f-9844-0e3282fd7292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:03:28.520069 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d71a-6ef5-476f-9844-0e3282fd7292 service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:28.520353 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d71a-6ef5-476f-9844-0e3282fd7292 service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:28.520657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d71a-6ef5-476f-9844-0e3282fd7292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:28.522279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f8d1d71a-6ef5-476f-9844-0e3282fd7292 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:28.619584 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1d71a-6ef5-476f-9844-0e3282fd7292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:03:28.621217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1d71a-6ef5-476f-9844-0e3282fd7292 service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:03:28.640154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 663/1360] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:03:30.894178 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419de235-006b-49db-baa6-58b320d8413b None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:30.894680 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419de235-006b-49db-baa6-58b320d8413b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:30.894680 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419de235-006b-49db-baa6-58b320d8413b None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:30.896154 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 698/1361] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:30.901334 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d50509-7bd9-4dd2-929c-25f75ab82e43 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:30.901788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d50509-7bd9-4dd2-929c-25f75ab82e43 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:30.902010 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d50509-7bd9-4dd2-929c-25f75ab82e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:30.971499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-75d50509-7bd9-4dd2-929c-25f75ab82e43 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:30.972727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-75d50509-7bd9-4dd2-929c-25f75ab82e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:31.012410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:31.082780 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 664/1362] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:03:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:31.131413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419de235-006b-49db-baa6-58b320d8413b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:03:31.133165 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-419de235-006b-49db-baa6-58b320d8413b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:31.348170 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419de235-006b-49db-baa6-58b320d8413b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:03:31.358326 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:31.477687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed98a51-cd60-435a-8dc1-10dd9da97d92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:03:31.478310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed98a51-cd60-435a-8dc1-10dd9da97d92 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:31.478591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed98a51-cd60-435a-8dc1-10dd9da97d92 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:31.478855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed98a51-cd60-435a-8dc1-10dd9da97d92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:31.480612 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3ed98a51-cd60-435a-8dc1-10dd9da97d92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:31.575383 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed98a51-cd60-435a-8dc1-10dd9da97d92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:03:31.577036 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed98a51-cd60-435a-8dc1-10dd9da97d92 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:03:31.596549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 699/1363] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:03:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:03:34.013097 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f26435-a472-46b8-883a-5019ce4de6f8 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:34.013664 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f26435-a472-46b8-883a-5019ce4de6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:34.013664 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f26435-a472-46b8-883a-5019ce4de6f8 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:34.015426 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 665/1364] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:34.020852 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae337-3948-4b81-83e8-0fad2d7c1019 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:34.021315 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae337-3948-4b81-83e8-0fad2d7c1019 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:34.021409 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ae337-3948-4b81-83e8-0fad2d7c1019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:34.038442 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:34.095759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-cf3ae337-3948-4b81-83e8-0fad2d7c1019 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:34.096994 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cf3ae337-3948-4b81-83e8-0fad2d7c1019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:34.208810 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 700/1365] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:34.249465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17f28b-476e-4673-b316-5ca64ae4009e None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:34.249775 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17f28b-476e-4673-b316-5ca64ae4009e None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:34.250318 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17f28b-476e-4673-b316-5ca64ae4009e None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:34.251900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 666/1366] 10.222.0.85 () {54 vars in 962 bytes} [Tue Aug 2 10:03:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:34.257476 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893752f-37b6-420d-91e7-43c8a5c68eb8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:34.257833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893752f-37b6-420d-91e7-43c8a5c68eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:34.258190 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893752f-37b6-420d-91e7-43c8a5c68eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:34.350696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a893752f-37b6-420d-91e7-43c8a5c68eb8 None None] MFA Rules not processed for user `310867deefd34a598cfef2f3e4245ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:34.351902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a893752f-37b6-420d-91e7-43c8a5c68eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:34.389810 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:34.481090 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 701/1367] 10.222.0.85 () {58 vars in 1059 bytes} [Tue Aug 2 10:03:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:03:34.489425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17f28b-476e-4673-b316-5ca64ae4009e None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:03:34.491284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ab17f28b-476e-4673-b316-5ca64ae4009e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:34.656816 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17f28b-476e-4673-b316-5ca64ae4009e None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:03:34.679869 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:34.788645 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2df82-384b-410b-9fb3-404925f56b31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:03:34.789267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2df82-384b-410b-9fb3-404925f56b31 service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:34.789553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2df82-384b-410b-9fb3-404925f56b31 service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:34.789832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2df82-384b-410b-9fb3-404925f56b31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:34.791478 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-54e2df82-384b-410b-9fb3-404925f56b31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:34.910906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e2df82-384b-410b-9fb3-404925f56b31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:03:34.912500 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e2df82-384b-410b-9fb3-404925f56b31 service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:03:34.934208 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 667/1368] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:03:35.845062 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0db808-15d1-4134-bca4-8f6a463c1b4a None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:35.845660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0db808-15d1-4134-bca4-8f6a463c1b4a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:35.845660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0db808-15d1-4134-bca4-8f6a463c1b4a None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:35.847214 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 702/1369] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:35.852151 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e62f08-e87e-407e-8118-17706d98a958 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:35.852608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e62f08-e87e-407e-8118-17706d98a958 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:35.852808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e62f08-e87e-407e-8118-17706d98a958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:35.888316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:35.927150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-29e62f08-e87e-407e-8118-17706d98a958 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:35.928432 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-29e62f08-e87e-407e-8118-17706d98a958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:36.031786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 668/1370] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:03:36.396583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf3788-80ad-4c1f-88e4-1d2337c7f403 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:36.397303 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf3788-80ad-4c1f-88e4-1d2337c7f403 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:36.397303 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf3788-80ad-4c1f-88e4-1d2337c7f403 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:36.398851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 703/1371] 10.222.0.85 () {54 vars in 964 bytes} [Tue Aug 2 10:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:36.403778 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d19cd8-2135-408a-80c1-47f03abebe7e None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:36.404551 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d19cd8-2135-408a-80c1-47f03abebe7e None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:36.404551 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d19cd8-2135-408a-80c1-47f03abebe7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:36.489863 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-86d19cd8-2135-408a-80c1-47f03abebe7e None None] MFA Rules not processed for user `8e4e240f7958425a99a2cc1110e40c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:36.491247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-86d19cd8-2135-408a-80c1-47f03abebe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:36.542730 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:36.580790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 669/1372] 10.222.0.85 () {58 vars in 1061 bytes} [Tue Aug 2 10:03:36 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:36.587295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf3788-80ad-4c1f-88e4-1d2337c7f403 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:03:36.588948 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6caf3788-80ad-4c1f-88e4-1d2337c7f403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:36.705537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf3788-80ad-4c1f-88e4-1d2337c7f403 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:03:36.749785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:36.787050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86576cd3-e5d7-46ba-965a-d1fda0b67f26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:03:36.787665 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86576cd3-e5d7-46ba-965a-d1fda0b67f26 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:36.787944 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86576cd3-e5d7-46ba-965a-d1fda0b67f26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:36.788215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86576cd3-e5d7-46ba-965a-d1fda0b67f26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:36.789858 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-86576cd3-e5d7-46ba-965a-d1fda0b67f26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:36.916548 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86576cd3-e5d7-46ba-965a-d1fda0b67f26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:03:36.918139 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86576cd3-e5d7-46ba-965a-d1fda0b67f26 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:03:36.939652 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 704/1373] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:03:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:03:37.081626 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e95f59-753a-4ab8-971e-7093ff4bc03a None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:37.082125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e95f59-753a-4ab8-971e-7093ff4bc03a None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:37.082580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e95f59-753a-4ab8-971e-7093ff4bc03a None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:37.083712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 670/1374] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:37.088885 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d2917-b372-4c3c-a62f-8427cc1378a5 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:37.090061 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d2917-b372-4c3c-a62f-8427cc1378a5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:37.090061 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d2917-b372-4c3c-a62f-8427cc1378a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:37.165070 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f51d2917-b372-4c3c-a62f-8427cc1378a5 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:37.166941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f51d2917-b372-4c3c-a62f-8427cc1378a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:37.193835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:37.397864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 705/1375] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:37.441688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e95f59-753a-4ab8-971e-7093ff4bc03a None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:03:37.443286 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-d7e95f59-753a-4ab8-971e-7093ff4bc03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:37.587720 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e95f59-753a-4ab8-971e-7093ff4bc03a None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:03:37.641898 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:37.705886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061aac1b-23f3-4c29-bafb-d05e5bf6e5c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:03:37.706499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aac1b-23f3-4c29-bafb-d05e5bf6e5c4 service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:37.706779 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aac1b-23f3-4c29-bafb-d05e5bf6e5c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:37.707050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061aac1b-23f3-4c29-bafb-d05e5bf6e5c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:37.708813 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-061aac1b-23f3-4c29-bafb-d05e5bf6e5c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:37.804786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061aac1b-23f3-4c29-bafb-d05e5bf6e5c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:03:37.806381 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061aac1b-23f3-4c29-bafb-d05e5bf6e5c4 service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:03:37.826151 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 671/1376] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:03:39.982138 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc311dd-1d77-4a5a-8ac9-cdc1cb1962e1 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:39.982625 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc311dd-1d77-4a5a-8ac9-cdc1cb1962e1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:39.982730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc311dd-1d77-4a5a-8ac9-cdc1cb1962e1 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:39.984183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 706/1377] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:39.989427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268a930-3ef7-453e-8907-713d7956e52d None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:39.989864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268a930-3ef7-453e-8907-713d7956e52d None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:39.989993 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268a930-3ef7-453e-8907-713d7956e52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:40.075610 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-b268a930-3ef7-453e-8907-713d7956e52d None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:40.076816 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b268a930-3ef7-453e-8907-713d7956e52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:40.084217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:40.179305 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 672/1378] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:40.223105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc311dd-1d77-4a5a-8ac9-cdc1cb1962e1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:03:40.224628 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-adc311dd-1d77-4a5a-8ac9-cdc1cb1962e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:40.385898 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc311dd-1d77-4a5a-8ac9-cdc1cb1962e1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:03:40.390459 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:40.545818 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473b3a8-bddb-49ab-a841-0a8ee878f562 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:03:40.546502 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473b3a8-bddb-49ab-a841-0a8ee878f562 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:40.546839 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473b3a8-bddb-49ab-a841-0a8ee878f562 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:40.547188 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473b3a8-bddb-49ab-a841-0a8ee878f562 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:40.549190 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4473b3a8-bddb-49ab-a841-0a8ee878f562 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:40.661395 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473b3a8-bddb-49ab-a841-0a8ee878f562 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:03:40.663058 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473b3a8-bddb-49ab-a841-0a8ee878f562 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:03:40.684317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 707/1379] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:03:42.747403 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d37fa1-f566-4953-a545-d1996c67eb51 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:42.747859 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d37fa1-f566-4953-a545-d1996c67eb51 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:42.747957 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d37fa1-f566-4953-a545-d1996c67eb51 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:42.749525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 673/1380] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:42.754397 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7d4c-44bf-4772-b83e-3d45ccf4df5c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:42.754802 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7d4c-44bf-4772-b83e-3d45ccf4df5c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:42.754992 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7d4c-44bf-4772-b83e-3d45ccf4df5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:42.767238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:42.829179 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4b7b7d4c-44bf-4772-b83e-3d45ccf4df5c None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:42.830348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4b7b7d4c-44bf-4772-b83e-3d45ccf4df5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:42.942673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 708/1381] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:42.987056 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d37fa1-f566-4953-a545-d1996c67eb51 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:03:42.988712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-35d37fa1-f566-4953-a545-d1996c67eb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:43.138144 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:43.149913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d37fa1-f566-4953-a545-d1996c67eb51 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:03:43.272924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83431df-fe86-4ef9-8c02-70dfd1c61e52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:03:43.273461 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83431df-fe86-4ef9-8c02-70dfd1c61e52 service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:43.273747 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83431df-fe86-4ef9-8c02-70dfd1c61e52 service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:43.274025 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83431df-fe86-4ef9-8c02-70dfd1c61e52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:43.276197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-d83431df-fe86-4ef9-8c02-70dfd1c61e52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:43.385387 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83431df-fe86-4ef9-8c02-70dfd1c61e52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:03:43.387517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83431df-fe86-4ef9-8c02-70dfd1c61e52 service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:03:43.401123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:43.411688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 674/1382] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:03:45.467470 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de6350-0783-4e0c-8b53-2b6b87af9206 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:45.468027 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de6350-0783-4e0c-8b53-2b6b87af9206 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:45.468235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de6350-0783-4e0c-8b53-2b6b87af9206 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:45.470122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 709/1383] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:03:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:45.475670 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe314af6-ff62-47e9-968e-b75bcbaa27ed None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:45.476082 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe314af6-ff62-47e9-968e-b75bcbaa27ed None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:45.476495 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe314af6-ff62-47e9-968e-b75bcbaa27ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:45.554326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-fe314af6-ff62-47e9-968e-b75bcbaa27ed None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:45.555591 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-fe314af6-ff62-47e9-968e-b75bcbaa27ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:45.655125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 675/1384] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:45.697833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de6350-0783-4e0c-8b53-2b6b87af9206 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:03:45.699339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-36de6350-0783-4e0c-8b53-2b6b87af9206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:45.788314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:45.855612 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de6350-0783-4e0c-8b53-2b6b87af9206 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:03:45.976058 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4844c2-447f-4095-919b-5acc4770fb8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:03:45.976708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4844c2-447f-4095-919b-5acc4770fb8b service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:45.976989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4844c2-447f-4095-919b-5acc4770fb8b service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:45.978039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4844c2-447f-4095-919b-5acc4770fb8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:45.979924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7e4844c2-447f-4095-919b-5acc4770fb8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:46.039358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:46.080885 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4844c2-447f-4095-919b-5acc4770fb8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:03:46.082484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4844c2-447f-4095-919b-5acc4770fb8b service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:03:46.101590 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 710/1385] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:03:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:03:48.153954 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b8933-e413-4ee7-85f9-6b1078860d3c None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:48.154713 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b8933-e413-4ee7-85f9-6b1078860d3c None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:48.154713 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b8933-e413-4ee7-85f9-6b1078860d3c None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:48.155863 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 676/1386] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:48.161582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf205a9-d96e-401a-9ba6-b4d54726a1b0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:48.162046 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf205a9-d96e-401a-9ba6-b4d54726a1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:48.162329 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf205a9-d96e-401a-9ba6-b4d54726a1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:48.241042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0bf205a9-d96e-401a-9ba6-b4d54726a1b0 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:48.243686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0bf205a9-d96e-401a-9ba6-b4d54726a1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:48.349968 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 711/1387] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:48.416010 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b8933-e413-4ee7-85f9-6b1078860d3c None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:03:48.417529 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-100b8933-e413-4ee7-85f9-6b1078860d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:48.516045 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:48.596092 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b8933-e413-4ee7-85f9-6b1078860d3c None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:03:48.730828 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf33c933-bb1d-4d7b-b46c-ae95856e1eef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:03:48.731452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33c933-bb1d-4d7b-b46c-ae95856e1eef service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:48.731738 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33c933-bb1d-4d7b-b46c-ae95856e1eef service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:48.732015 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf33c933-bb1d-4d7b-b46c-ae95856e1eef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:48.733677 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-bf33c933-bb1d-4d7b-b46c-ae95856e1eef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:48.774964 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:48.829840 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33c933-bb1d-4d7b-b46c-ae95856e1eef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:03:48.831434 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf33c933-bb1d-4d7b-b46c-ae95856e1eef service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:03:48.851434 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 677/1388] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:03:50.959003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c66a84-c92f-495f-824f-dc6acad0b9a3 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:50.959658 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c66a84-c92f-495f-824f-dc6acad0b9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:50.959764 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c66a84-c92f-495f-824f-dc6acad0b9a3 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:50.961370 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 712/1389] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:50.966593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c3e02-2657-406f-8f69-b99637dc4ff0 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:50.967058 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c3e02-2657-406f-8f69-b99637dc4ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:50.967173 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c3e02-2657-406f-8f69-b99637dc4ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:51.033606 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-e48c3e02-2657-406f-8f69-b99637dc4ff0 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:51.034821 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e48c3e02-2657-406f-8f69-b99637dc4ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:51.133849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 678/1390] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:51.179125 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c66a84-c92f-495f-824f-dc6acad0b9a3 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:03:51.180730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a0c66a84-c92f-495f-824f-dc6acad0b9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:51.211911 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:51.332590 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c66a84-c92f-495f-824f-dc6acad0b9a3 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:03:51.437115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:51.451407 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c9926-9e19-40e5-9c58-5f1480410ceb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:03:51.452028 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c9926-9e19-40e5-9c58-5f1480410ceb service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:51.452303 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c9926-9e19-40e5-9c58-5f1480410ceb service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:51.452672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c9926-9e19-40e5-9c58-5f1480410ceb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:51.454362 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-425c9926-9e19-40e5-9c58-5f1480410ceb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:51.545455 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c9926-9e19-40e5-9c58-5f1480410ceb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:03:51.546964 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c9926-9e19-40e5-9c58-5f1480410ceb service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:03:51.565607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 713/1391] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:03:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:03:52.371318 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4227e-b388-4eb7-8a01-618508686fea None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:52.371895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4227e-b388-4eb7-8a01-618508686fea None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:52.371895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4227e-b388-4eb7-8a01-618508686fea None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:52.373287 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 679/1392] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 10:03:52.378347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b41619-da67-406d-b616-0dfedfd7150f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:52.378745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b41619-da67-406d-b616-0dfedfd7150f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:52.378902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b41619-da67-406d-b616-0dfedfd7150f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:52.451623 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-67b41619-da67-406d-b616-0dfedfd7150f None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:52.452886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-67b41619-da67-406d-b616-0dfedfd7150f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:52.512904 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:52.553300 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 714/1393] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:52.609832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77cd2a-9288-4e4a-a5f5-6b878dc6dabd None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:52.610126 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77cd2a-9288-4e4a-a5f5-6b878dc6dabd None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:52.610402 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77cd2a-9288-4e4a-a5f5-6b878dc6dabd None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:52.611749 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 680/1394] 10.222.0.85 () {54 vars in 966 bytes} [Tue Aug 2 10:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:52.616821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b922f-ab21-49b5-b837-3ecb52394189 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:52.617109 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b922f-ab21-49b5-b837-3ecb52394189 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:52.617383 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b922f-ab21-49b5-b837-3ecb52394189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:52.694874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-976b922f-ab21-49b5-b837-3ecb52394189 None None] MFA Rules not processed for user `0af63c36df2c4ceaa2df4d3ac59542bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:52.696063 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-976b922f-ab21-49b5-b837-3ecb52394189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:52.778120 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 715/1395] 10.222.0.85 () {58 vars in 1063 bytes} [Tue Aug 2 10:03:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:52.785666 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77cd2a-9288-4e4a-a5f5-6b878dc6dabd None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:03:52.787244 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2f77cd2a-9288-4e4a-a5f5-6b878dc6dabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:52.800735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:52.894433 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77cd2a-9288-4e4a-a5f5-6b878dc6dabd None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:03:52.969147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452b08e-fd63-4eb8-9ae9-820ae3d108c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0af63c36df2c4ceaa2df4d3ac59542bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:03:52.969765 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452b08e-fd63-4eb8-9ae9-820ae3d108c0 service glance] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:52.970049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452b08e-fd63-4eb8-9ae9-820ae3d108c0 service glance] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:52.970326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452b08e-fd63-4eb8-9ae9-820ae3d108c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:52.971955 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-9452b08e-fd63-4eb8-9ae9-820ae3d108c0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:53.040404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:53.081939 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452b08e-fd63-4eb8-9ae9-820ae3d108c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:03:53.083377 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452b08e-fd63-4eb8-9ae9-820ae3d108c0 service glance] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:03:53.105961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 681/1396] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:03:53.627225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59172d81-b111-4454-ae3e-988b7c245089 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:53.627736 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59172d81-b111-4454-ae3e-988b7c245089 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:53.627842 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59172d81-b111-4454-ae3e-988b7c245089 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:53.629188 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 716/1397] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:53.635914 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ac7d8-57e1-4a4b-81b5-d71f316923c5 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:53.636360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ac7d8-57e1-4a4b-81b5-d71f316923c5 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:53.636619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ac7d8-57e1-4a4b-81b5-d71f316923c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:53.707064 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-cf7ac7d8-57e1-4a4b-81b5-d71f316923c5 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:53.708370 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-cf7ac7d8-57e1-4a4b-81b5-d71f316923c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:53.820716 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 682/1398] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:53.857550 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45bb64-b46c-4029-82ff-a265d24b2b03 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:53.857841 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45bb64-b46c-4029-82ff-a265d24b2b03 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:53.858121 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45bb64-b46c-4029-82ff-a265d24b2b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:53.867653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ac7d8-57e1-4a4b-81b5-d71f316923c5 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:03:53.869047 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-cf7ac7d8-57e1-4a4b-81b5-d71f316923c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:53.897416 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:53.927680 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ff45bb64-b46c-4029-82ff-a265d24b2b03 None None] MFA Rules not processed for user `f43a16e2dcab4872963222c557853d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:53.928940 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ff45bb64-b46c-4029-82ff-a265d24b2b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:53.937944 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:53.996321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ac7d8-57e1-4a4b-81b5-d71f316923c5 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:03:54.020068 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 717/1399] 10.222.0.85 () {58 vars in 1009 bytes} [Tue Aug 2 10:03:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:54.065032 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fc301-ba8a-4f7a-81f6-56a44995b9b6 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:54.065326 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fc301-ba8a-4f7a-81f6-56a44995b9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:54.065598 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fc301-ba8a-4f7a-81f6-56a44995b9b6 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:54.066942 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 718/1400] 10.222.0.85 () {54 vars in 943 bytes} [Tue Aug 2 10:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 10:03:54.073911 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70f7bc-b837-48de-8d60-5aa184953a01 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:54.074193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70f7bc-b837-48de-8d60-5aa184953a01 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:54.074465 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70f7bc-b837-48de-8d60-5aa184953a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:54.117976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb3e65-1dc4-4b0a-8444-1f899dcd47bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:03:54.118604 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb3e65-1dc4-4b0a-8444-1f899dcd47bd service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:54.118885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb3e65-1dc4-4b0a-8444-1f899dcd47bd service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:54.119155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb3e65-1dc4-4b0a-8444-1f899dcd47bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:54.120837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2dcb3e65-1dc4-4b0a-8444-1f899dcd47bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:54.139378 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:54.155327 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2f70f7bc-b837-48de-8d60-5aa184953a01 None None] MFA Rules not processed for user `e9cfed2469a7419f8fcbe09d25cb896e`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:54.156570 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2f70f7bc-b837-48de-8d60-5aa184953a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:54.215300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb3e65-1dc4-4b0a-8444-1f899dcd47bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:03:54.216970 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcb3e65-1dc4-4b0a-8444-1f899dcd47bd service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:03:54.235099 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 683/1401] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:03:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:03:54.242425 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:54.268916 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 719/1402] 10.222.0.85 () {58 vars in 1040 bytes} [Tue Aug 2 10:03:54 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:03:54.278581 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb3e65-1dc4-4b0a-8444-1f899dcd47bd service nova] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:03:54.279879 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2dcb3e65-1dc4-4b0a-8444-1f899dcd47bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:54.377291 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb3e65-1dc4-4b0a-8444-1f899dcd47bd service nova] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:03:54.438773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:54.504587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecaec50-6bc2-4471-ab9e-9417907c1bb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cfed2469a7419f8fcbe09d25cb896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:03:54.505774 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaec50-6bc2-4471-ab9e-9417907c1bb5 service swift] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:54.506057 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaec50-6bc2-4471-ab9e-9417907c1bb5 service swift] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:54.506330 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaec50-6bc2-4471-ab9e-9417907c1bb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:54.508257 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-1ecaec50-6bc2-4471-ab9e-9417907c1bb5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:54.592025 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecaec50-6bc2-4471-ab9e-9417907c1bb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:03:54.593579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecaec50-6bc2-4471-ab9e-9417907c1bb5 service swift] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:03:54.602414 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 684/1403] 10.222.0.85 () {60 vars in 1384 bytes} [Tue Aug 2 10:03:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 10:03:56.357929 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d992f-96f4-4ea0-bb14-ac92f5db2b96 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:56.358504 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d992f-96f4-4ea0-bb14-ac92f5db2b96 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:56.358504 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d992f-96f4-4ea0-bb14-ac92f5db2b96 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:56.359863 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 720/1404] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:56.366334 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe6269-bb42-4ae0-9a6d-7fff94f7113c None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:56.366846 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe6269-bb42-4ae0-9a6d-7fff94f7113c None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:56.366956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe6269-bb42-4ae0-9a6d-7fff94f7113c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:56.440736 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-a0fe6269-bb42-4ae0-9a6d-7fff94f7113c None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:56.442733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a0fe6269-bb42-4ae0-9a6d-7fff94f7113c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:56.491603 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:56.567582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 685/1405] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:56.630653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d992f-96f4-4ea0-bb14-ac92f5db2b96 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:03:56.632541 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-552d992f-96f4-4ea0-bb14-ac92f5db2b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:56.811448 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d992f-96f4-4ea0-bb14-ac92f5db2b96 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:03:56.882435 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:57.014380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f653b9-5a18-4344-a9a7-e0f370a43ad7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:03:57.015501 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f653b9-5a18-4344-a9a7-e0f370a43ad7 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:57.015802 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f653b9-5a18-4344-a9a7-e0f370a43ad7 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:57.016196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f653b9-5a18-4344-a9a7-e0f370a43ad7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:57.018376 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-36f653b9-5a18-4344-a9a7-e0f370a43ad7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:57.116509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f653b9-5a18-4344-a9a7-e0f370a43ad7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:03:57.118106 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f653b9-5a18-4344-a9a7-e0f370a43ad7 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:03:57.140666 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 721/1406] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:03:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:03:59.217155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249efe89-5647-47f6-9936-fde27d872ed2 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:59.217719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249efe89-5647-47f6-9936-fde27d872ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:59.217719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249efe89-5647-47f6-9936-fde27d872ed2 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:59.219196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 686/1407] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:03:59.225131 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6468a7-01bb-4a40-bfac-04d3c348eb27 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:59.225598 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6468a7-01bb-4a40-bfac-04d3c348eb27 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:59.225695 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6468a7-01bb-4a40-bfac-04d3c348eb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:59.296996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-af6468a7-01bb-4a40-bfac-04d3c348eb27 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:03:59.298198 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-af6468a7-01bb-4a40-bfac-04d3c348eb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:59.318377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:59.413330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 722/1408] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:03:59.460153 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249efe89-5647-47f6-9936-fde27d872ed2 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:03:59.461807 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-249efe89-5647-47f6-9936-fde27d872ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:59.624736 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249efe89-5647-47f6-9936-fde27d872ed2 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:03:59.650722 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:03:59.754542 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470aebc3-0b28-487d-a888-8bfa6e86c05e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:03:59.755455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470aebc3-0b28-487d-a888-8bfa6e86c05e service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:03:59.755742 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470aebc3-0b28-487d-a888-8bfa6e86c05e service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:03:59.756022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470aebc3-0b28-487d-a888-8bfa6e86c05e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:03:59.757797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-470aebc3-0b28-487d-a888-8bfa6e86c05e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:03:59.867642 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470aebc3-0b28-487d-a888-8bfa6e86c05e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:03:59.869404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470aebc3-0b28-487d-a888-8bfa6e86c05e service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:03:59.890432 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 687/1409] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:03:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:04:09.411093 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=35 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:09.888108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=87 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:17.102087 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4944d5-1eb6-4ede-a35b-144f52b32fef None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:17.102643 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4944d5-1eb6-4ede-a35b-144f52b32fef None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:17.102643 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4944d5-1eb6-4ede-a35b-144f52b32fef None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:17.103900 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 723/1410] 10.222.0.85 () {54 vars in 918 bytes} [Tue Aug 2 10:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:04:17.110452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94676353-39e0-4545-8da9-378da172cc92 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:17.110889 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94676353-39e0-4545-8da9-378da172cc92 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:17.110994 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94676353-39e0-4545-8da9-378da172cc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:17.187012 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-94676353-39e0-4545-8da9-378da172cc92 None None] MFA Rules not processed for user `a2a420cc676e4f2bb2766826a1de3b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:17.188311 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-94676353-39e0-4545-8da9-378da172cc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:17.300827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 688/1411] 10.222.0.85 () {58 vars in 1015 bytes} [Tue Aug 2 10:04:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:17.315492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c8694-40be-453a-96c5-c714a3f4a294 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:17.315780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c8694-40be-453a-96c5-c714a3f4a294 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:17.316053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c8694-40be-453a-96c5-c714a3f4a294 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:17.317442 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 724/1412] 10.222.0.85 () {54 vars in 918 bytes} [Tue Aug 2 10:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:04:17.322113 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded2387-ccbe-4340-9345-c8c0eb7b97aa None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:17.322404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded2387-ccbe-4340-9345-c8c0eb7b97aa None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:17.322682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded2387-ccbe-4340-9345-c8c0eb7b97aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:17.395710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:17.398773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-9ded2387-ccbe-4340-9345-c8c0eb7b97aa None None] MFA Rules not processed for user `310867deefd34a598cfef2f3e4245ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:17.400359 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-9ded2387-ccbe-4340-9345-c8c0eb7b97aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:17.515920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 689/1413] 10.222.0.85 () {58 vars in 1015 bytes} [Tue Aug 2 10:04:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:19.990236 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14770bed-c1ac-48a0-87e1-fa48809ca7fc None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:19.990795 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14770bed-c1ac-48a0-87e1-fa48809ca7fc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:19.990795 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14770bed-c1ac-48a0-87e1-fa48809ca7fc None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:19.992153 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 725/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 10:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 10:04:19.998253 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b5528-abd7-4a9c-9bb7-4b6209d5992b None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:19.998636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b5528-abd7-4a9c-9bb7-4b6209d5992b None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:19.998824 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b5528-abd7-4a9c-9bb7-4b6209d5992b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:20.067184 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-734b5528-abd7-4a9c-9bb7-4b6209d5992b None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:20.068406 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-734b5528-abd7-4a9c-9bb7-4b6209d5992b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:20.124333 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:20.167657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 690/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 10:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:20.212007 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14770bed-c1ac-48a0-87e1-fa48809ca7fc None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:04:20.213554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-14770bed-c1ac-48a0-87e1-fa48809ca7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:20.361057 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14770bed-c1ac-48a0-87e1-fa48809ca7fc None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:04:20.435173 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:20.477103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d77cdd-8d06-4548-b085-f182578caa73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:04:20.477717 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d77cdd-8d06-4548-b085-f182578caa73 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:20.477996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d77cdd-8d06-4548-b085-f182578caa73 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:20.478269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d77cdd-8d06-4548-b085-f182578caa73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:20.479915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-33d77cdd-8d06-4548-b085-f182578caa73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:20.568177 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d77cdd-8d06-4548-b085-f182578caa73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:04:20.569726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d77cdd-8d06-4548-b085-f182578caa73 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:04:20.587728 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 726/1416] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:04:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:04:21.497606 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b5499-c6c7-4147-baaf-21d511e9d9d3 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:21.498161 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b5499-c6c7-4147-baaf-21d511e9d9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:21.498161 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b5499-c6c7-4147-baaf-21d511e9d9d3 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:21.499847 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 691/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 10:04:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:04:21.504811 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e376b-86d8-4f27-9b12-a165ca7c3305 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:21.505229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e376b-86d8-4f27-9b12-a165ca7c3305 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:21.505376 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e376b-86d8-4f27-9b12-a165ca7c3305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:21.581413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-595e376b-86d8-4f27-9b12-a165ca7c3305 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:21.582560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-595e376b-86d8-4f27-9b12-a165ca7c3305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:21.609388 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:21.684415 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 727/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 10:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:21.834813 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b5499-c6c7-4147-baaf-21d511e9d9d3 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:04:21.836258 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-c17b5499-c6c7-4147-baaf-21d511e9d9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:21.984834 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b5499-c6c7-4147-baaf-21d511e9d9d3 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:04:22.024685 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:22.098578 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089780d-871d-4f13-a2e0-c744e063b480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:04:22.099116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089780d-871d-4f13-a2e0-c744e063b480 service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:22.099401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089780d-871d-4f13-a2e0-c744e063b480 service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:22.099676 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089780d-871d-4f13-a2e0-c744e063b480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:22.101347 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f089780d-871d-4f13-a2e0-c744e063b480 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:22.191783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089780d-871d-4f13-a2e0-c744e063b480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:04:22.193429 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089780d-871d-4f13-a2e0-c744e063b480 service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:04:22.212617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 692/1419] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:04:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:04:23.100026 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febf7a3-55e1-4c81-9cef-6b90edc51664 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:23.100587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febf7a3-55e1-4c81-9cef-6b90edc51664 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:23.100587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febf7a3-55e1-4c81-9cef-6b90edc51664 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:23.101902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 728/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 10:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:04:23.107426 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1aad2-bbe7-40b8-88b2-ef3ec13be445 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:23.107856 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1aad2-bbe7-40b8-88b2-ef3ec13be445 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:23.107973 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1aad2-bbe7-40b8-88b2-ef3ec13be445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:23.164280 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:23.187504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-c9d1aad2-bbe7-40b8-88b2-ef3ec13be445 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:23.188761 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-c9d1aad2-bbe7-40b8-88b2-ef3ec13be445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:23.287465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 693/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 10:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:23.439426 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febf7a3-55e1-4c81-9cef-6b90edc51664 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:04:23.441052 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6febf7a3-55e1-4c81-9cef-6b90edc51664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:23.585054 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febf7a3-55e1-4c81-9cef-6b90edc51664 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:04:23.597048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:23.699929 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bce52e-59d4-4151-bd5d-13f46a5743d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:04:23.700488 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bce52e-59d4-4151-bd5d-13f46a5743d9 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:23.700773 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bce52e-59d4-4151-bd5d-13f46a5743d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:23.701051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bce52e-59d4-4151-bd5d-13f46a5743d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:23.702689 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d3bce52e-59d4-4151-bd5d-13f46a5743d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:23.793888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bce52e-59d4-4151-bd5d-13f46a5743d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:04:23.795501 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bce52e-59d4-4151-bd5d-13f46a5743d9 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:04:23.814672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 729/1422] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:04:24.709756 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eecc5e-334c-45e3-aaeb-f51862777313 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:24.710314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eecc5e-334c-45e3-aaeb-f51862777313 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:24.710314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eecc5e-334c-45e3-aaeb-f51862777313 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:24.712551 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 694/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 10:04:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:04:24.719762 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbae77-59f8-474c-ae71-bc926e0e5bcd None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:24.720237 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbae77-59f8-474c-ae71-bc926e0e5bcd None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:24.720339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbae77-59f8-474c-ae71-bc926e0e5bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:24.742115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:24.799307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-05bbae77-59f8-474c-ae71-bc926e0e5bcd None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:24.800546 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-05bbae77-59f8-474c-ae71-bc926e0e5bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:24.899137 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 730/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 10:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:25.058806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eecc5e-334c-45e3-aaeb-f51862777313 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:04:25.060162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-09eecc5e-334c-45e3-aaeb-f51862777313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:25.174044 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:25.213264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eecc5e-334c-45e3-aaeb-f51862777313 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:04:25.335479 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a545c26-d390-45db-9eab-05a97f8cb405 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:04:25.336372 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a545c26-d390-45db-9eab-05a97f8cb405 service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:25.336932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a545c26-d390-45db-9eab-05a97f8cb405 service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:25.337387 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a545c26-d390-45db-9eab-05a97f8cb405 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:25.340380 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-5a545c26-d390-45db-9eab-05a97f8cb405 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:25.431325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:25.446855 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a545c26-d390-45db-9eab-05a97f8cb405 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:04:25.449766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a545c26-d390-45db-9eab-05a97f8cb405 service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:04:25.471629 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 695/1425] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:04:26.376595 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b86345-8f45-440e-932c-8d6740f4ca79 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:26.377165 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b86345-8f45-440e-932c-8d6740f4ca79 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:26.377165 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b86345-8f45-440e-932c-8d6740f4ca79 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:26.378515 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 731/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 10:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:04:26.383532 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca21837-0d61-4923-b8eb-51d5e3dc9d63 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:26.383969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca21837-0d61-4923-b8eb-51d5e3dc9d63 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:26.384085 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca21837-0d61-4923-b8eb-51d5e3dc9d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:26.460761 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-0ca21837-0d61-4923-b8eb-51d5e3dc9d63 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:26.461974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-0ca21837-0d61-4923-b8eb-51d5e3dc9d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:26.558506 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 696/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 10:04:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:26.709502 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b86345-8f45-440e-932c-8d6740f4ca79 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:04:26.711001 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-20b86345-8f45-440e-932c-8d6740f4ca79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:26.796997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:26.860890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b86345-8f45-440e-932c-8d6740f4ca79 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:04:26.975015 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166dc7ac-8816-44b0-9c2b-ab5d3093b476 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:04:26.975802 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dc7ac-8816-44b0-9c2b-ab5d3093b476 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:26.976094 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dc7ac-8816-44b0-9c2b-ab5d3093b476 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:26.976371 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166dc7ac-8816-44b0-9c2b-ab5d3093b476 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:26.978031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-166dc7ac-8816-44b0-9c2b-ab5d3093b476 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:27.027391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:27.069078 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166dc7ac-8816-44b0-9c2b-ab5d3093b476 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:04:27.070670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166dc7ac-8816-44b0-9c2b-ab5d3093b476 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:04:27.090253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 732/1428] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:04:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:04:27.905205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44748f-bfcf-4405-bb06-59fd68b34ea9 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:27.905863 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44748f-bfcf-4405-bb06-59fd68b34ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:27.905863 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44748f-bfcf-4405-bb06-59fd68b34ea9 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:27.907140 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 697/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 10:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:04:27.912681 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c7156-266c-49dd-9928-540bc2cfcf25 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:27.913124 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c7156-266c-49dd-9928-540bc2cfcf25 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:27.913310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c7156-266c-49dd-9928-540bc2cfcf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:27.989460 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-046c7156-266c-49dd-9928-540bc2cfcf25 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:27.990663 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-046c7156-266c-49dd-9928-540bc2cfcf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:28.087610 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 733/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 10:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:28.243781 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44748f-bfcf-4405-bb06-59fd68b34ea9 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:04:28.245419 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-8e44748f-bfcf-4405-bb06-59fd68b34ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:28.296702 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:28.397132 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44748f-bfcf-4405-bb06-59fd68b34ea9 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:04:28.510875 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57df735-6a1b-4935-a6b0-c5ab11495b2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:04:28.511415 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57df735-6a1b-4935-a6b0-c5ab11495b2a service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:28.511698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57df735-6a1b-4935-a6b0-c5ab11495b2a service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:28.511971 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57df735-6a1b-4935-a6b0-c5ab11495b2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:28.513641 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a57df735-6a1b-4935-a6b0-c5ab11495b2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:28.520465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:28.602064 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57df735-6a1b-4935-a6b0-c5ab11495b2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:04:28.603696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57df735-6a1b-4935-a6b0-c5ab11495b2a service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:04:28.621930 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 698/1431] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:04:29.432877 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b3d5c-ea66-42e8-bdf7-369794a19d36 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:29.433429 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b3d5c-ea66-42e8-bdf7-369794a19d36 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:29.433429 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b3d5c-ea66-42e8-bdf7-369794a19d36 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:29.434781 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 734/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 10:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:04:29.439827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22eeac6-8d91-429e-ae76-14e3e4955098 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:29.440240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22eeac6-8d91-429e-ae76-14e3e4955098 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:29.440560 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22eeac6-8d91-429e-ae76-14e3e4955098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:29.516823 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-a22eeac6-8d91-429e-ae76-14e3e4955098 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:29.518018 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a22eeac6-8d91-429e-ae76-14e3e4955098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:29.585173 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:29.614738 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 699/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 10:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:29.777562 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b3d5c-ea66-42e8-bdf7-369794a19d36 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:04:29.779946 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-813b3d5c-ea66-42e8-bdf7-369794a19d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:29.805666 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:29.938268 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b3d5c-ea66-42e8-bdf7-369794a19d36 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:04:30.026117 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:30.051603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a858dae-ffb9-4134-b5a9-757dd3b853c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:04:30.052223 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a858dae-ffb9-4134-b5a9-757dd3b853c4 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:30.052605 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a858dae-ffb9-4134-b5a9-757dd3b853c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:30.052884 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a858dae-ffb9-4134-b5a9-757dd3b853c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:30.054506 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8a858dae-ffb9-4134-b5a9-757dd3b853c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:30.153606 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a858dae-ffb9-4134-b5a9-757dd3b853c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:04:30.155197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a858dae-ffb9-4134-b5a9-757dd3b853c4 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:04:30.174115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 735/1434] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:04:30.984348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46181858-827c-432a-9ac2-171a4ce2e57f None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:30.984935 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46181858-827c-432a-9ac2-171a4ce2e57f None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:30.984935 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46181858-827c-432a-9ac2-171a4ce2e57f None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:30.986296 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 700/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 10:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:04:30.991413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa608b14-c9e4-4bba-bb77-cebd8953e994 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:30.991871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa608b14-c9e4-4bba-bb77-cebd8953e994 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:30.991976 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa608b14-c9e4-4bba-bb77-cebd8953e994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:31.069067 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-aa608b14-c9e4-4bba-bb77-cebd8953e994 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:31.070194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-aa608b14-c9e4-4bba-bb77-cebd8953e994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:31.114822 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:31.171169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 736/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 10:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:31.322257 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46181858-827c-432a-9ac2-171a4ce2e57f None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:04:31.323673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-46181858-827c-432a-9ac2-171a4ce2e57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:31.470885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46181858-827c-432a-9ac2-171a4ce2e57f None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:04:31.528230 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:31.588001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d74aa-8b95-4da0-87b1-920ca66ab030 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:04:31.588629 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d74aa-8b95-4da0-87b1-920ca66ab030 service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:31.588919 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d74aa-8b95-4da0-87b1-920ca66ab030 service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:31.589199 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d74aa-8b95-4da0-87b1-920ca66ab030 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:31.590832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-806d74aa-8b95-4da0-87b1-920ca66ab030 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:31.682619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d74aa-8b95-4da0-87b1-920ca66ab030 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:04:31.684216 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d74aa-8b95-4da0-87b1-920ca66ab030 service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:04:31.702510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 701/1437] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:04:32.515625 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94f3a1-3aa7-4267-9b29-422aee3360c5 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:32.516158 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94f3a1-3aa7-4267-9b29-422aee3360c5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:32.516158 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94f3a1-3aa7-4267-9b29-422aee3360c5 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:32.517488 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 737/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 10:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:04:32.522332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d2adc-64f7-4835-b15f-4e7b0637121f None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:32.522773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d2adc-64f7-4835-b15f-4e7b0637121f None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:32.522909 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937d2adc-64f7-4835-b15f-4e7b0637121f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:32.597000 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-937d2adc-64f7-4835-b15f-4e7b0637121f None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:32.598183 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-937d2adc-64f7-4835-b15f-4e7b0637121f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:32.600234 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:32.695036 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 702/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 10:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:32.852059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94f3a1-3aa7-4267-9b29-422aee3360c5 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:04:32.854683 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ac94f3a1-3aa7-4267-9b29-422aee3360c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:33.014174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94f3a1-3aa7-4267-9b29-422aee3360c5 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:04:33.041648 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:33.128029 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32020b-fe35-4b47-b050-62cefa77b3d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:04:33.128703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32020b-fe35-4b47-b050-62cefa77b3d2 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:33.128986 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32020b-fe35-4b47-b050-62cefa77b3d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:33.129259 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32020b-fe35-4b47-b050-62cefa77b3d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:33.130885 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3c32020b-fe35-4b47-b050-62cefa77b3d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:33.224991 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32020b-fe35-4b47-b050-62cefa77b3d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:04:33.226597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32020b-fe35-4b47-b050-62cefa77b3d2 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:04:33.245594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 738/1440] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:04:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:04:35.182116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d7ecc-ea67-4b54-9709-ea960fe15d84 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:35.182676 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d7ecc-ea67-4b54-9709-ea960fe15d84 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:35.182784 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d7ecc-ea67-4b54-9709-ea960fe15d84 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:35.184214 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 703/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 10:04:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:04:35.189561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b0f80-e7fe-4dca-bb7a-acbe2cffd37f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:35.190031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b0f80-e7fe-4dca-bb7a-acbe2cffd37f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:35.190128 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b0f80-e7fe-4dca-bb7a-acbe2cffd37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:35.231979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:35.257990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-fb1b0f80-e7fe-4dca-bb7a-acbe2cffd37f None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:35.259730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fb1b0f80-e7fe-4dca-bb7a-acbe2cffd37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:35.358666 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 739/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 10:04:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:35.398768 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d7ecc-ea67-4b54-9709-ea960fe15d84 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:04:35.400369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-8e0d7ecc-ea67-4b54-9709-ea960fe15d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:35.504679 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d7ecc-ea67-4b54-9709-ea960fe15d84 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:04:35.657262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:35.700271 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c705cd0-b1a7-4cd4-99c2-c1b357047c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:04:35.700952 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c705cd0-b1a7-4cd4-99c2-c1b357047c9d service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:35.701204 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c705cd0-b1a7-4cd4-99c2-c1b357047c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:35.701481 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c705cd0-b1a7-4cd4-99c2-c1b357047c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:35.703117 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7c705cd0-b1a7-4cd4-99c2-c1b357047c9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:35.811768 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c705cd0-b1a7-4cd4-99c2-c1b357047c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:04:35.813231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c705cd0-b1a7-4cd4-99c2-c1b357047c9d service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:04:35.831421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 704/1443] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:04:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:04:37.986507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f36d8b-dc2c-441b-80e7-264c5159abcc None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:37.987044 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f36d8b-dc2c-441b-80e7-264c5159abcc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:37.987171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f36d8b-dc2c-441b-80e7-264c5159abcc None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:37.988549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 740/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 10:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:04:37.994590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f5505-d4a3-45ec-9865-ac0b828cc870 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:37.995020 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f5505-d4a3-45ec-9865-ac0b828cc870 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:37.995133 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f5505-d4a3-45ec-9865-ac0b828cc870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:38.059794 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-cd1f5505-d4a3-45ec-9865-ac0b828cc870 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:38.061018 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-cd1f5505-d4a3-45ec-9865-ac0b828cc870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:38.073419 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:38.157748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 705/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 10:04:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:38.197905 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f36d8b-dc2c-441b-80e7-264c5159abcc None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:04:38.199592 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-89f36d8b-dc2c-441b-80e7-264c5159abcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:38.305082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f36d8b-dc2c-441b-80e7-264c5159abcc None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:04:38.317494 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:38.380629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26a7b9-6a1e-4c12-8669-bd097f8a5aed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:04:38.381246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26a7b9-6a1e-4c12-8669-bd097f8a5aed service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:38.381525 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26a7b9-6a1e-4c12-8669-bd097f8a5aed service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:38.381799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26a7b9-6a1e-4c12-8669-bd097f8a5aed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:38.384344 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ee26a7b9-6a1e-4c12-8669-bd097f8a5aed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:38.492899 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26a7b9-6a1e-4c12-8669-bd097f8a5aed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:04:38.494333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26a7b9-6a1e-4c12-8669-bd097f8a5aed service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:04:38.513535 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 741/1446] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:04:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:04:40.932682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7564e13-68b1-4ef9-a5cb-a555f42eac25 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:40.933242 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7564e13-68b1-4ef9-a5cb-a555f42eac25 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:40.933242 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7564e13-68b1-4ef9-a5cb-a555f42eac25 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:40.934651 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 706/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 10:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:04:40.939948 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862df7-9d56-446c-8979-f32b6db5ad04 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:40.940351 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862df7-9d56-446c-8979-f32b6db5ad04 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:40.940501 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34862df7-9d56-446c-8979-f32b6db5ad04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:40.990330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:41.010459 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-34862df7-9d56-446c-8979-f32b6db5ad04 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:41.011683 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-34862df7-9d56-446c-8979-f32b6db5ad04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:41.117734 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 742/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 10:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:41.156628 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7564e13-68b1-4ef9-a5cb-a555f42eac25 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:04:41.158196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b7564e13-68b1-4ef9-a5cb-a555f42eac25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:41.263500 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7564e13-68b1-4ef9-a5cb-a555f42eac25 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:04:41.308823 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:41.343919 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9d7c2-4b80-4a8c-9feb-0500f79389e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:04:41.344556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9d7c2-4b80-4a8c-9feb-0500f79389e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:41.344832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9d7c2-4b80-4a8c-9feb-0500f79389e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:41.345096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9d7c2-4b80-4a8c-9feb-0500f79389e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:41.346697 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-77d9d7c2-4b80-4a8c-9feb-0500f79389e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:41.453436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9d7c2-4b80-4a8c-9feb-0500f79389e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:04:41.454932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9d7c2-4b80-4a8c-9feb-0500f79389e7 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:04:41.473987 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 707/1449] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:04:43.637048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c43e9-ec0f-493d-9154-03ca8afed3fc None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:43.637580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c43e9-ec0f-493d-9154-03ca8afed3fc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:43.637580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c43e9-ec0f-493d-9154-03ca8afed3fc None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:43.638890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 743/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 10:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:04:43.644411 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e63e4-be6c-49cd-a9aa-359ef3ff5156 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:43.644840 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e63e4-be6c-49cd-a9aa-359ef3ff5156 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:43.645010 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e63e4-be6c-49cd-a9aa-359ef3ff5156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:43.709462 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-e47e63e4-be6c-49cd-a9aa-359ef3ff5156 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:43.710867 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e47e63e4-be6c-49cd-a9aa-359ef3ff5156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:43.731666 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:43.810579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 708/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 10:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:43.849004 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c43e9-ec0f-493d-9154-03ca8afed3fc None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:04:43.851145 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-766c43e9-ec0f-493d-9154-03ca8afed3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:43.954484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c43e9-ec0f-493d-9154-03ca8afed3fc None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:04:43.974401 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:44.029286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b6caba-81ff-485b-96e2-b456ce9b2c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:04:44.029901 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6caba-81ff-485b-96e2-b456ce9b2c4e service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:44.030183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6caba-81ff-485b-96e2-b456ce9b2c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:44.030460 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b6caba-81ff-485b-96e2-b456ce9b2c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:44.032087 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-49b6caba-81ff-485b-96e2-b456ce9b2c4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:44.140561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6caba-81ff-485b-96e2-b456ce9b2c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:04:44.141982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b6caba-81ff-485b-96e2-b456ce9b2c4e service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:04:44.160853 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 744/1452] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:04:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:04:46.281453 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e779ea6-ff0b-4451-b956-2d8fae07c735 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:46.282011 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e779ea6-ff0b-4451-b956-2d8fae07c735 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:46.282011 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e779ea6-ff0b-4451-b956-2d8fae07c735 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:46.283325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 709/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 10:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:04:46.289169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e5c13-f778-41ff-b22e-195f0c63b746 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:46.289613 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e5c13-f778-41ff-b22e-195f0c63b746 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:46.289714 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e5c13-f778-41ff-b22e-195f0c63b746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:46.353427 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:46.356701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-871e5c13-f778-41ff-b22e-195f0c63b746 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:46.358296 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-871e5c13-f778-41ff-b22e-195f0c63b746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:46.457681 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 745/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 10:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:46.496806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e779ea6-ff0b-4451-b956-2d8fae07c735 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:04:46.498335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-0e779ea6-ff0b-4451-b956-2d8fae07c735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:46.603507 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e779ea6-ff0b-4451-b956-2d8fae07c735 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:04:46.655653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:46.681172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db007b8f-5d2a-4ee6-a014-b5797456fbe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:04:46.681794 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db007b8f-5d2a-4ee6-a014-b5797456fbe4 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:46.682081 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db007b8f-5d2a-4ee6-a014-b5797456fbe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:46.682355 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db007b8f-5d2a-4ee6-a014-b5797456fbe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:46.683991 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-db007b8f-5d2a-4ee6-a014-b5797456fbe4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:46.793420 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db007b8f-5d2a-4ee6-a014-b5797456fbe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:04:46.794856 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db007b8f-5d2a-4ee6-a014-b5797456fbe4 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:04:46.812825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 710/1455] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:04:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:04:48.879130 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ece4c7-e7b3-4104-9673-e3701447047d None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:48.879669 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ece4c7-e7b3-4104-9673-e3701447047d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:48.879669 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ece4c7-e7b3-4104-9673-e3701447047d None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:48.881685 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 746/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 10:04:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:04:48.886926 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f100d9-2373-4389-9cf3-2dc5ad1d1625 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:48.887369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f100d9-2373-4389-9cf3-2dc5ad1d1625 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:48.887479 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f100d9-2373-4389-9cf3-2dc5ad1d1625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:48.953307 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-31f100d9-2373-4389-9cf3-2dc5ad1d1625 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:48.954502 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-31f100d9-2373-4389-9cf3-2dc5ad1d1625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:48.983497 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:49.051569 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 711/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 10:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:49.090118 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ece4c7-e7b3-4104-9673-e3701447047d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:04:49.091661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c0ece4c7-e7b3-4104-9673-e3701447047d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:49.199707 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ece4c7-e7b3-4104-9673-e3701447047d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:04:49.228409 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:49.274243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a502219-c68f-4a3d-8bbe-e583837bedb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:04:49.274857 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a502219-c68f-4a3d-8bbe-e583837bedb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:49.275142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a502219-c68f-4a3d-8bbe-e583837bedb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:49.275416 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a502219-c68f-4a3d-8bbe-e583837bedb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:49.277086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5a502219-c68f-4a3d-8bbe-e583837bedb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:49.398740 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a502219-c68f-4a3d-8bbe-e583837bedb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:04:49.400183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a502219-c68f-4a3d-8bbe-e583837bedb5 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:04:49.419532 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 747/1458] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:04:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:04:51.548039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcd46e-3a4d-4854-9157-33e029894f51 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:51.548568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcd46e-3a4d-4854-9157-33e029894f51 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:51.548568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcd46e-3a4d-4854-9157-33e029894f51 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:51.549886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 712/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 10:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:04:51.556406 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667270d-09d8-4baa-99c1-110da38d0488 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:51.556847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667270d-09d8-4baa-99c1-110da38d0488 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:51.557107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667270d-09d8-4baa-99c1-110da38d0488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:51.624116 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5667270d-09d8-4baa-99c1-110da38d0488 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:51.625354 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5667270d-09d8-4baa-99c1-110da38d0488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:51.634130 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:51.723852 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 748/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 10:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:51.763208 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcd46e-3a4d-4854-9157-33e029894f51 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:04:51.764804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-c4bcd46e-3a4d-4854-9157-33e029894f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:51.867437 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcd46e-3a4d-4854-9157-33e029894f51 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:04:51.923081 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:51.941333 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a28850-9bb1-45da-9c50-521fe17446c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:04:51.941950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a28850-9bb1-45da-9c50-521fe17446c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:51.942313 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a28850-9bb1-45da-9c50-521fe17446c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:51.943112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a28850-9bb1-45da-9c50-521fe17446c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:51.944775 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-53a28850-9bb1-45da-9c50-521fe17446c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:52.051287 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a28850-9bb1-45da-9c50-521fe17446c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:04:52.052746 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a28850-9bb1-45da-9c50-521fe17446c8 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:04:52.071092 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 713/1461] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:04:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:04:54.131018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba88120-f37a-4938-9772-83187dac8210 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:54.131608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba88120-f37a-4938-9772-83187dac8210 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:54.131608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba88120-f37a-4938-9772-83187dac8210 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:54.133034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 749/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 10:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:04:54.138889 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a868833-bcb5-46a9-8a77-4dbee8fc2766 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:54.139395 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a868833-bcb5-46a9-8a77-4dbee8fc2766 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:54.139503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a868833-bcb5-46a9-8a77-4dbee8fc2766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:54.207927 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-4a868833-bcb5-46a9-8a77-4dbee8fc2766 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:54.209923 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4a868833-bcb5-46a9-8a77-4dbee8fc2766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:54.248322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:54.307060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 714/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 10:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:54.345418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba88120-f37a-4938-9772-83187dac8210 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:04:54.346980 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6ba88120-f37a-4938-9772-83187dac8210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:54.452624 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba88120-f37a-4938-9772-83187dac8210 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:04:54.491286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:54.528970 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36880931-292b-4545-996a-3192a2dac955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:04:54.529585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36880931-292b-4545-996a-3192a2dac955 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:54.529863 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36880931-292b-4545-996a-3192a2dac955 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:54.530134 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36880931-292b-4545-996a-3192a2dac955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:54.531738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-36880931-292b-4545-996a-3192a2dac955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:54.642525 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36880931-292b-4545-996a-3192a2dac955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:04:54.643957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36880931-292b-4545-996a-3192a2dac955 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:04:54.662402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 750/1464] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:04:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:04:56.686262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28a777-05c1-42f4-a8e0-be2236618755 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:56.686778 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28a777-05c1-42f4-a8e0-be2236618755 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:56.686778 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28a777-05c1-42f4-a8e0-be2236618755 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:56.688181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 715/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 10:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:04:56.693829 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf273cb3-58e5-4ef9-ae0d-6262f14adb16 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:56.694265 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf273cb3-58e5-4ef9-ae0d-6262f14adb16 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:56.694372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf273cb3-58e5-4ef9-ae0d-6262f14adb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:56.761873 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-cf273cb3-58e5-4ef9-ae0d-6262f14adb16 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:56.763101 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cf273cb3-58e5-4ef9-ae0d-6262f14adb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:56.783321 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:56.865365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 751/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 10:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:56.903100 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28a777-05c1-42f4-a8e0-be2236618755 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:04:56.904599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2a28a777-05c1-42f4-a8e0-be2236618755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:57.006806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28a777-05c1-42f4-a8e0-be2236618755 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:04:57.071465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:57.078767 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f320f-ebb9-45de-8bbd-3c5c546e3a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:04:57.079375 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f320f-ebb9-45de-8bbd-3c5c546e3a4f service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:57.079655 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f320f-ebb9-45de-8bbd-3c5c546e3a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:57.079925 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f320f-ebb9-45de-8bbd-3c5c546e3a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:57.081560 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-0a8f320f-ebb9-45de-8bbd-3c5c546e3a4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:57.189322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f320f-ebb9-45de-8bbd-3c5c546e3a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:04:57.190758 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f320f-ebb9-45de-8bbd-3c5c546e3a4f service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:04:57.208881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 716/1467] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:04:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:04:59.212973 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9667aef-8943-482b-be77-be721c44ca36 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:59.213579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9667aef-8943-482b-be77-be721c44ca36 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:59.213579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9667aef-8943-482b-be77-be721c44ca36 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:59.214873 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 752/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 10:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:04:59.220092 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ca162-77a2-463a-b2f2-a4591fac9113 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:59.220563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ca162-77a2-463a-b2f2-a4591fac9113 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:59.220672 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ca162-77a2-463a-b2f2-a4591fac9113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:59.287700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-404ca162-77a2-463a-b2f2-a4591fac9113 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:04:59.292364 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-404ca162-77a2-463a-b2f2-a4591fac9113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:59.337596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:59.386479 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 717/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 10:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:04:59.423573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9667aef-8943-482b-be77-be721c44ca36 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:04:59.425175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e9667aef-8943-482b-be77-be721c44ca36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:59.530402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9667aef-8943-482b-be77-be721c44ca36 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:04:59.578109 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:04:59.604722 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64ab66-5eee-4a01-a456-5107c93576e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:04:59.605336 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64ab66-5eee-4a01-a456-5107c93576e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:04:59.605618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64ab66-5eee-4a01-a456-5107c93576e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:04:59.605893 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64ab66-5eee-4a01-a456-5107c93576e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:04:59.607513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8a64ab66-5eee-4a01-a456-5107c93576e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:04:59.717128 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64ab66-5eee-4a01-a456-5107c93576e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:04:59.718550 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64ab66-5eee-4a01-a456-5107c93576e2 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:04:59.736822 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 753/1470] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:05:09.384704 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=22 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:05:09.734481 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=66 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:05:19.355682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dadb7-9676-4f3f-a886-65fdce3152dc None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:19.356279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dadb7-9676-4f3f-a886-65fdce3152dc None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:19.356379 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dadb7-9676-4f3f-a886-65fdce3152dc None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:19.357744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 718/1471] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:05:19.363062 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888f866-e410-4d48-85d5-fdb1d68c81ec None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:19.363491 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888f866-e410-4d48-85d5-fdb1d68c81ec None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:19.363586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888f866-e410-4d48-85d5-fdb1d68c81ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:19.430103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7888f866-e410-4d48-85d5-fdb1d68c81ec None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:05:19.431298 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7888f866-e410-4d48-85d5-fdb1d68c81ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:19.530524 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 754/1472] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:05:19.621360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5889c89-1106-449c-955e-8cf987b6671b None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:19.621643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5889c89-1106-449c-955e-8cf987b6671b None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:19.621915 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5889c89-1106-449c-955e-8cf987b6671b None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:19.623261 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 719/1473] 10.222.0.85 () {54 vars in 966 bytes} [Tue Aug 2 10:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:05:19.628250 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8791420-6855-4e35-8f8d-7165c9c80861 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:19.628578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8791420-6855-4e35-8f8d-7165c9c80861 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:19.628857 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8791420-6855-4e35-8f8d-7165c9c80861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:19.704247 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a8791420-6855-4e35-8f8d-7165c9c80861 None None] MFA Rules not processed for user `0af63c36df2c4ceaa2df4d3ac59542bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:05:19.706045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a8791420-6855-4e35-8f8d-7165c9c80861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:19.726095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:05:19.785188 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 755/1474] 10.222.0.85 () {58 vars in 1063 bytes} [Tue Aug 2 10:05:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:05:19.792297 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5889c89-1106-449c-955e-8cf987b6671b None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:05:19.793834 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e5889c89-1106-449c-955e-8cf987b6671b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:19.899432 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5889c89-1106-449c-955e-8cf987b6671b None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:05:19.976285 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ba022-fcb5-4139-8447-c9d4eeb7da45 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0af63c36df2c4ceaa2df4d3ac59542bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:05:19.976922 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ba022-fcb5-4139-8447-c9d4eeb7da45 service glance] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:19.977209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ba022-fcb5-4139-8447-c9d4eeb7da45 service glance] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:19.977485 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ba022-fcb5-4139-8447-c9d4eeb7da45 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:19.979156 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-fd2ba022-fcb5-4139-8447-c9d4eeb7da45 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:20.037627 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:05:20.101160 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ba022-fcb5-4139-8447-c9d4eeb7da45 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:05:20.102609 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ba022-fcb5-4139-8447-c9d4eeb7da45 service glance] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:05:20.124095 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 720/1475] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:05:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:05:22.275555 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f89011-27e1-4d64-949f-69d28c78787d None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:22.276098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f89011-27e1-4d64-949f-69d28c78787d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:22.276098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f89011-27e1-4d64-949f-69d28c78787d None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:22.277496 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 756/1476] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:05:22.282853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb466bd-a9b1-4f48-93ec-f322f604d600 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:22.283298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb466bd-a9b1-4f48-93ec-f322f604d600 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:22.283416 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb466bd-a9b1-4f48-93ec-f322f604d600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:22.353365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-cfb466bd-a9b1-4f48-93ec-f322f604d600 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:05:22.354584 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-cfb466bd-a9b1-4f48-93ec-f322f604d600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:22.455474 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 721/1477] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:05:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:05:22.478512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f89011-27e1-4d64-949f-69d28c78787d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:05:22.480047 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e4f89011-27e1-4d64-949f-69d28c78787d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:22.609182 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f89011-27e1-4d64-949f-69d28c78787d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:05:22.659941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:05:22.705683 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b3f3a-6a65-4528-bf19-d0c75cb17d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:05:22.706301 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b3f3a-6a65-4528-bf19-d0c75cb17d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:22.706588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b3f3a-6a65-4528-bf19-d0c75cb17d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:22.706864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b3f3a-6a65-4528-bf19-d0c75cb17d1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:22.707561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b3f3a-6a65-4528-bf19-d0c75cb17d1d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:05:22.709323 dv-cinder-850318-6-smb devstack@keystone.service[80330]: WARNING py.warnings [None req-b90b3f3a-6a65-4528-bf19-d0c75cb17d1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:05:22.709323 dv-cinder-850318-6-smb devstack@keystone.service[80330]: warnings.warn(msg) Aug 02 10:05:22.709323 dv-cinder-850318-6-smb devstack@keystone.service[80330]: Aug 02 10:05:22.710474 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b3f3a-6a65-4528-bf19-d0c75cb17d1d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:05:22.729894 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 757/1478] 10.222.0.85 () {56 vars in 1108 bytes} [Tue Aug 2 10:05:22 2022] GET /identity/v3/projects => generated 2553 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:05:24.774982 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b81aa6-b3d1-4f2f-8fa6-e6a4b9cecfbe None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:24.775524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b81aa6-b3d1-4f2f-8fa6-e6a4b9cecfbe None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:24.775524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b81aa6-b3d1-4f2f-8fa6-e6a4b9cecfbe None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:24.776936 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 722/1479] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:05:24.782239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc38f69-9089-498b-9516-53dc844e328e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:24.783026 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc38f69-9089-498b-9516-53dc844e328e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:24.783314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc38f69-9089-498b-9516-53dc844e328e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:24.851256 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9fc38f69-9089-498b-9516-53dc844e328e None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:05:24.852518 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9fc38f69-9089-498b-9516-53dc844e328e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:24.951705 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 758/1480] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:05:24.996358 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b81aa6-b3d1-4f2f-8fa6-e6a4b9cecfbe None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:05:24.998046 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-21b81aa6-b3d1-4f2f-8fa6-e6a4b9cecfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:25.007999 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:05:25.147019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b81aa6-b3d1-4f2f-8fa6-e6a4b9cecfbe None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:05:25.228126 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:05:25.262730 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1762a-f0e5-4a1a-8cf9-8253a09c175f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:05:25.263377 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1762a-f0e5-4a1a-8cf9-8253a09c175f service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:25.263637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1762a-f0e5-4a1a-8cf9-8253a09c175f service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:25.263911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1762a-f0e5-4a1a-8cf9-8253a09c175f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:25.265619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-38b1762a-f0e5-4a1a-8cf9-8253a09c175f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:25.359874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1762a-f0e5-4a1a-8cf9-8253a09c175f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:05:25.361756 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1762a-f0e5-4a1a-8cf9-8253a09c175f service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:05:25.379989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 723/1481] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:05:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:05:27.584519 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0070dae-0214-43c7-91ed-1e79c5b36a21 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:27.585040 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0070dae-0214-43c7-91ed-1e79c5b36a21 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:27.585040 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0070dae-0214-43c7-91ed-1e79c5b36a21 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:27.586345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 759/1482] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:05:27.591928 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed11fe-8bf4-4f44-9261-7d5edd9f2725 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:27.592515 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed11fe-8bf4-4f44-9261-7d5edd9f2725 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:27.592515 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ed11fe-8bf4-4f44-9261-7d5edd9f2725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:27.668723 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-a7ed11fe-8bf4-4f44-9261-7d5edd9f2725 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:05:27.669975 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a7ed11fe-8bf4-4f44-9261-7d5edd9f2725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:27.725241 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:05:27.785947 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 724/1483] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:05:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:05:27.838634 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0070dae-0214-43c7-91ed-1e79c5b36a21 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:05:27.840850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d0070dae-0214-43c7-91ed-1e79c5b36a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:27.871968 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:05:27.975100 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0070dae-0214-43c7-91ed-1e79c5b36a21 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:05:28.056661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12cbd2-842f-4241-b421-dd271dc6bbb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:05:28.057284 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12cbd2-842f-4241-b421-dd271dc6bbb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:28.057562 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12cbd2-842f-4241-b421-dd271dc6bbb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:28.057838 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12cbd2-842f-4241-b421-dd271dc6bbb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:28.059474 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ca12cbd2-842f-4241-b421-dd271dc6bbb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:28.135411 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:05:28.174327 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12cbd2-842f-4241-b421-dd271dc6bbb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:05:28.175772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12cbd2-842f-4241-b421-dd271dc6bbb8 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:05:28.196994 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 760/1484] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:05:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:05:30.316166 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208f251-ba31-4610-920d-c349b1e4a268 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:30.316760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208f251-ba31-4610-920d-c349b1e4a268 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:30.316760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208f251-ba31-4610-920d-c349b1e4a268 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:30.318112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 725/1485] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:05:30.323427 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d87e4a-bd69-4955-b816-b38e11abe742 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:30.323897 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d87e4a-bd69-4955-b816-b38e11abe742 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:30.324025 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d87e4a-bd69-4955-b816-b38e11abe742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:30.394604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-89d87e4a-bd69-4955-b816-b38e11abe742 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:05:30.395830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-89d87e4a-bd69-4955-b816-b38e11abe742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:30.494378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 761/1486] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:05:30.534156 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208f251-ba31-4610-920d-c349b1e4a268 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:05:30.535711 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-d208f251-ba31-4610-920d-c349b1e4a268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:30.644402 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208f251-ba31-4610-920d-c349b1e4a268 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:05:30.724195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:05:30.726135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c71cee-2d91-4263-a783-9d3848f88188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:05:30.726802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c71cee-2d91-4263-a783-9d3848f88188 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:30.727106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c71cee-2d91-4263-a783-9d3848f88188 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:30.727383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c71cee-2d91-4263-a783-9d3848f88188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:30.729847 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a1c71cee-2d91-4263-a783-9d3848f88188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:30.848503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c71cee-2d91-4263-a783-9d3848f88188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:05:30.849938 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c71cee-2d91-4263-a783-9d3848f88188 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:05:30.868641 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 726/1487] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:05:33.049208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2402a-236c-46ee-a86b-2470c1350832 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:33.049747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2402a-236c-46ee-a86b-2470c1350832 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:33.049747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2402a-236c-46ee-a86b-2470c1350832 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:33.051138 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 762/1488] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:05:33.056307 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654aca55-9d9c-4fb4-a720-5a18c1e8aac8 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:33.056742 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654aca55-9d9c-4fb4-a720-5a18c1e8aac8 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:33.056934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654aca55-9d9c-4fb4-a720-5a18c1e8aac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:33.126374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-654aca55-9d9c-4fb4-a720-5a18c1e8aac8 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:05:33.127607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-654aca55-9d9c-4fb4-a720-5a18c1e8aac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:33.182408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:05:33.228333 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 727/1489] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:05:33.269757 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2402a-236c-46ee-a86b-2470c1350832 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:05:33.271292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fcd2402a-236c-46ee-a86b-2470c1350832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:33.310733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:05:33.386114 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2402a-236c-46ee-a86b-2470c1350832 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:05:33.461732 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd15156-bfb7-4797-91f1-e3eb46aa3462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:05:33.462343 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd15156-bfb7-4797-91f1-e3eb46aa3462 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:33.462621 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd15156-bfb7-4797-91f1-e3eb46aa3462 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:33.462890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd15156-bfb7-4797-91f1-e3eb46aa3462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:33.464525 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1bd15156-bfb7-4797-91f1-e3eb46aa3462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:33.546579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:05:33.577656 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd15156-bfb7-4797-91f1-e3eb46aa3462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:05:33.579155 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd15156-bfb7-4797-91f1-e3eb46aa3462 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:05:33.597746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 763/1490] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:05:35.925994 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38d698-8d71-49ba-9558-9307b8fd4fe7 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:35.926560 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38d698-8d71-49ba-9558-9307b8fd4fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:35.926560 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38d698-8d71-49ba-9558-9307b8fd4fe7 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:35.927912 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 728/1491] 10.222.0.85 () {54 vars in 926 bytes} [Tue Aug 2 10:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:05:35.933100 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427df992-fcbb-4d8a-8ef8-6870fd0cbe3b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:35.933513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427df992-fcbb-4d8a-8ef8-6870fd0cbe3b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:35.933652 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427df992-fcbb-4d8a-8ef8-6870fd0cbe3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:36.002765 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-427df992-fcbb-4d8a-8ef8-6870fd0cbe3b None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:05:36.003977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-427df992-fcbb-4d8a-8ef8-6870fd0cbe3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:36.100293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 764/1492] 10.222.0.85 () {58 vars in 1023 bytes} [Tue Aug 2 10:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:05:36.141455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38d698-8d71-49ba-9558-9307b8fd4fe7 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:05:36.143018 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-6c38d698-8d71-49ba-9558-9307b8fd4fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:36.247386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38d698-8d71-49ba-9558-9307b8fd4fe7 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:05:36.321050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc850ea-8ba8-4a29-8335-d6338a865da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:05:36.322269 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc850ea-8ba8-4a29-8335-d6338a865da3 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:05:36.322566 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc850ea-8ba8-4a29-8335-d6338a865da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:05:36.322849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc850ea-8ba8-4a29-8335-d6338a865da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:05:36.324578 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2cc850ea-8ba8-4a29-8335-d6338a865da3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:05:36.334533 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:05:36.434143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc850ea-8ba8-4a29-8335-d6338a865da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:05:36.435579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc850ea-8ba8-4a29-8335-d6338a865da3 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:05:36.454991 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 729/1493] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:05:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:05:46.098683 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=82 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:05:46.452020 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=50 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:07:05.942904 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58c914-5b4f-42fe-a7ba-9a759b9e1752 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:07:05.943516 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58c914-5b4f-42fe-a7ba-9a759b9e1752 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:07:05.943516 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58c914-5b4f-42fe-a7ba-9a759b9e1752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:07:06.021261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1e58c914-5b4f-42fe-a7ba-9a759b9e1752 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:07:06.022481 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1e58c914-5b4f-42fe-a7ba-9a759b9e1752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:07:06.121670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 765/1494] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:07:06.130263 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7022ab-d285-42f1-98b2-a4cb02070d50 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:07:06.130786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7022ab-d285-42f1-98b2-a4cb02070d50 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:07:06.130786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7022ab-d285-42f1-98b2-a4cb02070d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:07:06.208917 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-3b7022ab-d285-42f1-98b2-a4cb02070d50 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:07:06.210053 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-3b7022ab-d285-42f1-98b2-a4cb02070d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:07:06.314719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 730/1495] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:07:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:07:06.319426 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58c914-5b4f-42fe-a7ba-9a759b9e1752 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:07:06.320719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1e58c914-5b4f-42fe-a7ba-9a759b9e1752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:07:06.333009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58c914-5b4f-42fe-a7ba-9a759b9e1752 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:07:06.400260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:07:06.436446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a69ce-4d43-432d-b748-7ab1f338a2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:07:06.437097 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a69ce-4d43-432d-b748-7ab1f338a2bf admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:07:06.437379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a69ce-4d43-432d-b748-7ab1f338a2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:07:06.437654 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a69ce-4d43-432d-b748-7ab1f338a2bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:07:06.438356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a69ce-4d43-432d-b748-7ab1f338a2bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:07:06.438668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a69ce-4d43-432d-b748-7ab1f338a2bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:07:06.439685 dv-cinder-850318-6-smb devstack@keystone.service[80330]: WARNING py.warnings [None req-dc1a69ce-4d43-432d-b748-7ab1f338a2bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:07:06.439685 dv-cinder-850318-6-smb devstack@keystone.service[80330]: warnings.warn(msg) Aug 02 10:07:06.439685 dv-cinder-850318-6-smb devstack@keystone.service[80330]: Aug 02 10:07:06.440633 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a69ce-4d43-432d-b748-7ab1f338a2bf admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:07:06.453639 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 766/1496] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:07:06.462105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7022ab-d285-42f1-98b2-a4cb02070d50 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:07:06.471975 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7022ab-d285-42f1-98b2-a4cb02070d50 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:07:06.534771 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:07:06.570025 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bd125-a6e1-474e-8628-9e7b420b28bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:07:06.570648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bd125-a6e1-474e-8628-9e7b420b28bf admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:07:06.570927 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bd125-a6e1-474e-8628-9e7b420b28bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:07:06.571196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bd125-a6e1-474e-8628-9e7b420b28bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:07:06.571874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861bd125-a6e1-474e-8628-9e7b420b28bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:07:06.573660 dv-cinder-850318-6-smb devstack@keystone.service[80329]: WARNING py.warnings [None req-861bd125-a6e1-474e-8628-9e7b420b28bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:07:06.573660 dv-cinder-850318-6-smb devstack@keystone.service[80329]: warnings.warn(msg) Aug 02 10:07:06.573660 dv-cinder-850318-6-smb devstack@keystone.service[80329]: Aug 02 10:07:06.575017 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861bd125-a6e1-474e-8628-9e7b420b28bf admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:07:06.634235 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 731/1497] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:07:06 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:07:06.638851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a69ce-4d43-432d-b748-7ab1f338a2bf admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:07:06.640436 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dc1a69ce-4d43-432d-b748-7ab1f338a2bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:07:06.677695 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a69ce-4d43-432d-b748-7ab1f338a2bf admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:07:06.781225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010d51c-a268-44d0-8c10-46328ff51f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:07:06.781752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010d51c-a268-44d0-8c10-46328ff51f66 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:07:06.782031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010d51c-a268-44d0-8c10-46328ff51f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:07:06.782304 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010d51c-a268-44d0-8c10-46328ff51f66 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:07:06.782979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010d51c-a268-44d0-8c10-46328ff51f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:07:06.784026 dv-cinder-850318-6-smb devstack@keystone.service[80330]: WARNING py.warnings [None req-c010d51c-a268-44d0-8c10-46328ff51f66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:07:06.784026 dv-cinder-850318-6-smb devstack@keystone.service[80330]: warnings.warn(msg) Aug 02 10:07:06.784026 dv-cinder-850318-6-smb devstack@keystone.service[80330]: Aug 02 10:07:06.785270 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010d51c-a268-44d0-8c10-46328ff51f66 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:07:06.828633 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 767/1498] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:07:06 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:07:06.832719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bd125-a6e1-474e-8628-9e7b420b28bf admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:07:06.834214 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-861bd125-a6e1-474e-8628-9e7b420b28bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:07:06.895691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bd125-a6e1-474e-8628-9e7b420b28bf admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:07:06.977373 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:07:06.988967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85654ad2-47e1-489c-bb81-eb3f9acbc9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:07:06.989593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85654ad2-47e1-489c-bb81-eb3f9acbc9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:07:06.989914 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85654ad2-47e1-489c-bb81-eb3f9acbc9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:07:06.990189 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85654ad2-47e1-489c-bb81-eb3f9acbc9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:07:06.990892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85654ad2-47e1-489c-bb81-eb3f9acbc9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:07:06.991908 dv-cinder-850318-6-smb devstack@keystone.service[80329]: WARNING py.warnings [None req-85654ad2-47e1-489c-bb81-eb3f9acbc9c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:07:06.991908 dv-cinder-850318-6-smb devstack@keystone.service[80329]: warnings.warn(msg) Aug 02 10:07:06.991908 dv-cinder-850318-6-smb devstack@keystone.service[80329]: Aug 02 10:07:06.992836 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85654ad2-47e1-489c-bb81-eb3f9acbc9c2 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:07:07.005834 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 732/1499] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:07:07.009898 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010d51c-a268-44d0-8c10-46328ff51f66 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:07:07.012073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c010d51c-a268-44d0-8c10-46328ff51f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:07:07.023748 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010d51c-a268-44d0-8c10-46328ff51f66 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:07:07.048811 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:07:07.121187 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ede3f-e6fa-43eb-be0e-215bcbc16cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:07:07.121805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ede3f-e6fa-43eb-be0e-215bcbc16cda admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:07:07.122085 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ede3f-e6fa-43eb-be0e-215bcbc16cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:07:07.122358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ede3f-e6fa-43eb-be0e-215bcbc16cda admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:07:07.123055 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ede3f-e6fa-43eb-be0e-215bcbc16cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:07:07.124063 dv-cinder-850318-6-smb devstack@keystone.service[80330]: WARNING py.warnings [None req-2b9ede3f-e6fa-43eb-be0e-215bcbc16cda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:07:07.124063 dv-cinder-850318-6-smb devstack@keystone.service[80330]: warnings.warn(msg) Aug 02 10:07:07.124063 dv-cinder-850318-6-smb devstack@keystone.service[80330]: Aug 02 10:07:07.124977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ede3f-e6fa-43eb-be0e-215bcbc16cda admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:07:07.137420 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 768/1500] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:07:07.141620 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85654ad2-47e1-489c-bb81-eb3f9acbc9c2 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:07:07.143169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-85654ad2-47e1-489c-bb81-eb3f9acbc9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:07:07.176824 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85654ad2-47e1-489c-bb81-eb3f9acbc9c2 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:07:07.270284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ba52f-e2fb-405f-8825-8d32ee18db35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:07:07.270956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ba52f-e2fb-405f-8825-8d32ee18db35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:07:07.271243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ba52f-e2fb-405f-8825-8d32ee18db35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:07:07.271525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ba52f-e2fb-405f-8825-8d32ee18db35 admin admin] PATH_INFO: `/v3/projects/075cf005881746e18da7ebfe1c087871/users/4d6296d012094c61937cdfd1c4373c1a/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:07:07.294573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ba52f-e2fb-405f-8825-8d32ee18db35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=075cf005881746e18da7ebfe1c087871, user_id=4d6296d012094c61937cdfd1c4373c1a, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:07:07.296667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: WARNING py.warnings [None req-ea3ba52f-e2fb-405f-8825-8d32ee18db35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:07:07.296667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: warnings.warn(msg) Aug 02 10:07:07.296667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: Aug 02 10:07:07.297890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ba52f-e2fb-405f-8825-8d32ee18db35 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:07:07.325131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 733/1501] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:07:07 2022] PUT /identity/v3/projects/075cf005881746e18da7ebfe1c087871/users/4d6296d012094c61937cdfd1c4373c1a/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:07:07.337091 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae76fc-530d-4c7b-a8a1-dcdf6b538dce None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:07:07.337383 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae76fc-530d-4c7b-a8a1-dcdf6b538dce None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:07:07.337661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae76fc-530d-4c7b-a8a1-dcdf6b538dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:07:07.400608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3eae76fc-530d-4c7b-a8a1-dcdf6b538dce None None] MFA Rules not processed for user `4d6296d012094c61937cdfd1c4373c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:07:07.401948 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3eae76fc-530d-4c7b-a8a1-dcdf6b538dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:07:07.500288 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 769/1502] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:07:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:07:07.514459 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2d1ee-65e7-49fc-9908-762bd83b5e84 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:07:07.514743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2d1ee-65e7-49fc-9908-762bd83b5e84 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:07:07.515170 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2d1ee-65e7-49fc-9908-762bd83b5e84 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:07:07.516584 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 734/1503] 10.222.0.85 () {54 vars in 964 bytes} [Tue Aug 2 10:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:07:07.522255 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a16ee-c99d-407b-88cb-935aa93ea098 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:07:07.522547 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a16ee-c99d-407b-88cb-935aa93ea098 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:07:07.522824 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a16ee-c99d-407b-88cb-935aa93ea098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:07:07.555377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:07:07.605590 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3c5a16ee-c99d-407b-88cb-935aa93ea098 None None] MFA Rules not processed for user `8e4e240f7958425a99a2cc1110e40c13`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:07:07.606721 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3c5a16ee-c99d-407b-88cb-935aa93ea098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:07:07.687715 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 770/1504] 10.222.0.85 () {58 vars in 1061 bytes} [Tue Aug 2 10:07:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:07:07.695604 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2d1ee-65e7-49fc-9908-762bd83b5e84 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:07:07.697171 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f0f2d1ee-65e7-49fc-9908-762bd83b5e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:07:07.749711 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:07:07.808004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2d1ee-65e7-49fc-9908-762bd83b5e84 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:07:07.882653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a856ec-a8e3-4d97-942e-992c16155e6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:07:07.883182 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a856ec-a8e3-4d97-942e-992c16155e6c service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:07:07.883464 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a856ec-a8e3-4d97-942e-992c16155e6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:07:07.883738 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a856ec-a8e3-4d97-942e-992c16155e6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:07:07.885388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-00a856ec-a8e3-4d97-942e-992c16155e6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:07:07.992587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a856ec-a8e3-4d97-942e-992c16155e6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:07:07.994041 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a856ec-a8e3-4d97-942e-992c16155e6c service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:07:07.997673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:07:08.013060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 735/1505] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:07:07 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:07:08.060903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09799cfc-5d1e-4918-9b13-c59f065ce240 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:07:08.061378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09799cfc-5d1e-4918-9b13-c59f065ce240 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:07:08.061484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09799cfc-5d1e-4918-9b13-c59f065ce240 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:07:08.062724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 771/1506] 10.222.0.85 () {52 vars in 830 bytes} [Tue Aug 2 10:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:07:08.066406 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a856ec-a8e3-4d97-942e-992c16155e6c service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:07:08.067633 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-00a856ec-a8e3-4d97-942e-992c16155e6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:07:08.169429 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a856ec-a8e3-4d97-942e-992c16155e6c service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:07:08.272950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a70a6f-abec-451e-bb18-21be574e5e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:07:08.273594 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a70a6f-abec-451e-bb18-21be574e5e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:07:08.273916 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a70a6f-abec-451e-bb18-21be574e5e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:07:08.274188 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a70a6f-abec-451e-bb18-21be574e5e0c admin admin] PATH_INFO: `/v3/users/4d6296d012094c61937cdfd1c4373c1a` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:07:08.287494 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a70a6f-abec-451e-bb18-21be574e5e0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6296d012094c61937cdfd1c4373c1a)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:07:08.288569 dv-cinder-850318-6-smb devstack@keystone.service[80329]: WARNING py.warnings [None req-17a70a6f-abec-451e-bb18-21be574e5e0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:07:08.288569 dv-cinder-850318-6-smb devstack@keystone.service[80329]: warnings.warn(msg) Aug 02 10:07:08.288569 dv-cinder-850318-6-smb devstack@keystone.service[80329]: Aug 02 10:07:08.289800 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a70a6f-abec-451e-bb18-21be574e5e0c admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:07:08.303150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:07:08.367459 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-17a70a6f-abec-451e-bb18-21be574e5e0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6296d012094c61937cdfd1c4373c1a'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:07:08.368078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-17a70a6f-abec-451e-bb18-21be574e5e0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6296d012094c61937cdfd1c4373c1a'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:07:08.394063 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-17a70a6f-abec-451e-bb18-21be574e5e0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6296d012094c61937cdfd1c4373c1a'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:07:08.404647 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-17a70a6f-abec-451e-bb18-21be574e5e0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6296d012094c61937cdfd1c4373c1a'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:07:08.405176 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-17a70a6f-abec-451e-bb18-21be574e5e0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6296d012094c61937cdfd1c4373c1a'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:07:08.427255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 736/1507] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:07:08 2022] DELETE /identity/v3/users/4d6296d012094c61937cdfd1c4373c1a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:07:08.431676 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b733b2-f3a8-4d82-957f-f1251eaaafe4 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:07:08.431963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b733b2-f3a8-4d82-957f-f1251eaaafe4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:07:08.432275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b733b2-f3a8-4d82-957f-f1251eaaafe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:07:08.489624 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-60b733b2-f3a8-4d82-957f-f1251eaaafe4 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:07:08.490944 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-60b733b2-f3a8-4d82-957f-f1251eaaafe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:07:08.570587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:07:08.584851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 772/1508] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:07:08.595827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a70a6f-abec-451e-bb18-21be574e5e0c admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:07:08.597105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-17a70a6f-abec-451e-bb18-21be574e5e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:07:08.703554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a70a6f-abec-451e-bb18-21be574e5e0c admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:07:08.758940 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:07:08.781604 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9de99-57f7-418c-b767-53d817a75396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:07:08.782427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9de99-57f7-418c-b767-53d817a75396 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:07:08.782910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9de99-57f7-418c-b767-53d817a75396 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:07:08.783223 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9de99-57f7-418c-b767-53d817a75396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:07:08.784909 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-fae9de99-57f7-418c-b767-53d817a75396 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:07:08.912830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9de99-57f7-418c-b767-53d817a75396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:07:08.914276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9de99-57f7-418c-b767-53d817a75396 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:07:08.936875 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 737/1509] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:07:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:07:09.342974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b733b2-f3a8-4d82-957f-f1251eaaafe4 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:07:09.344218 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-60b733b2-f3a8-4d82-957f-f1251eaaafe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:07:09.356797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b733b2-f3a8-4d82-957f-f1251eaaafe4 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:07:09.466918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2400c950-63bf-4eb8-a297-9237a4946e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:07:09.467634 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400c950-63bf-4eb8-a297-9237a4946e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:07:09.467956 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400c950-63bf-4eb8-a297-9237a4946e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:07:09.468236 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2400c950-63bf-4eb8-a297-9237a4946e9f admin admin] PATH_INFO: `/v3/projects/075cf005881746e18da7ebfe1c087871` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:07:09.480329 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400c950-63bf-4eb8-a297-9237a4946e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=075cf005881746e18da7ebfe1c087871)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:07:09.481630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: WARNING py.warnings [None req-2400c950-63bf-4eb8-a297-9237a4946e9f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:07:09.481630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: warnings.warn(msg) Aug 02 10:07:09.481630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: Aug 02 10:07:09.482849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2400c950-63bf-4eb8-a297-9237a4946e9f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:07:09.544330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2400c950-63bf-4eb8-a297-9237a4946e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '075cf005881746e18da7ebfe1c087871', 'request_id': 'req-2400c950-63bf-4eb8-a297-9237a4946e9f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:07:09.557609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2400c950-63bf-4eb8-a297-9237a4946e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '075cf005881746e18da7ebfe1c087871', 'request_id': 'req-2400c950-63bf-4eb8-a297-9237a4946e9f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:07:09.564425 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2400c950-63bf-4eb8-a297-9237a4946e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '075cf005881746e18da7ebfe1c087871', 'request_id': 'req-2400c950-63bf-4eb8-a297-9237a4946e9f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:07:09.593199 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2400c950-63bf-4eb8-a297-9237a4946e9f admin admin] The token cache is being invalidate because project 075cf005881746e18da7ebfe1c087871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:07:09.593436 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2400c950-63bf-4eb8-a297-9237a4946e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:07:09.593924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2400c950-63bf-4eb8-a297-9237a4946e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:07:09.595302 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 773/1510] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:07:09 2022] DELETE /identity/v3/projects/075cf005881746e18da7ebfe1c087871 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:07:18.932912 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=62 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:07:19.589999 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:09:04.630827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62599c-e011-4c31-a3a3-113c323aa2a5 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:04.631390 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62599c-e011-4c31-a3a3-113c323aa2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:04.631390 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62599c-e011-4c31-a3a3-113c323aa2a5 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:04.632735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 738/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 10:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:09:04.637545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845102ba-5820-4d7e-857d-e2715ce25a54 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:04.637992 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845102ba-5820-4d7e-857d-e2715ce25a54 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:04.638099 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845102ba-5820-4d7e-857d-e2715ce25a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:04.719982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-845102ba-5820-4d7e-857d-e2715ce25a54 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:09:04.721241 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-845102ba-5820-4d7e-857d-e2715ce25a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:09:04.826490 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 774/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 10:09:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:09:04.986227 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62599c-e011-4c31-a3a3-113c323aa2a5 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:09:04.988329 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-3c62599c-e011-4c31-a3a3-113c323aa2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:09:05.110903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62599c-e011-4c31-a3a3-113c323aa2a5 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:09:05.117229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cafa0-e589-4398-b5b8-0cf7fef51ade service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:09:05.117836 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cafa0-e589-4398-b5b8-0cf7fef51ade service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:05.118117 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cafa0-e589-4398-b5b8-0cf7fef51ade service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:05.118388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cafa0-e589-4398-b5b8-0cf7fef51ade service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:05.126421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cafa0-e589-4398-b5b8-0cf7fef51ade service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:09:05.127993 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cafa0-e589-4398-b5b8-0cf7fef51ade service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:09:05.137329 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 739/1513] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:09:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:09:05.982079 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e23ce-8f5f-4142-b60d-2536f3bd11a8 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:05.982661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e23ce-8f5f-4142-b60d-2536f3bd11a8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:05.982661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e23ce-8f5f-4142-b60d-2536f3bd11a8 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:05.984038 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 775/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 10:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:09:05.989317 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcddd9-f709-4510-a34c-ba0f35df65ac None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:05.989790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcddd9-f709-4510-a34c-ba0f35df65ac None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:05.989911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fcddd9-f709-4510-a34c-ba0f35df65ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:06.009707 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-41fcddd9-f709-4510-a34c-ba0f35df65ac None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:09:06.010933 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-41fcddd9-f709-4510-a34c-ba0f35df65ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:09:06.018809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 740/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 10:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:09:06.175972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e23ce-8f5f-4142-b60d-2536f3bd11a8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:09:06.190705 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e23ce-8f5f-4142-b60d-2536f3bd11a8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:09:06.196425 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13397da6-d13d-4128-b00f-d5f20a218aa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:09:06.197050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13397da6-d13d-4128-b00f-d5f20a218aa4 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:06.197331 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13397da6-d13d-4128-b00f-d5f20a218aa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:06.197602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13397da6-d13d-4128-b00f-d5f20a218aa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:06.205795 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13397da6-d13d-4128-b00f-d5f20a218aa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:09:06.207545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13397da6-d13d-4128-b00f-d5f20a218aa4 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:09:06.218167 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 776/1516] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:09:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:09:06.455307 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c23b6-c766-40d2-b024-29509ea47153 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:06.455596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c23b6-c766-40d2-b024-29509ea47153 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:06.455879 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c23b6-c766-40d2-b024-29509ea47153 None None] PATH_INFO: `/v3` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:06.457211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 741/1517] 10.222.0.60 () {54 vars in 925 bytes} [Tue Aug 2 10:09:06 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:09:06.463644 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f5f80-09e9-47f6-a2e9-43eb77931e99 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:06.463939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f5f80-09e9-47f6-a2e9-43eb77931e99 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:06.464218 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f5f80-09e9-47f6-a2e9-43eb77931e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:06.523995 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-735f5f80-09e9-47f6-a2e9-43eb77931e99 None None] MFA Rules not processed for user `a2a420cc676e4f2bb2766826a1de3b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:09:06.525131 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-735f5f80-09e9-47f6-a2e9-43eb77931e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:09:06.541723 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:09:06.597924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 777/1518] 10.222.0.60 () {58 vars in 1015 bytes} [Tue Aug 2 10:09:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:09:10.410162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2fc26-be84-44e1-bb95-d2abe652e4d6 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:10.410710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2fc26-be84-44e1-bb95-d2abe652e4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:10.410817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2fc26-be84-44e1-bb95-d2abe652e4d6 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:10.413180 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 742/1519] 10.222.0.85 () {54 vars in 961 bytes} [Tue Aug 2 10:09:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:09:10.418011 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bce48-6922-4f54-9dd8-e34ddbc8aeae None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:10.418418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bce48-6922-4f54-9dd8-e34ddbc8aeae None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:10.418562 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bce48-6922-4f54-9dd8-e34ddbc8aeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:10.438814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-432bce48-6922-4f54-9dd8-e34ddbc8aeae None None] MFA Rules not processed for user `a2a420cc676e4f2bb2766826a1de3b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:09:10.439993 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-432bce48-6922-4f54-9dd8-e34ddbc8aeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:09:10.449440 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 778/1520] 10.222.0.85 () {58 vars in 1058 bytes} [Tue Aug 2 10:09:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:09:10.457043 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2fc26-be84-44e1-bb95-d2abe652e4d6 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:09:10.470520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2fc26-be84-44e1-bb95-d2abe652e4d6 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:09:10.476255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a02dd-be12-418e-8c53-3e5c7d81892b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2a420cc676e4f2bb2766826a1de3b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:09:10.476897 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a02dd-be12-418e-8c53-3e5c7d81892b service placement] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:10.477184 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a02dd-be12-418e-8c53-3e5c7d81892b service placement] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:10.477461 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a02dd-be12-418e-8c53-3e5c7d81892b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:10.486001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a02dd-be12-418e-8c53-3e5c7d81892b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:09:10.487609 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a02dd-be12-418e-8c53-3e5c7d81892b service placement] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:09:10.497853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 743/1521] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:09:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:09:17.463925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1300f-767d-44f5-b710-276767cf50ae None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:17.464519 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1300f-767d-44f5-b710-276767cf50ae None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:17.464519 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f1300f-767d-44f5-b710-276767cf50ae None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:17.465674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 779/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 10:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:09:17.470986 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0b66a-f8d6-4e29-be0d-2cda7313bde9 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:17.471438 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0b66a-f8d6-4e29-be0d-2cda7313bde9 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:17.471552 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0b66a-f8d6-4e29-be0d-2cda7313bde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:17.492122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-e8f0b66a-f8d6-4e29-be0d-2cda7313bde9 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:09:17.493346 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e8f0b66a-f8d6-4e29-be0d-2cda7313bde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:09:17.501509 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 744/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 10:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:09:17.656542 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1300f-767d-44f5-b710-276767cf50ae None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:09:17.671578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f1300f-767d-44f5-b710-276767cf50ae None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:09:17.676933 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554355a7-30a9-4724-a285-8cc409566e41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:09:17.677529 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554355a7-30a9-4724-a285-8cc409566e41 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:17.678025 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554355a7-30a9-4724-a285-8cc409566e41 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:17.678301 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554355a7-30a9-4724-a285-8cc409566e41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:17.686427 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554355a7-30a9-4724-a285-8cc409566e41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:09:17.687990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554355a7-30a9-4724-a285-8cc409566e41 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:09:17.697330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 780/1524] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:09:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:09:18.535244 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab74bdc-bb2e-4a37-9a29-271e56fbcb86 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:18.536082 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab74bdc-bb2e-4a37-9a29-271e56fbcb86 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:18.536256 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab74bdc-bb2e-4a37-9a29-271e56fbcb86 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:18.537903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 745/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 10:09:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:09:18.543063 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b77419-42d1-48cf-b979-353491bcbf1e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:18.543484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b77419-42d1-48cf-b979-353491bcbf1e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:18.543591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b77419-42d1-48cf-b979-353491bcbf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:18.562704 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e3b77419-42d1-48cf-b979-353491bcbf1e None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:09:18.563815 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e3b77419-42d1-48cf-b979-353491bcbf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:09:18.572246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 781/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 10:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:09:18.722590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab74bdc-bb2e-4a37-9a29-271e56fbcb86 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:09:18.737268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab74bdc-bb2e-4a37-9a29-271e56fbcb86 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:09:18.742642 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b3543-05aa-4734-8000-538f2d51f473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:09:18.743237 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b3543-05aa-4734-8000-538f2d51f473 service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:18.743520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b3543-05aa-4734-8000-538f2d51f473 service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:18.743795 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b3543-05aa-4734-8000-538f2d51f473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:18.751833 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b3543-05aa-4734-8000-538f2d51f473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:09:18.753536 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b3543-05aa-4734-8000-538f2d51f473 service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:09:18.763795 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 746/1527] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:09:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:09:22.662164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb956a-e82f-4ca5-9f70-2b7888942982 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:22.662765 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb956a-e82f-4ca5-9f70-2b7888942982 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:22.662765 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb956a-e82f-4ca5-9f70-2b7888942982 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:22.664043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 782/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 10:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:09:22.669296 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238785c7-664a-4bda-8594-9d4fbf92f4e9 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:22.669711 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238785c7-664a-4bda-8594-9d4fbf92f4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:22.669859 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238785c7-664a-4bda-8594-9d4fbf92f4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:22.689919 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-238785c7-664a-4bda-8594-9d4fbf92f4e9 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:09:22.691109 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-238785c7-664a-4bda-8594-9d4fbf92f4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:09:22.699922 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 747/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 10:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:09:22.773140 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb956a-e82f-4ca5-9f70-2b7888942982 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:09:22.774834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-70cb956a-e82f-4ca5-9f70-2b7888942982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:09:22.853914 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb956a-e82f-4ca5-9f70-2b7888942982 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:09:22.857462 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c5e5f-2040-4ab3-b840-d5d55fa38acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:09:22.858071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c5e5f-2040-4ab3-b840-d5d55fa38acd service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:22.858354 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c5e5f-2040-4ab3-b840-d5d55fa38acd service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:22.858629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c5e5f-2040-4ab3-b840-d5d55fa38acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:22.868696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c5e5f-2040-4ab3-b840-d5d55fa38acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:09:22.870118 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c5e5f-2040-4ab3-b840-d5d55fa38acd service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:09:22.879420 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 783/1530] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:09:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:09:24.870513 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fdfa7-a750-4f71-83db-75ec61c8285c None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:24.871195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fdfa7-a750-4f71-83db-75ec61c8285c None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:24.871195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fdfa7-a750-4f71-83db-75ec61c8285c None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:24.872545 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 748/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 10:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:09:24.877787 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708264af-a512-487d-8ee2-ac1c19357c8e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:24.878205 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708264af-a512-487d-8ee2-ac1c19357c8e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:24.878336 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708264af-a512-487d-8ee2-ac1c19357c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:24.898041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-708264af-a512-487d-8ee2-ac1c19357c8e None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:09:24.899216 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-708264af-a512-487d-8ee2-ac1c19357c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:09:24.906993 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 784/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 10:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:09:24.944614 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fdfa7-a750-4f71-83db-75ec61c8285c None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:09:24.955395 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fdfa7-a750-4f71-83db-75ec61c8285c None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:09:24.958896 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c9ac8-40e4-45e9-9cf6-d56a7a83c6da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:09:24.959724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c9ac8-40e4-45e9-9cf6-d56a7a83c6da service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:24.960006 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c9ac8-40e4-45e9-9cf6-d56a7a83c6da service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:24.960284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c9ac8-40e4-45e9-9cf6-d56a7a83c6da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:24.969093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c9ac8-40e4-45e9-9cf6-d56a7a83c6da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:09:24.970515 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c9ac8-40e4-45e9-9cf6-d56a7a83c6da service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:09:24.980201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 749/1533] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:09:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:09:28.841371 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087c700-595b-4497-8d62-cd768acc04ef None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:28.841958 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087c700-595b-4497-8d62-cd768acc04ef None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:28.841958 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087c700-595b-4497-8d62-cd768acc04ef None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:28.843272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 785/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 10:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:09:28.848352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c7203-6a1d-4530-aa1d-dc1f0a1e9a65 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:28.848809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c7203-6a1d-4530-aa1d-dc1f0a1e9a65 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:28.848936 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c7203-6a1d-4530-aa1d-dc1f0a1e9a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:28.869166 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-f85c7203-6a1d-4530-aa1d-dc1f0a1e9a65 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:09:28.870372 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f85c7203-6a1d-4530-aa1d-dc1f0a1e9a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:09:28.878256 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 750/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 10:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:09:29.186058 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087c700-595b-4497-8d62-cd768acc04ef None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:09:29.187766 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b087c700-595b-4497-8d62-cd768acc04ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:09:29.253887 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:09:29.268773 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087c700-595b-4497-8d62-cd768acc04ef None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:09:29.272311 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9809f253-1923-41de-825b-f4f0bbd37377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:09:29.273000 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809f253-1923-41de-825b-f4f0bbd37377 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:29.273398 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809f253-1923-41de-825b-f4f0bbd37377 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:29.273495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9809f253-1923-41de-825b-f4f0bbd37377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:29.282261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809f253-1923-41de-825b-f4f0bbd37377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:09:29.283682 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9809f253-1923-41de-825b-f4f0bbd37377 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:09:29.293893 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 786/1536] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:09:31.311028 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe4e9b-1e69-4174-9162-0e5979de51ab None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:31.311510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe4e9b-1e69-4174-9162-0e5979de51ab None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:31.311608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe4e9b-1e69-4174-9162-0e5979de51ab None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:31.312961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 751/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 10:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:09:31.317997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5693e-d435-433e-8c3c-ec2fb8455690 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:31.318436 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5693e-d435-433e-8c3c-ec2fb8455690 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:31.318541 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5693e-d435-433e-8c3c-ec2fb8455690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:31.337621 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-03b5693e-d435-433e-8c3c-ec2fb8455690 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:09:31.338808 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-03b5693e-d435-433e-8c3c-ec2fb8455690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:09:31.346804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 787/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 10:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:09:31.658353 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe4e9b-1e69-4174-9162-0e5979de51ab None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:09:31.660018 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ddfe4e9b-1e69-4174-9162-0e5979de51ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:09:31.668774 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=84 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:09:31.675179 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe4e9b-1e69-4174-9162-0e5979de51ab None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:09:31.678673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac831f67-c2e1-480d-b86b-4b1023192681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:09:31.679877 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac831f67-c2e1-480d-b86b-4b1023192681 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:09:31.680164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac831f67-c2e1-480d-b86b-4b1023192681 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:09:31.680438 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac831f67-c2e1-480d-b86b-4b1023192681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:09:31.689408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac831f67-c2e1-480d-b86b-4b1023192681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:09:31.690824 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac831f67-c2e1-480d-b86b-4b1023192681 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:09:31.700914 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 752/1539] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:09:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:09:41.332913 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=11 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:09:41.696440 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=5 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:06.879140 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90aa6e-3f82-47a7-9acc-acb82609e115 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:06.879918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90aa6e-3f82-47a7-9acc-acb82609e115 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:06.879918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90aa6e-3f82-47a7-9acc-acb82609e115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:06.913353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-dc90aa6e-3f82-47a7-9acc-acb82609e115 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:06.914496 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dc90aa6e-3f82-47a7-9acc-acb82609e115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:06.923900 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 788/1540] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:06.933520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fc0ef-c091-4de9-a79e-5b493f0c2496 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:06.934116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fc0ef-c091-4de9-a79e-5b493f0c2496 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:06.934116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3fc0ef-c091-4de9-a79e-5b493f0c2496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:06.936520 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53700ee-bfd3-403c-a4c9-90efa129b059 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:06.936811 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53700ee-bfd3-403c-a4c9-90efa129b059 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:06.937092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53700ee-bfd3-403c-a4c9-90efa129b059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:06.961554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e53700ee-bfd3-403c-a4c9-90efa129b059 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:06.963540 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e53700ee-bfd3-403c-a4c9-90efa129b059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:06.966942 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-2a3fc0ef-c091-4de9-a79e-5b493f0c2496 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:06.968238 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2a3fc0ef-c091-4de9-a79e-5b493f0c2496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:06.983136 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 789/1541] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:11:06.987024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 753/1542] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:06.991485 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53700ee-bfd3-403c-a4c9-90efa129b059 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:06.998619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7f4f0-c7c1-4f57-a07e-0d83daff17c9 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:06.999207 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7f4f0-c7c1-4f57-a07e-0d83daff17c9 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:06.999748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7f4f0-c7c1-4f57-a07e-0d83daff17c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.025984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53700ee-bfd3-403c-a4c9-90efa129b059 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.038097 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ddea8-9fd3-4d7a-bfe7-ecd11a493742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.038738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ddea8-9fd3-4d7a-bfe7-ecd11a493742 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.039022 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ddea8-9fd3-4d7a-bfe7-ecd11a493742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.039298 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ddea8-9fd3-4d7a-bfe7-ecd11a493742 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.040011 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ddea8-9fd3-4d7a-bfe7-ecd11a493742 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:07.044498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ddea8-9fd3-4d7a-bfe7-ecd11a493742 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.044498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ddea8-9fd3-4d7a-bfe7-ecd11a493742 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.059929 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-17d7f4f0-c7c1-4f57-a07e-0d83daff17c9 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:07.061878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-17d7f4f0-c7c1-4f57-a07e-0d83daff17c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:07.071416 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 790/1543] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:07.076359 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 754/1544] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:11:07.076860 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f38aa-c18c-41fa-b16c-5fff3b99a995 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.077186 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f38aa-c18c-41fa-b16c-5fff3b99a995 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.077475 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f38aa-c18c-41fa-b16c-5fff3b99a995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.079604 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf0059-d706-42ad-97d6-b763411a0e3d None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.080220 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf0059-d706-42ad-97d6-b763411a0e3d None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.080864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf0059-d706-42ad-97d6-b763411a0e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.115595 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c66f38aa-c18c-41fa-b16c-5fff3b99a995 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:07.116187 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-7abf0059-d706-42ad-97d6-b763411a0e3d None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:07.116861 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c66f38aa-c18c-41fa-b16c-5fff3b99a995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:07.117877 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7abf0059-d706-42ad-97d6-b763411a0e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:07.131736 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 755/1545] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:07.132946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf0059-d706-42ad-97d6-b763411a0e3d None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.134874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 791/1546] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:07.135728 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f38aa-c18c-41fa-b16c-5fff3b99a995 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.151806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf0059-d706-42ad-97d6-b763411a0e3d None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.157536 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f38aa-c18c-41fa-b16c-5fff3b99a995 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.161869 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17def7ed-9ccd-45ba-b1f4-a01a6762c409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.162597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17def7ed-9ccd-45ba-b1f4-a01a6762c409 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.162883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17def7ed-9ccd-45ba-b1f4-a01a6762c409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.163159 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17def7ed-9ccd-45ba-b1f4-a01a6762c409 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.164010 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17def7ed-9ccd-45ba-b1f4-a01a6762c409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.165250 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d841b-8e24-4718-a6d9-6c9571a33d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.165997 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17def7ed-9ccd-45ba-b1f4-a01a6762c409 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.166947 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d841b-8e24-4718-a6d9-6c9571a33d23 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.167459 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d841b-8e24-4718-a6d9-6c9571a33d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.167966 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d841b-8e24-4718-a6d9-6c9571a33d23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.168921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d841b-8e24-4718-a6d9-6c9571a33d23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:07.169586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d841b-8e24-4718-a6d9-6c9571a33d23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.171394 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d841b-8e24-4718-a6d9-6c9571a33d23 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.185905 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 792/1547] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:07.187574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406a874-6148-4612-8e88-475556ed0c97 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.188084 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406a874-6148-4612-8e88-475556ed0c97 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.188607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406a874-6148-4612-8e88-475556ed0c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.218142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 756/1548] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:07.218379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1406a874-6148-4612-8e88-475556ed0c97 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:07.219598 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1406a874-6148-4612-8e88-475556ed0c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:07.220386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c850-b3c8-4940-866a-84c0172a824e None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.221002 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c850-b3c8-4940-866a-84c0172a824e None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.221492 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811c850-b3c8-4940-866a-84c0172a824e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.245009 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-0811c850-b3c8-4940-866a-84c0172a824e None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:07.246619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-0811c850-b3c8-4940-866a-84c0172a824e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:07.300382 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 793/1549] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:07.302345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e881b-2b47-46cb-8aa6-9455af690936 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.302629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e881b-2b47-46cb-8aa6-9455af690936 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.302913 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e881b-2b47-46cb-8aa6-9455af690936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.317912 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 757/1550] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:07.319390 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463507b-cc6e-4d13-b3ab-b0eb99b6e1b0 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.319841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463507b-cc6e-4d13-b3ab-b0eb99b6e1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.320274 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463507b-cc6e-4d13-b3ab-b0eb99b6e1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.323275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-481e881b-2b47-46cb-8aa6-9455af690936 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:07.324492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-481e881b-2b47-46cb-8aa6-9455af690936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:07.333028 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 794/1551] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:07.334122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e881b-2b47-46cb-8aa6-9455af690936 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.343016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-a463507b-cc6e-4d13-b3ab-b0eb99b6e1b0 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:07.344329 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a463507b-cc6e-4d13-b3ab-b0eb99b6e1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:07.344669 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e881b-2b47-46cb-8aa6-9455af690936 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.350503 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108c963-2056-4e60-ac25-108339a2c63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.351115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108c963-2056-4e60-ac25-108339a2c63f admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.351429 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108c963-2056-4e60-ac25-108339a2c63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.351703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108c963-2056-4e60-ac25-108339a2c63f admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.352373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108c963-2056-4e60-ac25-108339a2c63f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.353430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: WARNING py.warnings [None req-8108c963-2056-4e60-ac25-108339a2c63f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:11:07.353430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: warnings.warn(msg) Aug 02 10:11:07.353430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: Aug 02 10:11:07.354125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 758/1552] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:07.354628 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108c963-2056-4e60-ac25-108339a2c63f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.354965 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463507b-cc6e-4d13-b3ab-b0eb99b6e1b0 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.368107 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463507b-cc6e-4d13-b3ab-b0eb99b6e1b0 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.373299 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f430f-8469-4f85-9b51-f75293dbf8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.374010 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f430f-8469-4f85-9b51-f75293dbf8ea admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.374736 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f430f-8469-4f85-9b51-f75293dbf8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.374736 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f430f-8469-4f85-9b51-f75293dbf8ea admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.375508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f430f-8469-4f85-9b51-f75293dbf8ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.376834 dv-cinder-850318-6-smb devstack@keystone.service[80329]: WARNING py.warnings [None req-a67f430f-8469-4f85-9b51-f75293dbf8ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:11:07.376834 dv-cinder-850318-6-smb devstack@keystone.service[80329]: warnings.warn(msg) Aug 02 10:11:07.376834 dv-cinder-850318-6-smb devstack@keystone.service[80329]: Aug 02 10:11:07.378413 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f430f-8469-4f85-9b51-f75293dbf8ea admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.387503 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 795/1553] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:07.387503 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d9e7e-b9d2-4ad2-9ebf-ce205748fa21 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.387787 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d9e7e-b9d2-4ad2-9ebf-ce205748fa21 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.387903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d9e7e-b9d2-4ad2-9ebf-ce205748fa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.407249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 759/1554] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/users => generated 291 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:07.407249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378abb6-adf0-4b76-9ed0-c4eca74e920a None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.407249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378abb6-adf0-4b76-9ed0-c4eca74e920a None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.407249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378abb6-adf0-4b76-9ed0-c4eca74e920a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.409149 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-966d9e7e-b9d2-4ad2-9ebf-ce205748fa21 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:07.410362 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-966d9e7e-b9d2-4ad2-9ebf-ce205748fa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:07.428074 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-f378abb6-adf0-4b76-9ed0-c4eca74e920a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:07.429301 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f378abb6-adf0-4b76-9ed0-c4eca74e920a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:07.478014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 796/1555] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:07.478932 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d9e7e-b9d2-4ad2-9ebf-ce205748fa21 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.491782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d9e7e-b9d2-4ad2-9ebf-ce205748fa21 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.497159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f946ce2-fd85-4b0e-975b-4453eaceb97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.497783 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f946ce2-fd85-4b0e-975b-4453eaceb97b admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.498068 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f946ce2-fd85-4b0e-975b-4453eaceb97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.498344 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f946ce2-fd85-4b0e-975b-4453eaceb97b admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.499051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f946ce2-fd85-4b0e-975b-4453eaceb97b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:07.499357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f946ce2-fd85-4b0e-975b-4453eaceb97b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.501026 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f946ce2-fd85-4b0e-975b-4453eaceb97b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.501314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 760/1556] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:07.502175 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378abb6-adf0-4b76-9ed0-c4eca74e920a None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.514217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 797/1557] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:07.515033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378abb6-adf0-4b76-9ed0-c4eca74e920a None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.515609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c09bb-a3a6-44d9-8300-b7c747f4437e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.515881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c09bb-a3a6-44d9-8300-b7c747f4437e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.516161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c09bb-a3a6-44d9-8300-b7c747f4437e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.520817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03e56d-39eb-4b57-98fa-f5dd4080da8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.521443 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03e56d-39eb-4b57-98fa-f5dd4080da8c admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.521732 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03e56d-39eb-4b57-98fa-f5dd4080da8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.522015 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03e56d-39eb-4b57-98fa-f5dd4080da8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.523075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03e56d-39eb-4b57-98fa-f5dd4080da8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:07.523544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03e56d-39eb-4b57-98fa-f5dd4080da8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.524684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: WARNING py.warnings [None req-2a03e56d-39eb-4b57-98fa-f5dd4080da8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:11:07.524684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: warnings.warn(msg) Aug 02 10:11:07.524684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: Aug 02 10:11:07.525590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a03e56d-39eb-4b57-98fa-f5dd4080da8c admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.536029 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f15c09bb-a3a6-44d9-8300-b7c747f4437e None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:07.537489 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f15c09bb-a3a6-44d9-8300-b7c747f4437e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:07.540491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 761/1558] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:07.542148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500cd51-6d75-4410-8ae4-001cb6d01d1e None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.542641 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500cd51-6d75-4410-8ae4-001cb6d01d1e None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.543078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500cd51-6d75-4410-8ae4-001cb6d01d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.549840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 798/1559] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:07.550689 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c09bb-a3a6-44d9-8300-b7c747f4437e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.560914 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c09bb-a3a6-44d9-8300-b7c747f4437e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.565534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293a52bb-ae40-4dc4-b311-f77fd139d120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.565879 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-5500cd51-6d75-4410-8ae4-001cb6d01d1e None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:07.566175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a52bb-ae40-4dc4-b311-f77fd139d120 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.566459 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a52bb-ae40-4dc4-b311-f77fd139d120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.566734 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293a52bb-ae40-4dc4-b311-f77fd139d120 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.567693 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-5500cd51-6d75-4410-8ae4-001cb6d01d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:07.568419 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a52bb-ae40-4dc4-b311-f77fd139d120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.570372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293a52bb-ae40-4dc4-b311-f77fd139d120 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.575712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 762/1560] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:07.576574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500cd51-6d75-4410-8ae4-001cb6d01d1e None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.578383 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:07.587964 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500cd51-6d75-4410-8ae4-001cb6d01d1e None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.593189 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce51d0-653d-4407-b8a7-10a316371f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.593835 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce51d0-653d-4407-b8a7-10a316371f88 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.594121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce51d0-653d-4407-b8a7-10a316371f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.594398 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce51d0-653d-4407-b8a7-10a316371f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.595102 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce51d0-653d-4407-b8a7-10a316371f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.596528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 799/1561] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/users => generated 283 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:07.596800 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce51d0-653d-4407-b8a7-10a316371f88 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.597767 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb52ad-52b7-4313-97c8-a6872a9db5a8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.598065 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb52ad-52b7-4313-97c8-a6872a9db5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.598739 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:07.599959 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb52ad-52b7-4313-97c8-a6872a9db5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.611292 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 763/1562] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:07.612648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f85f10-d2aa-4ce7-b38c-f6c2870f73ae None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.612990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f85f10-d2aa-4ce7-b38c-f6c2870f73ae None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.613275 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f85f10-d2aa-4ce7-b38c-f6c2870f73ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.620637 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-64cb52ad-52b7-4313-97c8-a6872a9db5a8 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:07.621924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-64cb52ad-52b7-4313-97c8-a6872a9db5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:07.630895 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 800/1563] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:07.632982 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-84f85f10-d2aa-4ce7-b38c-f6c2870f73ae None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:07.633534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb52ad-52b7-4313-97c8-a6872a9db5a8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.634180 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-84f85f10-d2aa-4ce7-b38c-f6c2870f73ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:07.642446 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 764/1564] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:07.646802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f85f10-d2aa-4ce7-b38c-f6c2870f73ae None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.646900 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb52ad-52b7-4313-97c8-a6872a9db5a8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.648439 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90eccab-97bd-4a11-8cd0-a74fcbcbf511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.649094 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90eccab-97bd-4a11-8cd0-a74fcbcbf511 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.649378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90eccab-97bd-4a11-8cd0-a74fcbcbf511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.649668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90eccab-97bd-4a11-8cd0-a74fcbcbf511 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.650364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90eccab-97bd-4a11-8cd0-a74fcbcbf511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.652355 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90eccab-97bd-4a11-8cd0-a74fcbcbf511 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.655898 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f85f10-d2aa-4ce7-b38c-f6c2870f73ae None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.660594 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b3a05-8d56-4a31-8be2-428f5def0431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.661729 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b3a05-8d56-4a31-8be2-428f5def0431 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.662009 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b3a05-8d56-4a31-8be2-428f5def0431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.662286 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b3a05-8d56-4a31-8be2-428f5def0431 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.662949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b3a05-8d56-4a31-8be2-428f5def0431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.664884 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698b3a05-8d56-4a31-8be2-428f5def0431 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.686731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 801/1565] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:07.687668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90eccab-97bd-4a11-8cd0-a74fcbcbf511 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.697040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 765/1566] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:07.697040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b3a05-8d56-4a31-8be2-428f5def0431 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.755935 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90eccab-97bd-4a11-8cd0-a74fcbcbf511 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.760593 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7291cc2-4975-4d4a-83f0-2dae8ceb3c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.761205 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7291cc2-4975-4d4a-83f0-2dae8ceb3c35 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.761487 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7291cc2-4975-4d4a-83f0-2dae8ceb3c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.761760 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7291cc2-4975-4d4a-83f0-2dae8ceb3c35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.762456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7291cc2-4975-4d4a-83f0-2dae8ceb3c35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:07.762761 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7291cc2-4975-4d4a-83f0-2dae8ceb3c35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.763232 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b3a05-8d56-4a31-8be2-428f5def0431 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.764366 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7291cc2-4975-4d4a-83f0-2dae8ceb3c35 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.768499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824701e-9552-41f6-8d7c-ce634fc70755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.769105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824701e-9552-41f6-8d7c-ce634fc70755 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.769386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824701e-9552-41f6-8d7c-ce634fc70755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.769660 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824701e-9552-41f6-8d7c-ce634fc70755 admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.770970 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824701e-9552-41f6-8d7c-ce634fc70755 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:07.771273 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824701e-9552-41f6-8d7c-ce634fc70755 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.773374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824701e-9552-41f6-8d7c-ce634fc70755 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.778446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 802/1567] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:07.779270 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7291cc2-4975-4d4a-83f0-2dae8ceb3c35 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.787877 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 766/1568] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:07.794021 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824701e-9552-41f6-8d7c-ce634fc70755 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.802667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7291cc2-4975-4d4a-83f0-2dae8ceb3c35 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.806390 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824701e-9552-41f6-8d7c-ce634fc70755 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.810748 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b079ccb-7d84-4a57-b398-4de4fce3b83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.811294 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2eb7ea-c4e9-461a-af35-d395cebb4050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.811685 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b079ccb-7d84-4a57-b398-4de4fce3b83a admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.811977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b079ccb-7d84-4a57-b398-4de4fce3b83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.812260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b079ccb-7d84-4a57-b398-4de4fce3b83a admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.812375 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2eb7ea-c4e9-461a-af35-d395cebb4050 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.812633 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2eb7ea-c4e9-461a-af35-d395cebb4050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.812941 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2eb7ea-c4e9-461a-af35-d395cebb4050 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.813587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b079ccb-7d84-4a57-b398-4de4fce3b83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.813718 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2eb7ea-c4e9-461a-af35-d395cebb4050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.815380 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2eb7ea-c4e9-461a-af35-d395cebb4050 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.816807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b079ccb-7d84-4a57-b398-4de4fce3b83a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.826627 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 767/1569] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:07.827512 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2eb7ea-c4e9-461a-af35-d395cebb4050 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.832275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 803/1570] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:07.832275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b079ccb-7d84-4a57-b398-4de4fce3b83a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.838551 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2eb7ea-c4e9-461a-af35-d395cebb4050 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.842359 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b079ccb-7d84-4a57-b398-4de4fce3b83a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.843488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1630bd-26b9-4716-bd1d-be6a9718b865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.844143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1630bd-26b9-4716-bd1d-be6a9718b865 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.844452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1630bd-26b9-4716-bd1d-be6a9718b865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.844846 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1630bd-26b9-4716-bd1d-be6a9718b865 admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.845590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1630bd-26b9-4716-bd1d-be6a9718b865 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:07.845926 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1630bd-26b9-4716-bd1d-be6a9718b865 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.847442 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aea02d-dea1-481b-be96-6c7e314644d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.847623 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1630bd-26b9-4716-bd1d-be6a9718b865 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.848048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aea02d-dea1-481b-be96-6c7e314644d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.848882 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aea02d-dea1-481b-be96-6c7e314644d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.849155 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aea02d-dea1-481b-be96-6c7e314644d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.849963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aea02d-dea1-481b-be96-6c7e314644d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:07.850165 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aea02d-dea1-481b-be96-6c7e314644d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.851785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aea02d-dea1-481b-be96-6c7e314644d5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.861618 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 768/1571] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:07.862466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1630bd-26b9-4716-bd1d-be6a9718b865 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.872331 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 804/1572] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:07.872331 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aea02d-dea1-481b-be96-6c7e314644d5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.878124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1630bd-26b9-4716-bd1d-be6a9718b865 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.878399 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aea02d-dea1-481b-be96-6c7e314644d5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.883249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d533e-19e5-4115-a206-f9038613ff6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.883869 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d533e-19e5-4115-a206-f9038613ff6e admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.884154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d533e-19e5-4115-a206-f9038613ff6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.884406 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0464e5-616a-44cc-b007-af9399a49b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.884939 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d533e-19e5-4115-a206-f9038613ff6e admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.885092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0464e5-616a-44cc-b007-af9399a49b06 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.885253 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d533e-19e5-4115-a206-f9038613ff6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.885372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0464e5-616a-44cc-b007-af9399a49b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.885671 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0464e5-616a-44cc-b007-af9399a49b06 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.886384 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0464e5-616a-44cc-b007-af9399a49b06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.887209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d533e-19e5-4115-a206-f9038613ff6e admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.888332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0464e5-616a-44cc-b007-af9399a49b06 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.910552 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 769/1573] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/users => generated 288 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:07.911921 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d533e-19e5-4115-a206-f9038613ff6e admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.915323 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 805/1574] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/users => generated 286 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:07.915323 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0464e5-616a-44cc-b007-af9399a49b06 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.921824 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d533e-19e5-4115-a206-f9038613ff6e admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.924651 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0464e5-616a-44cc-b007-af9399a49b06 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:07.927405 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea200ba3-6413-4279-87f2-b0acc2628220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.928039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea200ba3-6413-4279-87f2-b0acc2628220 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.928327 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea200ba3-6413-4279-87f2-b0acc2628220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.928644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea200ba3-6413-4279-87f2-b0acc2628220 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.929319 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea200ba3-6413-4279-87f2-b0acc2628220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.930427 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b8f2f-1b41-4054-a0f4-daeaa480c586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:07.931026 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b8f2f-1b41-4054-a0f4-daeaa480c586 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:07.931219 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea200ba3-6413-4279-87f2-b0acc2628220 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.931341 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b8f2f-1b41-4054-a0f4-daeaa480c586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:07.931567 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b8f2f-1b41-4054-a0f4-daeaa480c586 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:07.932225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b8f2f-1b41-4054-a0f4-daeaa480c586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:07.934167 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b8f2f-1b41-4054-a0f4-daeaa480c586 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:07.960525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 770/1575] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:07.961341 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea200ba3-6413-4279-87f2-b0acc2628220 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:07.963729 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 806/1576] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:07 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:07.964786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b8f2f-1b41-4054-a0f4-daeaa480c586 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.020741 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:08.026295 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:08.031319 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea200ba3-6413-4279-87f2-b0acc2628220 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.035137 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b8f2f-1b41-4054-a0f4-daeaa480c586 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.038878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110a066-e0e9-48b2-baf6-6a834bf25845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.039600 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110a066-e0e9-48b2-baf6-6a834bf25845 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.039935 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110a066-e0e9-48b2-baf6-6a834bf25845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.040382 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110a066-e0e9-48b2-baf6-6a834bf25845 admin admin] PATH_INFO: `/v3/projects/16f86229b59e440986f3b0b843cce356/users/4f0a3d117fe14c47bc79306e634c9228/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.042082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e542b3-3117-4d74-a0ce-4179a85a744b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.042804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e542b3-3117-4d74-a0ce-4179a85a744b admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.043072 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e542b3-3117-4d74-a0ce-4179a85a744b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.043348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e542b3-3117-4d74-a0ce-4179a85a744b admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.044052 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e542b3-3117-4d74-a0ce-4179a85a744b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.045721 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e542b3-3117-4d74-a0ce-4179a85a744b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.059778 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 807/1577] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:08.059778 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e542b3-3117-4d74-a0ce-4179a85a744b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.061621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110a066-e0e9-48b2-baf6-6a834bf25845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16f86229b59e440986f3b0b843cce356, user_id=4f0a3d117fe14c47bc79306e634c9228, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.064554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110a066-e0e9-48b2-baf6-6a834bf25845 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.070210 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e542b3-3117-4d74-a0ce-4179a85a744b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.076157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa736e-431b-41cc-943e-45cdc0f684b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.076933 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa736e-431b-41cc-943e-45cdc0f684b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.077250 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa736e-431b-41cc-943e-45cdc0f684b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.077563 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa736e-431b-41cc-943e-45cdc0f684b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.078297 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa736e-431b-41cc-943e-45cdc0f684b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.080021 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 771/1578] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:07 2022] PUT /identity/v3/projects/16f86229b59e440986f3b0b843cce356/users/4f0a3d117fe14c47bc79306e634c9228/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:08.080881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110a066-e0e9-48b2-baf6-6a834bf25845 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.084899 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa736e-431b-41cc-943e-45cdc0f684b4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.116587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 808/1579] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:08 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:08.117647 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa736e-431b-41cc-943e-45cdc0f684b4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.150286 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110a066-e0e9-48b2-baf6-6a834bf25845 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.179351 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa736e-431b-41cc-943e-45cdc0f684b4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.184312 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ed5e4-421b-4d65-a0ff-2bd68945faa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.185024 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ed5e4-421b-4d65-a0ff-2bd68945faa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.185305 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ed5e4-421b-4d65-a0ff-2bd68945faa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.185578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ed5e4-421b-4d65-a0ff-2bd68945faa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.186323 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ed5e4-421b-4d65-a0ff-2bd68945faa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.187985 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ed5e4-421b-4d65-a0ff-2bd68945faa2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.198300 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 809/1580] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:08.199122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ed5e4-421b-4d65-a0ff-2bd68945faa2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.209683 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ed5e4-421b-4d65-a0ff-2bd68945faa2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.212767 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a3403-fbfa-409b-9564-4fd1db466155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.213330 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a3403-fbfa-409b-9564-4fd1db466155 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.213608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a3403-fbfa-409b-9564-4fd1db466155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.213895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a3403-fbfa-409b-9564-4fd1db466155 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.214556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a3403-fbfa-409b-9564-4fd1db466155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.214837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060137f-4c51-41d5-953c-0545deaddf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.215489 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060137f-4c51-41d5-953c-0545deaddf59 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.215797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060137f-4c51-41d5-953c-0545deaddf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.216107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060137f-4c51-41d5-953c-0545deaddf59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.216428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a3403-fbfa-409b-9564-4fd1db466155 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.216864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060137f-4c51-41d5-953c-0545deaddf59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.218674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060137f-4c51-41d5-953c-0545deaddf59 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.241777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 810/1581] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:08.242767 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060137f-4c51-41d5-953c-0545deaddf59 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.249129 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 772/1582] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:08 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:08.250028 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a3403-fbfa-409b-9564-4fd1db466155 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.257975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060137f-4c51-41d5-953c-0545deaddf59 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.322412 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114dd95-1e57-488b-a156-60085b72e029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.323029 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114dd95-1e57-488b-a156-60085b72e029 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.323338 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114dd95-1e57-488b-a156-60085b72e029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.323610 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114dd95-1e57-488b-a156-60085b72e029 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.324120 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a3403-fbfa-409b-9564-4fd1db466155 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.324273 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114dd95-1e57-488b-a156-60085b72e029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.326216 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6114dd95-1e57-488b-a156-60085b72e029 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.328959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328369c7-d57c-4e05-ae95-3acfbd0ade83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.329573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328369c7-d57c-4e05-ae95-3acfbd0ade83 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.329853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328369c7-d57c-4e05-ae95-3acfbd0ade83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.330125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328369c7-d57c-4e05-ae95-3acfbd0ade83 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.330790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328369c7-d57c-4e05-ae95-3acfbd0ade83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.333094 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328369c7-d57c-4e05-ae95-3acfbd0ade83 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.346756 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 811/1583] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:08 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:08.347710 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114dd95-1e57-488b-a156-60085b72e029 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.359017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6114dd95-1e57-488b-a156-60085b72e029 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.360373 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 773/1584] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:08 2022] POST /identity/v3/users => generated 303 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:08.361650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a84dd1-1de0-40b5-94aa-e9482bcd8c53 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.361941 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a84dd1-1de0-40b5-94aa-e9482bcd8c53 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.362224 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a84dd1-1de0-40b5-94aa-e9482bcd8c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.365443 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7514a-c5e8-48bc-a007-03e36d95281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.366039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7514a-c5e8-48bc-a007-03e36d95281f admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.366332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7514a-c5e8-48bc-a007-03e36d95281f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.366672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7514a-c5e8-48bc-a007-03e36d95281f admin admin] PATH_INFO: `/v3/projects/ab0b45bd550f4337b5d1bc094e6a200a/users/2871d4c1e19a4e97a95fb467fc3664f6/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.371374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:08.386126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7514a-c5e8-48bc-a007-03e36d95281f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0b45bd550f4337b5d1bc094e6a200a, user_id=2871d4c1e19a4e97a95fb467fc3664f6, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.387180 dv-cinder-850318-6-smb devstack@keystone.service[80330]: WARNING py.warnings [None req-5ff7514a-c5e8-48bc-a007-03e36d95281f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:11:08.387180 dv-cinder-850318-6-smb devstack@keystone.service[80330]: warnings.warn(msg) Aug 02 10:11:08.387180 dv-cinder-850318-6-smb devstack@keystone.service[80330]: Aug 02 10:11:08.389194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7514a-c5e8-48bc-a007-03e36d95281f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.394505 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-04a84dd1-1de0-40b5-94aa-e9482bcd8c53 None None] MFA Rules not processed for user `4f0a3d117fe14c47bc79306e634c9228`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:08.396608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-04a84dd1-1de0-40b5-94aa-e9482bcd8c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:08.410103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 812/1585] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:08 2022] PUT /identity/v3/projects/ab0b45bd550f4337b5d1bc094e6a200a/users/2871d4c1e19a4e97a95fb467fc3664f6/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:08.411539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7514a-c5e8-48bc-a007-03e36d95281f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.437654 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:08.469538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 774/1586] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:08.470410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a84dd1-1de0-40b5-94aa-e9482bcd8c53 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.482439 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a84dd1-1de0-40b5-94aa-e9482bcd8c53 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.487489 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226a259-037c-4cfd-850c-d6574e2c6c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.487914 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7514a-c5e8-48bc-a007-03e36d95281f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.488130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226a259-037c-4cfd-850c-d6574e2c6c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.488415 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226a259-037c-4cfd-850c-d6574e2c6c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.488877 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226a259-037c-4cfd-850c-d6574e2c6c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.490717 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226a259-037c-4cfd-850c-d6574e2c6c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.492343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226a259-037c-4cfd-850c-d6574e2c6c74 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.493783 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8710fc-851b-4646-b544-621c1e7be7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.494459 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8710fc-851b-4646-b544-621c1e7be7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.494773 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8710fc-851b-4646-b544-621c1e7be7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.495048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8710fc-851b-4646-b544-621c1e7be7d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.495787 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8710fc-851b-4646-b544-621c1e7be7d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.497995 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8710fc-851b-4646-b544-621c1e7be7d6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.502971 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 775/1587] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:08.503840 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226a259-037c-4cfd-850c-d6574e2c6c74 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.514488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226a259-037c-4cfd-850c-d6574e2c6c74 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.519267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f527e-0438-4910-967f-fa5ba8aac17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.519875 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f527e-0438-4910-967f-fa5ba8aac17e admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.520259 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 813/1588] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:08 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:08.520765 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f527e-0438-4910-967f-fa5ba8aac17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.521065 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955f527e-0438-4910-967f-fa5ba8aac17e admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.521273 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8710fc-851b-4646-b544-621c1e7be7d6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.521767 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f527e-0438-4910-967f-fa5ba8aac17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.523456 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955f527e-0438-4910-967f-fa5ba8aac17e admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.533208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8710fc-851b-4646-b544-621c1e7be7d6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.537566 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 776/1589] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:08.537566 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f527e-0438-4910-967f-fa5ba8aac17e admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.539785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80487d-c183-4b95-8b80-1bbd87007a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.540569 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80487d-c183-4b95-8b80-1bbd87007a6a admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.540918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80487d-c183-4b95-8b80-1bbd87007a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.541188 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80487d-c183-4b95-8b80-1bbd87007a6a admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.541852 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80487d-c183-4b95-8b80-1bbd87007a6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.544060 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80487d-c183-4b95-8b80-1bbd87007a6a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.545280 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955f527e-0438-4910-967f-fa5ba8aac17e admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.549878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25acb4-9580-4f09-acf4-b1884fc3ec36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.550470 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25acb4-9580-4f09-acf4-b1884fc3ec36 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.550754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25acb4-9580-4f09-acf4-b1884fc3ec36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.551031 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be25acb4-9580-4f09-acf4-b1884fc3ec36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.553011 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25acb4-9580-4f09-acf4-b1884fc3ec36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.554653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be25acb4-9580-4f09-acf4-b1884fc3ec36 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.565915 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 777/1590] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:08.566850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 814/1591] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:08 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:08.568252 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984b068-aab3-49c4-a518-3d73fe2e3422 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.568656 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984b068-aab3-49c4-a518-3d73fe2e3422 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.569081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984b068-aab3-49c4-a518-3d73fe2e3422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.570233 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25acb4-9580-4f09-acf4-b1884fc3ec36 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.580017 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be25acb4-9580-4f09-acf4-b1884fc3ec36 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.585237 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd3c31-98a2-4522-a902-2c8e87982a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.585838 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd3c31-98a2-4522-a902-2c8e87982a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.586124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd3c31-98a2-4522-a902-2c8e87982a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.586398 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd3c31-98a2-4522-a902-2c8e87982a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.587088 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd3c31-98a2-4522-a902-2c8e87982a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.588700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd3c31-98a2-4522-a902-2c8e87982a69 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.597674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6984b068-aab3-49c4-a518-3d73fe2e3422 None None] MFA Rules not processed for user `2871d4c1e19a4e97a95fb467fc3664f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:08.599560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6984b068-aab3-49c4-a518-3d73fe2e3422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:08.600046 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 778/1592] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:08.600862 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd3c31-98a2-4522-a902-2c8e87982a69 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.610741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd3c31-98a2-4522-a902-2c8e87982a69 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.616766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a7192-f8aa-4f12-a149-5cf48ca920ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.617415 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a7192-f8aa-4f12-a149-5cf48ca920ff admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.617723 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a7192-f8aa-4f12-a149-5cf48ca920ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.618029 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a7192-f8aa-4f12-a149-5cf48ca920ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.618743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a7192-f8aa-4f12-a149-5cf48ca920ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.620806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a7192-f8aa-4f12-a149-5cf48ca920ff admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.650178 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 779/1593] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:08 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:08.651197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a7192-f8aa-4f12-a149-5cf48ca920ff admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.680840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 815/1594] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:08.681578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984b068-aab3-49c4-a518-3d73fe2e3422 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.693687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984b068-aab3-49c4-a518-3d73fe2e3422 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.733520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a7192-f8aa-4f12-a149-5cf48ca920ff admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.740374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b9a86-cde0-470a-8b8a-33e5cc128de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.741102 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b9a86-cde0-470a-8b8a-33e5cc128de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.741396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b9a86-cde0-470a-8b8a-33e5cc128de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.741666 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b9a86-cde0-470a-8b8a-33e5cc128de8 admin admin] PATH_INFO: `/v3/projects/3de3a9d89f244e328e304d028feab651/users/324d0f6b637647a29580091f3a248cda/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.758383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b9a86-cde0-470a-8b8a-33e5cc128de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3de3a9d89f244e328e304d028feab651, user_id=324d0f6b637647a29580091f3a248cda, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.761266 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5434b21-e300-4975-a44c-bc755de100ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.761533 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b9a86-cde0-470a-8b8a-33e5cc128de8 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.762101 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5434b21-e300-4975-a44c-bc755de100ba admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.762488 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5434b21-e300-4975-a44c-bc755de100ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.762885 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5434b21-e300-4975-a44c-bc755de100ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.763694 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5434b21-e300-4975-a44c-bc755de100ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.766503 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5434b21-e300-4975-a44c-bc755de100ba admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.778747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 816/1595] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:08.779490 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5434b21-e300-4975-a44c-bc755de100ba admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.784840 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 780/1596] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:08 2022] PUT /identity/v3/projects/3de3a9d89f244e328e304d028feab651/users/324d0f6b637647a29580091f3a248cda/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:08.784840 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b9a86-cde0-470a-8b8a-33e5cc128de8 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.791290 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5434b21-e300-4975-a44c-bc755de100ba admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.795621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:08.801852 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:08.858601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a32f7-84fc-4a82-9270-1e0379f0307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.859277 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a32f7-84fc-4a82-9270-1e0379f0307e admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.859811 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a32f7-84fc-4a82-9270-1e0379f0307e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.860077 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a32f7-84fc-4a82-9270-1e0379f0307e admin admin] PATH_INFO: `/v3/projects/a2b12c098f024af7a4e92d09647df160/users/a433a3a56afd437db531dd8fda308c63/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.863794 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b9a86-cde0-470a-8b8a-33e5cc128de8 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.870060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9eedd-7de7-4076-bf2f-040e7001ed50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.870922 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9eedd-7de7-4076-bf2f-040e7001ed50 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.871297 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9eedd-7de7-4076-bf2f-040e7001ed50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.871680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9eedd-7de7-4076-bf2f-040e7001ed50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.872709 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9eedd-7de7-4076-bf2f-040e7001ed50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.874816 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a32f7-84fc-4a82-9270-1e0379f0307e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2b12c098f024af7a4e92d09647df160, user_id=a433a3a56afd437db531dd8fda308c63, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.875001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9eedd-7de7-4076-bf2f-040e7001ed50 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.877534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a32f7-84fc-4a82-9270-1e0379f0307e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.888657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 781/1597] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:08.891852 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 817/1598] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:08 2022] PUT /identity/v3/projects/a2b12c098f024af7a4e92d09647df160/users/a433a3a56afd437db531dd8fda308c63/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:08.900701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a32f7-84fc-4a82-9270-1e0379f0307e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.900829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9eedd-7de7-4076-bf2f-040e7001ed50 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.912755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9eedd-7de7-4076-bf2f-040e7001ed50 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.968970 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a32f7-84fc-4a82-9270-1e0379f0307e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:08.972919 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8225b1-8c73-4ba5-953c-e32ffa363af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.974197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8225b1-8c73-4ba5-953c-e32ffa363af9 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.974457 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36970f-5f4b-4a49-ae00-14ef53ca2a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:08.974587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8225b1-8c73-4ba5-953c-e32ffa363af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.974754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8225b1-8c73-4ba5-953c-e32ffa363af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.974952 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36970f-5f4b-4a49-ae00-14ef53ca2a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:08.975315 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36970f-5f4b-4a49-ae00-14ef53ca2a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:08.975454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8225b1-8c73-4ba5-953c-e32ffa363af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.975548 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36970f-5f4b-4a49-ae00-14ef53ca2a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:08.976209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36970f-5f4b-4a49-ae00-14ef53ca2a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:08.977138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8225b1-8c73-4ba5-953c-e32ffa363af9 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.977863 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36970f-5f4b-4a49-ae00-14ef53ca2a87 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:08.990386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 782/1599] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:08.990386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8225b1-8c73-4ba5-953c-e32ffa363af9 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:08.990708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 818/1600] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:08.990708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36970f-5f4b-4a49-ae00-14ef53ca2a87 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:09.000272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36970f-5f4b-4a49-ae00-14ef53ca2a87 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:09.001531 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8225b1-8c73-4ba5-953c-e32ffa363af9 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:09.005283 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d439903-f943-49e5-b0ac-b9e5c75fb4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:09.005894 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d439903-f943-49e5-b0ac-b9e5c75fb4fa admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:09.006175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d439903-f943-49e5-b0ac-b9e5c75fb4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:09.006451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d439903-f943-49e5-b0ac-b9e5c75fb4fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:09.006716 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be134fe-029c-4108-be30-7e1b58025bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:09.007115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d439903-f943-49e5-b0ac-b9e5c75fb4fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:09.007357 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be134fe-029c-4108-be30-7e1b58025bed admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:09.007643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be134fe-029c-4108-be30-7e1b58025bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:09.007924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be134fe-029c-4108-be30-7e1b58025bed admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:09.008629 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be134fe-029c-4108-be30-7e1b58025bed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:09.009079 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d439903-f943-49e5-b0ac-b9e5c75fb4fa admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:09.010536 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be134fe-029c-4108-be30-7e1b58025bed admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:09.038002 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 783/1601] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:08 2022] POST /identity/v3/users => generated 296 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:09.039070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be134fe-029c-4108-be30-7e1b58025bed admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:09.041293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 819/1602] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:08 2022] POST /identity/v3/projects => generated 361 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:09.042783 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48564e15-3b7b-44f6-8c15-db4d43693ca4 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:09.043212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48564e15-3b7b-44f6-8c15-db4d43693ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:09.043734 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48564e15-3b7b-44f6-8c15-db4d43693ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:09.051307 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be134fe-029c-4108-be30-7e1b58025bed admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:09.066133 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-48564e15-3b7b-44f6-8c15-db4d43693ca4 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:09.067865 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-48564e15-3b7b-44f6-8c15-db4d43693ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:09.114167 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620ab14-d366-41eb-aad8-3273519b60df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:09.114854 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620ab14-d366-41eb-aad8-3273519b60df admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:09.115139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620ab14-d366-41eb-aad8-3273519b60df admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:09.115415 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620ab14-d366-41eb-aad8-3273519b60df admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:09.116171 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620ab14-d366-41eb-aad8-3273519b60df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:09.117827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620ab14-d366-41eb-aad8-3273519b60df admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:09.127829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 784/1603] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:09.128776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620ab14-d366-41eb-aad8-3273519b60df admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:09.136913 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 820/1604] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:09.138500 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83914d5e-8f77-42a1-9e8e-24cc9335f220 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:09.138823 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83914d5e-8f77-42a1-9e8e-24cc9335f220 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:09.139136 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83914d5e-8f77-42a1-9e8e-24cc9335f220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:09.139253 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620ab14-d366-41eb-aad8-3273519b60df admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:09.144640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02831310-2a42-4a9a-8606-925a235d8a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:09.145964 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02831310-2a42-4a9a-8606-925a235d8a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:09.146400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02831310-2a42-4a9a-8606-925a235d8a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:09.147061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02831310-2a42-4a9a-8606-925a235d8a17 admin admin] PATH_INFO: `/v3/projects/1589ba4c99194698aa1b5ba7cf5b1758/users/39dde4f17d8e41ed8583cd8d5c9ce8c2/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:09.160523 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:09.163499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02831310-2a42-4a9a-8606-925a235d8a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1589ba4c99194698aa1b5ba7cf5b1758, user_id=39dde4f17d8e41ed8583cd8d5c9ce8c2, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:09.166650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02831310-2a42-4a9a-8606-925a235d8a17 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:09.169232 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-83914d5e-8f77-42a1-9e8e-24cc9335f220 None None] MFA Rules not processed for user `a433a3a56afd437db531dd8fda308c63`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:09.169838 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:09.170997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-83914d5e-8f77-42a1-9e8e-24cc9335f220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:09.181661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 785/1605] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:09 2022] PUT /identity/v3/projects/1589ba4c99194698aa1b5ba7cf5b1758/users/39dde4f17d8e41ed8583cd8d5c9ce8c2/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:09.182471 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02831310-2a42-4a9a-8606-925a235d8a17 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:09.246685 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02831310-2a42-4a9a-8606-925a235d8a17 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:09.250186 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 821/1606] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:09.250995 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83914d5e-8f77-42a1-9e8e-24cc9335f220 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:09.251418 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec95c10-d3aa-4370-b9ed-72a66ee3a1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:09.252041 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec95c10-d3aa-4370-b9ed-72a66ee3a1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:09.252329 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec95c10-d3aa-4370-b9ed-72a66ee3a1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:09.252719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec95c10-d3aa-4370-b9ed-72a66ee3a1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:09.253711 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec95c10-d3aa-4370-b9ed-72a66ee3a1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:09.255757 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec95c10-d3aa-4370-b9ed-72a66ee3a1b2 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:09.262671 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83914d5e-8f77-42a1-9e8e-24cc9335f220 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:09.266132 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 786/1607] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:09.266942 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec95c10-d3aa-4370-b9ed-72a66ee3a1b2 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:09.269902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7d487-3131-453b-81c6-a98456dafc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:09.270786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7d487-3131-453b-81c6-a98456dafc88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:09.271068 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7d487-3131-453b-81c6-a98456dafc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:09.271344 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7d487-3131-453b-81c6-a98456dafc88 admin admin] PATH_INFO: `/v3/projects/fd4a2c6ec3e74056b8a0c91bd5fdd513/users/0c3a542d0b96489ba55736f6761d7bd7/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:09.276478 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec95c10-d3aa-4370-b9ed-72a66ee3a1b2 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:09.281045 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b62d4a-2357-4583-aba2-57e2a8041c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:09.281626 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b62d4a-2357-4583-aba2-57e2a8041c46 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:09.281908 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b62d4a-2357-4583-aba2-57e2a8041c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:09.282185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b62d4a-2357-4583-aba2-57e2a8041c46 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:09.282839 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b62d4a-2357-4583-aba2-57e2a8041c46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:09.284853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b62d4a-2357-4583-aba2-57e2a8041c46 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:09.287618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7d487-3131-453b-81c6-a98456dafc88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd4a2c6ec3e74056b8a0c91bd5fdd513, user_id=0c3a542d0b96489ba55736f6761d7bd7, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:09.290317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc7d487-3131-453b-81c6-a98456dafc88 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:09.309716 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 822/1608] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:09 2022] PUT /identity/v3/projects/fd4a2c6ec3e74056b8a0c91bd5fdd513/users/0c3a542d0b96489ba55736f6761d7bd7/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:09.313168 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 787/1609] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:09 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:09.313168 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b62d4a-2357-4583-aba2-57e2a8041c46 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:09.313326 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7d487-3131-453b-81c6-a98456dafc88 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:09.323718 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b62d4a-2357-4583-aba2-57e2a8041c46 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:09.391674 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4506d57-a5f0-4e33-9cc5-05181f4ef2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:09.392307 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4506d57-a5f0-4e33-9cc5-05181f4ef2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:09.392613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4506d57-a5f0-4e33-9cc5-05181f4ef2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:09.392888 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4506d57-a5f0-4e33-9cc5-05181f4ef2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:09.393589 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4506d57-a5f0-4e33-9cc5-05181f4ef2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:09.394945 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7d487-3131-453b-81c6-a98456dafc88 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:09.395232 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4506d57-a5f0-4e33-9cc5-05181f4ef2e4 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:09.400792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c678412-fa46-4f58-bcd0-1335a203fda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:09.401599 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c678412-fa46-4f58-bcd0-1335a203fda5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:09.401991 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c678412-fa46-4f58-bcd0-1335a203fda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:09.402453 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c678412-fa46-4f58-bcd0-1335a203fda5 admin admin] PATH_INFO: `/v3/projects/869bd898ead54451b7bab81457caecfd/users/5d791b7676d6485794bb267b1bebdcad/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:09.405419 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 788/1610] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:09.406242 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4506d57-a5f0-4e33-9cc5-05181f4ef2e4 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:09.407950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-c4506d57-a5f0-4e33-9cc5-05181f4ef2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:09.426066 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c678412-fa46-4f58-bcd0-1335a203fda5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=869bd898ead54451b7bab81457caecfd, user_id=5d791b7676d6485794bb267b1bebdcad, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:09.430223 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c678412-fa46-4f58-bcd0-1335a203fda5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:09.446417 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 823/1611] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:09 2022] PUT /identity/v3/projects/869bd898ead54451b7bab81457caecfd/users/5d791b7676d6485794bb267b1bebdcad/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:09.450239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b25244-b002-470d-9bc8-48f783e8a8c4 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:09.450718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b25244-b002-470d-9bc8-48f783e8a8c4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:09.451142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b25244-b002-470d-9bc8-48f783e8a8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:09.474088 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4506d57-a5f0-4e33-9cc5-05181f4ef2e4 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:09.482351 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f5b25244-b002-470d-9bc8-48f783e8a8c4 None None] MFA Rules not processed for user `39dde4f17d8e41ed8583cd8d5c9ce8c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:09.483606 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f5b25244-b002-470d-9bc8-48f783e8a8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:09.499161 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:09.533159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:09.535270 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027242f5-3438-4b6a-976d-806814554c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:09.537056 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027242f5-3438-4b6a-976d-806814554c59 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:09.537561 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027242f5-3438-4b6a-976d-806814554c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:09.538042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027242f5-3438-4b6a-976d-806814554c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:09.553889 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 824/1612] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:09.554722 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b25244-b002-470d-9bc8-48f783e8a8c4 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:09.615828 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027242f5-3438-4b6a-976d-806814554c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:09.617714 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027242f5-3438-4b6a-976d-806814554c59 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:09.624391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b25244-b002-470d-9bc8-48f783e8a8c4 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:09.629268 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9ed1d-6af8-4e7d-95f8-69b738b10535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:09.629908 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 789/1613] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:09.630137 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9ed1d-6af8-4e7d-95f8-69b738b10535 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:09.630137 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9ed1d-6af8-4e7d-95f8-69b738b10535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:09.630404 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a9ed1d-6af8-4e7d-95f8-69b738b10535 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:09.630961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027242f5-3438-4b6a-976d-806814554c59 service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:09.631123 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9ed1d-6af8-4e7d-95f8-69b738b10535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:09.633033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a9ed1d-6af8-4e7d-95f8-69b738b10535 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:09.642784 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027242f5-3438-4b6a-976d-806814554c59 service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:09.649857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50537d9a-57f4-4825-ae29-1f79f2c2dd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:09.650554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50537d9a-57f4-4825-ae29-1f79f2c2dd39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:09.651396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50537d9a-57f4-4825-ae29-1f79f2c2dd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:09.651396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50537d9a-57f4-4825-ae29-1f79f2c2dd39 admin admin] PATH_INFO: `/v3/projects/513336570b36443d914c58ed2f363996/users/4a52bffd247140b6892388500d398044/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:09.666391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 825/1614] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:09 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:09.667356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9ed1d-6af8-4e7d-95f8-69b738b10535 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:09.678334 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50537d9a-57f4-4825-ae29-1f79f2c2dd39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=513336570b36443d914c58ed2f363996, user_id=4a52bffd247140b6892388500d398044, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:09.683327 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50537d9a-57f4-4825-ae29-1f79f2c2dd39 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:09.705103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 790/1615] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:09 2022] PUT /identity/v3/projects/513336570b36443d914c58ed2f363996/users/4a52bffd247140b6892388500d398044/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:09.705103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f63e23-c752-4d81-ab23-f3ebb07f9a4b None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:09.705103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f63e23-c752-4d81-ab23-f3ebb07f9a4b None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:09.705103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f63e23-c752-4d81-ab23-f3ebb07f9a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:09.748746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a9ed1d-6af8-4e7d-95f8-69b738b10535 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:09.751053 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-86f63e23-c752-4d81-ab23-f3ebb07f9a4b None None] MFA Rules not processed for user `0c3a542d0b96489ba55736f6761d7bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:09.752493 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-86f63e23-c752-4d81-ab23-f3ebb07f9a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:09.861558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 791/1616] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:09 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:09.862521 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f63e23-c752-4d81-ab23-f3ebb07f9a4b None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:09.867433 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c189109-1910-4006-afdf-f7c1610a2bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:09.868351 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c189109-1910-4006-afdf-f7c1610a2bba admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:09.868799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c189109-1910-4006-afdf-f7c1610a2bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:09.869221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c189109-1910-4006-afdf-f7c1610a2bba admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:09.870294 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c189109-1910-4006-afdf-f7c1610a2bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:09.872885 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c189109-1910-4006-afdf-f7c1610a2bba admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:09.878164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f63e23-c752-4d81-ab23-f3ebb07f9a4b None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:09.884490 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7752f3c6-3b29-42a7-99a4-00b6f469f6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:09.885363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752f3c6-3b29-42a7-99a4-00b6f469f6a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:09.885654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752f3c6-3b29-42a7-99a4-00b6f469f6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:09.885939 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7752f3c6-3b29-42a7-99a4-00b6f469f6a3 admin admin] PATH_INFO: `/v3/projects/09b6e4c93e204e9cadec6ff605987e9e/users/14d30305e5884fe8a67a535966a10ba8/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:09.887042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 826/1617] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:09.888338 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ca050-1191-4bed-8191-1e481e88d584 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:09.888655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ca050-1191-4bed-8191-1e481e88d584 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:09.888933 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ca050-1191-4bed-8191-1e481e88d584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:09.909583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752f3c6-3b29-42a7-99a4-00b6f469f6a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b6e4c93e204e9cadec6ff605987e9e, user_id=14d30305e5884fe8a67a535966a10ba8, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:09.912942 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7752f3c6-3b29-42a7-99a4-00b6f469f6a3 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:09.919700 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-067ca050-1191-4bed-8191-1e481e88d584 None None] MFA Rules not processed for user `5d791b7676d6485794bb267b1bebdcad`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:09.921092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-067ca050-1191-4bed-8191-1e481e88d584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:09.929726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:09.938240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 792/1618] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:09 2022] PUT /identity/v3/projects/09b6e4c93e204e9cadec6ff605987e9e/users/14d30305e5884fe8a67a535966a10ba8/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:09.942190 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9189b6-f94d-4b0b-ae1b-d9afbcf8a7af None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:09.942190 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9189b6-f94d-4b0b-ae1b-d9afbcf8a7af None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:09.942190 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9189b6-f94d-4b0b-ae1b-d9afbcf8a7af None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:09.944595 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 793/1619] 10.222.0.85 () {54 vars in 962 bytes} [Tue Aug 2 10:11:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:11:09.945735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9189b6-f94d-4b0b-ae1b-d9afbcf8a7af None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:09.979834 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:10.017650 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 827/1620] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:10.024255 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4c6b2-cace-4e2e-8db5-1e9091993837 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:10.024652 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4c6b2-cace-4e2e-8db5-1e9091993837 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:10.025060 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4c6b2-cace-4e2e-8db5-1e9091993837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:10.052834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d8e4c6b2-cace-4e2e-8db5-1e9091993837 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:10.054464 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d8e4c6b2-cace-4e2e-8db5-1e9091993837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:10.064185 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 828/1621] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:10.069718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4c6b2-cace-4e2e-8db5-1e9091993837 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:10.078716 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9189b6-f94d-4b0b-ae1b-d9afbcf8a7af None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:10.082948 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4c6b2-cace-4e2e-8db5-1e9091993837 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:10.085796 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba679954-4d3b-44a2-a85a-04d05c4a3993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:10.086677 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba679954-4d3b-44a2-a85a-04d05c4a3993 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:10.086965 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba679954-4d3b-44a2-a85a-04d05c4a3993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:10.087367 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba679954-4d3b-44a2-a85a-04d05c4a3993 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:10.088225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba679954-4d3b-44a2-a85a-04d05c4a3993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:10.090308 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae27295-4cb2-457a-bd27-fd6812189b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:10.090788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba679954-4d3b-44a2-a85a-04d05c4a3993 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:10.091854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae27295-4cb2-457a-bd27-fd6812189b4d admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:10.091854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae27295-4cb2-457a-bd27-fd6812189b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:10.091854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae27295-4cb2-457a-bd27-fd6812189b4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:10.092833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae27295-4cb2-457a-bd27-fd6812189b4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:10.095326 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae27295-4cb2-457a-bd27-fd6812189b4d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:10.124946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 794/1622] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:09 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:10.126070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba679954-4d3b-44a2-a85a-04d05c4a3993 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:10.139211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba679954-4d3b-44a2-a85a-04d05c4a3993 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:10.139439 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 829/1623] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:10 2022] POST /identity/v3/projects => generated 403 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:10.143002 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae27295-4cb2-457a-bd27-fd6812189b4d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:10.209522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a4a942-b1cc-4b2f-aba9-20ecccf24088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:10.210545 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4a942-b1cc-4b2f-aba9-20ecccf24088 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:10.210987 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4a942-b1cc-4b2f-aba9-20ecccf24088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:10.211433 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a4a942-b1cc-4b2f-aba9-20ecccf24088 admin admin] PATH_INFO: `/v3/projects/af60ad8fc2974c16976c5e5ae468dcd1/users/1627b28e7ed44b3982f2a36024184fd0/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:10.220877 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae27295-4cb2-457a-bd27-fd6812189b4d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:10.226751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bf4c6-6036-4b3d-8d90-958e53f19cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:10.227383 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bf4c6-6036-4b3d-8d90-958e53f19cea admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:10.227669 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bf4c6-6036-4b3d-8d90-958e53f19cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:10.227949 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bf4c6-6036-4b3d-8d90-958e53f19cea admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:10.228745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bf4c6-6036-4b3d-8d90-958e53f19cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:10.230427 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bf4c6-6036-4b3d-8d90-958e53f19cea admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:10.233332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4a942-b1cc-4b2f-aba9-20ecccf24088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af60ad8fc2974c16976c5e5ae468dcd1, user_id=1627b28e7ed44b3982f2a36024184fd0, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:10.237080 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a4a942-b1cc-4b2f-aba9-20ecccf24088 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:10.244555 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 830/1624] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:10.245100 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ece58-91d3-4c7c-b6b5-d126a72829dc None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:10.245390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ece58-91d3-4c7c-b6b5-d126a72829dc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:10.245622 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ece58-91d3-4c7c-b6b5-d126a72829dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:10.255885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 795/1625] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:10 2022] PUT /identity/v3/projects/af60ad8fc2974c16976c5e5ae468dcd1/users/1627b28e7ed44b3982f2a36024184fd0/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:10.256997 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f87c46-b7a7-41c4-87b8-5efcaa94a685 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:10.258881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f87c46-b7a7-41c4-87b8-5efcaa94a685 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:10.259176 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f87c46-b7a7-41c4-87b8-5efcaa94a685 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:10.260674 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 796/1626] 10.222.0.85 () {54 vars in 962 bytes} [Tue Aug 2 10:11:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:11:10.265995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f87c46-b7a7-41c4-87b8-5efcaa94a685 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:10.297670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2c7ece58-91d3-4c7c-b6b5-d126a72829dc None None] MFA Rules not processed for user `310867deefd34a598cfef2f3e4245ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:10.300019 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2c7ece58-91d3-4c7c-b6b5-d126a72829dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:10.352976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f87c46-b7a7-41c4-87b8-5efcaa94a685 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:10.357912 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ed18d-4f9f-44d3-9e93-a3549c5a338d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:10.358869 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ed18d-4f9f-44d3-9e93-a3549c5a338d service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:10.359147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ed18d-4f9f-44d3-9e93-a3549c5a338d service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:10.359430 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ed18d-4f9f-44d3-9e93-a3549c5a338d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:10.372767 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:10.394300 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 831/1627] 10.222.0.85 () {58 vars in 1059 bytes} [Tue Aug 2 10:11:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:10.395021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ece58-91d3-4c7c-b6b5-d126a72829dc None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:10.419916 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:10.443348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ed18d-4f9f-44d3-9e93-a3549c5a338d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:10.445016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ed18d-4f9f-44d3-9e93-a3549c5a338d service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:10.460184 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 797/1628] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:10.466414 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ed18d-4f9f-44d3-9e93-a3549c5a338d service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:10.473422 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ece58-91d3-4c7c-b6b5-d126a72829dc None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:10.484781 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799f3cd-55b8-4059-960f-bf8013065f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:10.485801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799f3cd-55b8-4059-960f-bf8013065f34 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:10.486400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799f3cd-55b8-4059-960f-bf8013065f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:10.486746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799f3cd-55b8-4059-960f-bf8013065f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:10.487699 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ed18d-4f9f-44d3-9e93-a3549c5a338d service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:10.488060 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799f3cd-55b8-4059-960f-bf8013065f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:10.491145 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799f3cd-55b8-4059-960f-bf8013065f34 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:10.495360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394ca5e-0d11-431c-ab41-079dfed62605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:10.496052 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394ca5e-0d11-431c-ab41-079dfed62605 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:10.496530 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394ca5e-0d11-431c-ab41-079dfed62605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:10.496830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394ca5e-0d11-431c-ab41-079dfed62605 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:10.497650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394ca5e-0d11-431c-ab41-079dfed62605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:10.500693 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394ca5e-0d11-431c-ab41-079dfed62605 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:10.504742 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 832/1629] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:10.509309 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799f3cd-55b8-4059-960f-bf8013065f34 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:10.524020 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799f3cd-55b8-4059-960f-bf8013065f34 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:10.530801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c1b187-8e8c-4302-b254-a4a4fff2325d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:10.532269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1b187-8e8c-4302-b254-a4a4fff2325d admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:10.532509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1b187-8e8c-4302-b254-a4a4fff2325d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:10.532891 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c1b187-8e8c-4302-b254-a4a4fff2325d admin admin] PATH_INFO: `/v3/projects/09b6e4c93e204e9cadec6ff605987e9e/users/14d30305e5884fe8a67a535966a10ba8/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:10.535491 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1b187-8e8c-4302-b254-a4a4fff2325d admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b6e4c93e204e9cadec6ff605987e9e, user_id=14d30305e5884fe8a67a535966a10ba8, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:10.541577 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c1b187-8e8c-4302-b254-a4a4fff2325d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:10.543479 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 798/1630] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:10 2022] POST /identity/v3/users => generated 308 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:10.545495 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394ca5e-0d11-431c-ab41-079dfed62605 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:10.571835 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394ca5e-0d11-431c-ab41-079dfed62605 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:10.590498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 833/1631] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:10 2022] PUT /identity/v3/projects/09b6e4c93e204e9cadec6ff605987e9e/users/14d30305e5884fe8a67a535966a10ba8/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:10.592052 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672889d-6862-4030-a847-fc9a34c2c3d8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:10.592343 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672889d-6862-4030-a847-fc9a34c2c3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:10.592702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672889d-6862-4030-a847-fc9a34c2c3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:10.617679 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c672889d-6862-4030-a847-fc9a34c2c3d8 None None] MFA Rules not processed for user `310867deefd34a598cfef2f3e4245ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:10.618942 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c672889d-6862-4030-a847-fc9a34c2c3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:10.724684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a80d2-c883-4de8-9b14-c0e3c702ba61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:10.726290 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a80d2-c883-4de8-9b14-c0e3c702ba61 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:10.726802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a80d2-c883-4de8-9b14-c0e3c702ba61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:10.727323 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a80d2-c883-4de8-9b14-c0e3c702ba61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:10.728762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a80d2-c883-4de8-9b14-c0e3c702ba61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:10.733307 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a80d2-c883-4de8-9b14-c0e3c702ba61 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:10.749902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 799/1632] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:10.750974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a80d2-c883-4de8-9b14-c0e3c702ba61 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:10.797166 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 834/1633] 10.222.0.85 () {58 vars in 1059 bytes} [Tue Aug 2 10:11:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:10.798536 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672889d-6862-4030-a847-fc9a34c2c3d8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:10.818849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672889d-6862-4030-a847-fc9a34c2c3d8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:10.829933 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a4bf1-c47a-44ba-b021-c3b7d7804118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:10.831058 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a4bf1-c47a-44ba-b021-c3b7d7804118 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:10.831346 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a4bf1-c47a-44ba-b021-c3b7d7804118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:10.831853 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a4bf1-c47a-44ba-b021-c3b7d7804118 admin admin] PATH_INFO: `/v3/projects/67941877a04046319b68b6887da30560/users/80e249ec67644d47bdff9f146e972ad4/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:10.855546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a80d2-c883-4de8-9b14-c0e3c702ba61 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:10.859756 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a4bf1-c47a-44ba-b021-c3b7d7804118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67941877a04046319b68b6887da30560, user_id=80e249ec67644d47bdff9f146e972ad4, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:10.866534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a4bf1-c47a-44ba-b021-c3b7d7804118 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:10.867293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a694dae5-882a-4ed6-a471-04d5a3409324 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:10.868746 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694dae5-882a-4ed6-a471-04d5a3409324 service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:10.869046 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694dae5-882a-4ed6-a471-04d5a3409324 service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:10.869331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a694dae5-882a-4ed6-a471-04d5a3409324 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:10.899161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 835/1634] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:10 2022] PUT /identity/v3/projects/67941877a04046319b68b6887da30560/users/80e249ec67644d47bdff9f146e972ad4/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:10.900434 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a4bf1-c47a-44ba-b021-c3b7d7804118 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:11.001588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:11.032914 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:11.034865 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a4bf1-c47a-44ba-b021-c3b7d7804118 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:11.036775 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694dae5-882a-4ed6-a471-04d5a3409324 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:11.038908 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a694dae5-882a-4ed6-a471-04d5a3409324 service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:11.047081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d1933-d861-4e76-ace8-b35016b676bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:11.048017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d1933-d861-4e76-ace8-b35016b676bf admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:11.048484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d1933-d861-4e76-ace8-b35016b676bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:11.048985 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d1933-d861-4e76-ace8-b35016b676bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:11.050456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d1933-d861-4e76-ace8-b35016b676bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:11.056138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 800/1635] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:11.057784 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccc9ee-21ee-47aa-8b1e-210b32eb60ac None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:11.058213 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccc9ee-21ee-47aa-8b1e-210b32eb60ac None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:11.058594 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcccc9ee-21ee-47aa-8b1e-210b32eb60ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:11.067925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d1933-d861-4e76-ace8-b35016b676bf admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:11.096542 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-dcccc9ee-21ee-47aa-8b1e-210b32eb60ac None None] MFA Rules not processed for user `14d30305e5884fe8a67a535966a10ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:11.100195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-dcccc9ee-21ee-47aa-8b1e-210b32eb60ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:11.111313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 836/1636] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:11.117901 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d1933-d861-4e76-ace8-b35016b676bf admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:11.155503 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d1933-d861-4e76-ace8-b35016b676bf admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:11.173717 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a677878-8b93-49f5-b392-507d70e43679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:11.174766 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a677878-8b93-49f5-b392-507d70e43679 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:11.175172 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a677878-8b93-49f5-b392-507d70e43679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:11.175623 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a677878-8b93-49f5-b392-507d70e43679 admin admin] PATH_INFO: `/v3/projects/af60ad8fc2974c16976c5e5ae468dcd1/users/1627b28e7ed44b3982f2a36024184fd0/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:11.185620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a677878-8b93-49f5-b392-507d70e43679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af60ad8fc2974c16976c5e5ae468dcd1, user_id=1627b28e7ed44b3982f2a36024184fd0, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:11.194072 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a677878-8b93-49f5-b392-507d70e43679 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:11.240117 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 837/1637] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:11 2022] PUT /identity/v3/projects/af60ad8fc2974c16976c5e5ae468dcd1/users/1627b28e7ed44b3982f2a36024184fd0/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:11.242011 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a677878-8b93-49f5-b392-507d70e43679 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:11.252032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 801/1638] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:11.253080 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccc9ee-21ee-47aa-8b1e-210b32eb60ac None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:11.267314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcccc9ee-21ee-47aa-8b1e-210b32eb60ac None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:11.343278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe116be2-b458-4031-b47d-04eb5ba0d490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:11.344175 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe116be2-b458-4031-b47d-04eb5ba0d490 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:11.344999 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe116be2-b458-4031-b47d-04eb5ba0d490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:11.346056 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe116be2-b458-4031-b47d-04eb5ba0d490 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:11.346311 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe116be2-b458-4031-b47d-04eb5ba0d490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:11.348740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe116be2-b458-4031-b47d-04eb5ba0d490 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:11.367032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 802/1639] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:11.367032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe116be2-b458-4031-b47d-04eb5ba0d490 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:11.378385 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe116be2-b458-4031-b47d-04eb5ba0d490 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:11.391296 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d6e23-644e-4926-ab6d-4cd60ef0d0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:11.392134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d6e23-644e-4926-ab6d-4cd60ef0d0c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:11.392569 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d6e23-644e-4926-ab6d-4cd60ef0d0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:11.392922 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d6e23-644e-4926-ab6d-4cd60ef0d0c1 admin admin] PATH_INFO: `/v3/projects/ed55091f747640088a26f07f1d11c30e/users/ae391516bf834d2bb1d4bd0abc08d9c0/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:11.432246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d6e23-644e-4926-ab6d-4cd60ef0d0c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed55091f747640088a26f07f1d11c30e, user_id=ae391516bf834d2bb1d4bd0abc08d9c0, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:11.435030 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d6e23-644e-4926-ab6d-4cd60ef0d0c1 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:11.465998 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 803/1640] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:11 2022] PUT /identity/v3/projects/ed55091f747640088a26f07f1d11c30e/users/ae391516bf834d2bb1d4bd0abc08d9c0/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:11.465998 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5821ba6-366a-46d0-9fbe-9b352fa9dd8a None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:11.465998 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5821ba6-366a-46d0-9fbe-9b352fa9dd8a None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:11.465998 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5821ba6-366a-46d0-9fbe-9b352fa9dd8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:11.492616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a677878-8b93-49f5-b392-507d70e43679 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:11.534859 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-f5821ba6-366a-46d0-9fbe-9b352fa9dd8a None None] MFA Rules not processed for user `1627b28e7ed44b3982f2a36024184fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:11.536231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f5821ba6-366a-46d0-9fbe-9b352fa9dd8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:11.633319 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:11.652845 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0510066-1ff0-4c01-aa75-e0868c19e72a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:11.653433 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0510066-1ff0-4c01-aa75-e0868c19e72a service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:11.653682 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0510066-1ff0-4c01-aa75-e0868c19e72a service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:11.654040 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0510066-1ff0-4c01-aa75-e0868c19e72a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:11.698100 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 804/1641] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:11.701744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5821ba6-366a-46d0-9fbe-9b352fa9dd8a None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:11.774752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0510066-1ff0-4c01-aa75-e0868c19e72a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:11.776439 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0510066-1ff0-4c01-aa75-e0868c19e72a service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:11.812136 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 838/1642] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:11.813678 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0510066-1ff0-4c01-aa75-e0868c19e72a service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:11.838365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:11.869835 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5821ba6-366a-46d0-9fbe-9b352fa9dd8a None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:11.877332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3472b-cc7c-4f2e-b0e7-ff71114ab885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:11.878853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3472b-cc7c-4f2e-b0e7-ff71114ab885 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:11.879434 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3472b-cc7c-4f2e-b0e7-ff71114ab885 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:11.879855 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3472b-cc7c-4f2e-b0e7-ff71114ab885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:12.025208 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3472b-cc7c-4f2e-b0e7-ff71114ab885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:12.028118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3472b-cc7c-4f2e-b0e7-ff71114ab885 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:12.062227 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0510066-1ff0-4c01-aa75-e0868c19e72a service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:12.070511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 805/1643] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:12.072264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3472b-cc7c-4f2e-b0e7-ff71114ab885 service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:12.082765 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d438c46-82e3-445f-8842-739165133652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:12.083790 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d438c46-82e3-445f-8842-739165133652 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:12.084220 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d438c46-82e3-445f-8842-739165133652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:12.084668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d438c46-82e3-445f-8842-739165133652 admin admin] PATH_INFO: `/v3/projects/67941877a04046319b68b6887da30560/users/80e249ec67644d47bdff9f146e972ad4/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:12.091877 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d438c46-82e3-445f-8842-739165133652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67941877a04046319b68b6887da30560, user_id=80e249ec67644d47bdff9f146e972ad4, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:12.100632 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d438c46-82e3-445f-8842-739165133652 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:12.125699 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 839/1644] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:11 2022] PUT /identity/v3/projects/67941877a04046319b68b6887da30560/users/80e249ec67644d47bdff9f146e972ad4/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:12.126684 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d438c46-82e3-445f-8842-739165133652 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:12.143922 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3472b-cc7c-4f2e-b0e7-ff71114ab885 service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:12.338993 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d438c46-82e3-445f-8842-739165133652 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:12.339991 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c953d-5cec-4bac-b0ad-83760f448f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:12.341331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c953d-5cec-4bac-b0ad-83760f448f84 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:12.341821 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c953d-5cec-4bac-b0ad-83760f448f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:12.342308 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c953d-5cec-4bac-b0ad-83760f448f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:12.343618 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c953d-5cec-4bac-b0ad-83760f448f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:12.346869 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c953d-5cec-4bac-b0ad-83760f448f84 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:12.351517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f0d23-6482-4d55-b6cb-a29cd6d19e55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:12.352152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f0d23-6482-4d55-b6cb-a29cd6d19e55 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:12.352430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f0d23-6482-4d55-b6cb-a29cd6d19e55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:12.352738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f0d23-6482-4d55-b6cb-a29cd6d19e55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:12.384054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 806/1645] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:12.386553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6edf1c-d542-437a-b949-558a5b1ed203 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:12.387068 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6edf1c-d542-437a-b949-558a5b1ed203 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:12.387563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6edf1c-d542-437a-b949-558a5b1ed203 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:12.390151 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 807/1646] 10.222.0.85 () {54 vars in 912 bytes} [Tue Aug 2 10:11:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:11:12.392192 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30e559-28ff-421f-b0dd-277faa5921cc None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:12.392725 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30e559-28ff-421f-b0dd-277faa5921cc None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:12.394219 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30e559-28ff-421f-b0dd-277faa5921cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:12.461712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-ca30e559-28ff-421f-b0dd-277faa5921cc None None] MFA Rules not processed for user `80e249ec67644d47bdff9f146e972ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:12.462951 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ca30e559-28ff-421f-b0dd-277faa5921cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:12.478009 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:12.522341 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f0d23-6482-4d55-b6cb-a29cd6d19e55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:12.524416 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f0d23-6482-4d55-b6cb-a29cd6d19e55 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:12.560148 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 840/1647] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:12 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:12.561730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864255b-35e3-49b4-aec9-9d3e8abb165c None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:12.562027 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864255b-35e3-49b4-aec9-9d3e8abb165c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:12.562303 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864255b-35e3-49b4-aec9-9d3e8abb165c None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:12.563859 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 841/1648] 10.222.0.85 () {54 vars in 912 bytes} [Tue Aug 2 10:11:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:11:12.565244 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864255b-35e3-49b4-aec9-9d3e8abb165c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:12.579932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 808/1649] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:12.585979 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30e559-28ff-421f-b0dd-277faa5921cc None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:12.597948 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30e559-28ff-421f-b0dd-277faa5921cc None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:12.603918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864255b-35e3-49b4-aec9-9d3e8abb165c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:12.604907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a0e89-15c4-48f7-bfd1-dd66b716a8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:12.605699 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a0e89-15c4-48f7-bfd1-dd66b716a8c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:12.606007 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a0e89-15c4-48f7-bfd1-dd66b716a8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:12.606278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a0e89-15c4-48f7-bfd1-dd66b716a8c3 admin admin] PATH_INFO: `/v3/projects/ed55091f747640088a26f07f1d11c30e/users/ae391516bf834d2bb1d4bd0abc08d9c0/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:12.610197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a0e89-15c4-48f7-bfd1-dd66b716a8c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed55091f747640088a26f07f1d11c30e, user_id=ae391516bf834d2bb1d4bd0abc08d9c0, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:12.613264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91a0e89-15c4-48f7-bfd1-dd66b716a8c3 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:12.621685 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ec60f-6f74-4ca9-a049-c3c0c4e76bf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:12.623357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ec60f-6f74-4ca9-a049-c3c0c4e76bf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:12.623835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ec60f-6f74-4ca9-a049-c3c0c4e76bf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:12.624980 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ec60f-6f74-4ca9-a049-c3c0c4e76bf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:12.636411 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 809/1650] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:12 2022] PUT /identity/v3/projects/ed55091f747640088a26f07f1d11c30e/users/ae391516bf834d2bb1d4bd0abc08d9c0/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:12.637298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746808e-1ceb-4982-8db4-f945fbc93dd9 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:12.637468 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746808e-1ceb-4982-8db4-f945fbc93dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:12.637752 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746808e-1ceb-4982-8db4-f945fbc93dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:12.672420 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-7746808e-1ceb-4982-8db4-f945fbc93dd9 None None] MFA Rules not processed for user `310867deefd34a598cfef2f3e4245ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:12.674176 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7746808e-1ceb-4982-8db4-f945fbc93dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:12.815262 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:12.832525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 810/1651] 10.222.0.85 () {58 vars in 1009 bytes} [Tue Aug 2 10:11:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:12.833910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7aab9-b3ca-422a-8b97-957e10dad951 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:12.834206 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7aab9-b3ca-422a-8b97-957e10dad951 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:12.834484 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7aab9-b3ca-422a-8b97-957e10dad951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:12.851777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ec60f-6f74-4ca9-a049-c3c0c4e76bf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:12.853623 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ec60f-6f74-4ca9-a049-c3c0c4e76bf4 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:12.944413 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-14c7aab9-b3ca-422a-8b97-957e10dad951 None None] MFA Rules not processed for user `310867deefd34a598cfef2f3e4245ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:12.944413 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-14c7aab9-b3ca-422a-8b97-957e10dad951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:12.946194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 842/1652] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:12.946194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03958e-fc0f-4dba-9e8b-0a7503821c72 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:12.946194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03958e-fc0f-4dba-9e8b-0a7503821c72 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:12.946194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03958e-fc0f-4dba-9e8b-0a7503821c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:12.946844 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 811/1653] 10.222.0.85 () {58 vars in 1009 bytes} [Tue Aug 2 10:11:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:12.946844 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7aab9-b3ca-422a-8b97-957e10dad951 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:12.980904 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0f03958e-fc0f-4dba-9e8b-0a7503821c72 None None] MFA Rules not processed for user `ae391516bf834d2bb1d4bd0abc08d9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:12.983171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0f03958e-fc0f-4dba-9e8b-0a7503821c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:13.103161 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7aab9-b3ca-422a-8b97-957e10dad951 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:13.110179 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147d9ab-67e3-4d7d-83e7-09ea40102811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:13.111376 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147d9ab-67e3-4d7d-83e7-09ea40102811 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:13.112647 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147d9ab-67e3-4d7d-83e7-09ea40102811 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:13.113257 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147d9ab-67e3-4d7d-83e7-09ea40102811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:13.191571 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 843/1654] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:12 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:13.209781 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:13.293729 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147d9ab-67e3-4d7d-83e7-09ea40102811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:13.299638 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147d9ab-67e3-4d7d-83e7-09ea40102811 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:13.327878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 812/1655] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:13.455545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03958e-fc0f-4dba-9e8b-0a7503821c72 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:13.479895 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03958e-fc0f-4dba-9e8b-0a7503821c72 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:13.485903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7f94d-e79e-49de-98b0-892be4564203 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:13.486828 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7f94d-e79e-49de-98b0-892be4564203 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:13.487245 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7f94d-e79e-49de-98b0-892be4564203 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:13.487657 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7f94d-e79e-49de-98b0-892be4564203 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:13.518514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147d9ab-67e3-4d7d-83e7-09ea40102811 service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:13.522720 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7f94d-e79e-49de-98b0-892be4564203 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:13.525838 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7f94d-e79e-49de-98b0-892be4564203 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:13.536659 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147d9ab-67e3-4d7d-83e7-09ea40102811 service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:13.547517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2b13f-2d64-4d47-aae8-5f15341589cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:13.549221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2b13f-2d64-4d47-aae8-5f15341589cd service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:13.549517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2b13f-2d64-4d47-aae8-5f15341589cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:13.550373 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2b13f-2d64-4d47-aae8-5f15341589cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:13.566379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 844/1656] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:13.606013 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2b13f-2d64-4d47-aae8-5f15341589cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:13.611373 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2b13f-2d64-4d47-aae8-5f15341589cd service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:13.646922 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 813/1657] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:11:13.697650 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7f94d-e79e-49de-98b0-892be4564203 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:13.717658 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7f94d-e79e-49de-98b0-892be4564203 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:13.730837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbae1c2-3013-4c0d-8676-5dd12895b155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:13.734183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbae1c2-3013-4c0d-8676-5dd12895b155 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:13.735253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbae1c2-3013-4c0d-8676-5dd12895b155 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:13.739388 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbae1c2-3013-4c0d-8676-5dd12895b155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:13.767188 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbae1c2-3013-4c0d-8676-5dd12895b155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:13.769075 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbae1c2-3013-4c0d-8676-5dd12895b155 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:13.805975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 845/1658] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:13 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:14.853253 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2b13f-2d64-4d47-aae8-5f15341589cd service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:14.870855 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2b13f-2d64-4d47-aae8-5f15341589cd service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:14.887038 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c7546-99ad-4536-947e-95d8404017ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:14.888241 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c7546-99ad-4536-947e-95d8404017ec service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:14.888858 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c7546-99ad-4536-947e-95d8404017ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:14.895127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c7546-99ad-4536-947e-95d8404017ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:15.209492 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c7546-99ad-4536-947e-95d8404017ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:15.212201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c7546-99ad-4536-947e-95d8404017ec service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:15.275446 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 814/1659] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:15.738369 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbae1c2-3013-4c0d-8676-5dd12895b155 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:16.043574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbae1c2-3013-4c0d-8676-5dd12895b155 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:16.062851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6421553-36bd-4e06-8ed1-b6535642108e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:16.063157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6421553-36bd-4e06-8ed1-b6535642108e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:16.065959 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6421553-36bd-4e06-8ed1-b6535642108e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:16.066292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6421553-36bd-4e06-8ed1-b6535642108e admin admin] PATH_INFO: `/v3/users/39dde4f17d8e41ed8583cd8d5c9ce8c2` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:16.070388 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6421553-36bd-4e06-8ed1-b6535642108e admin admin] RBAC: Authorizing `identity:delete_user(user_id=39dde4f17d8e41ed8583cd8d5c9ce8c2)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:16.073783 dv-cinder-850318-6-smb devstack@keystone.service[80330]: WARNING py.warnings [None req-d6421553-36bd-4e06-8ed1-b6535642108e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:11:16.073783 dv-cinder-850318-6-smb devstack@keystone.service[80330]: warnings.warn(msg) Aug 02 10:11:16.073783 dv-cinder-850318-6-smb devstack@keystone.service[80330]: Aug 02 10:11:16.075573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6421553-36bd-4e06-8ed1-b6535642108e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:16.139209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c7546-99ad-4536-947e-95d8404017ec service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:16.163110 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c7546-99ad-4536-947e-95d8404017ec service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:16.183221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834821a9-3892-4f2d-8e59-783439709e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:16.184065 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834821a9-3892-4f2d-8e59-783439709e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:16.184191 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834821a9-3892-4f2d-8e59-783439709e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:16.185500 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834821a9-3892-4f2d-8e59-783439709e5f admin admin] PATH_INFO: `/v3/users/0c3a542d0b96489ba55736f6761d7bd7` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:16.190213 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834821a9-3892-4f2d-8e59-783439709e5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c3a542d0b96489ba55736f6761d7bd7)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:16.201366 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834821a9-3892-4f2d-8e59-783439709e5f admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:16.263556 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:16.272442 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d6421553-36bd-4e06-8ed1-b6535642108e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39dde4f17d8e41ed8583cd8d5c9ce8c2'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:16.273521 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d6421553-36bd-4e06-8ed1-b6535642108e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39dde4f17d8e41ed8583cd8d5c9ce8c2'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:16.330221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d6421553-36bd-4e06-8ed1-b6535642108e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39dde4f17d8e41ed8583cd8d5c9ce8c2'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:16.406013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d6421553-36bd-4e06-8ed1-b6535642108e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39dde4f17d8e41ed8583cd8d5c9ce8c2'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:16.427537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d6421553-36bd-4e06-8ed1-b6535642108e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39dde4f17d8e41ed8583cd8d5c9ce8c2'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:16.443843 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 846/1660] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:15 2022] DELETE /identity/v3/users/39dde4f17d8e41ed8583cd8d5c9ce8c2 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:16.450228 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbfe60-0528-4c72-9b6e-62b3810c57bc None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:16.450565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbfe60-0528-4c72-9b6e-62b3810c57bc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:16.450850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbfe60-0528-4c72-9b6e-62b3810c57bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:16.457724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-834821a9-3892-4f2d-8e59-783439709e5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c3a542d0b96489ba55736f6761d7bd7'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:16.463713 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-834821a9-3892-4f2d-8e59-783439709e5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c3a542d0b96489ba55736f6761d7bd7'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:16.506467 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-834821a9-3892-4f2d-8e59-783439709e5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c3a542d0b96489ba55736f6761d7bd7'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:16.524957 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-834821a9-3892-4f2d-8e59-783439709e5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c3a542d0b96489ba55736f6761d7bd7'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:16.526601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-834821a9-3892-4f2d-8e59-783439709e5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c3a542d0b96489ba55736f6761d7bd7'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:16.530105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-cefbfe60-0528-4c72-9b6e-62b3810c57bc None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:16.531381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cefbfe60-0528-4c72-9b6e-62b3810c57bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:16.570340 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 815/1661] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:16 2022] DELETE /identity/v3/users/0c3a542d0b96489ba55736f6761d7bd7 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:16.573089 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52726190-c9a4-43a9-a2d0-653ffe7e3afe None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:16.574700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52726190-c9a4-43a9-a2d0-653ffe7e3afe None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:16.574700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52726190-c9a4-43a9-a2d0-653ffe7e3afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:16.663587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-52726190-c9a4-43a9-a2d0-653ffe7e3afe None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:16.668211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-52726190-c9a4-43a9-a2d0-653ffe7e3afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:16.756296 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 847/1662] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:16.768833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbfe60-0528-4c72-9b6e-62b3810c57bc None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:16.771251 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cefbfe60-0528-4c72-9b6e-62b3810c57bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:16.786151 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:16.873357 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 816/1663] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:16.906771 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52726190-c9a4-43a9-a2d0-653ffe7e3afe None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:16.908586 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-52726190-c9a4-43a9-a2d0-653ffe7e3afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:16.933771 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbfe60-0528-4c72-9b6e-62b3810c57bc None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:17.005059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08390364-0707-4fb1-a048-e3c025e9f1d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:17.005693 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08390364-0707-4fb1-a048-e3c025e9f1d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:17.006352 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08390364-0707-4fb1-a048-e3c025e9f1d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:17.006636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08390364-0707-4fb1-a048-e3c025e9f1d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:17.019064 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08390364-0707-4fb1-a048-e3c025e9f1d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:17.021607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08390364-0707-4fb1-a048-e3c025e9f1d6 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:17.034390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 848/1664] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:11:17.040393 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52726190-c9a4-43a9-a2d0-653ffe7e3afe None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:17.052445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3882ed0-1a4a-4a54-9d8d-2d01fa8a8f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:17.053374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3882ed0-1a4a-4a54-9d8d-2d01fa8a8f59 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:17.053830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3882ed0-1a4a-4a54-9d8d-2d01fa8a8f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:17.054382 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3882ed0-1a4a-4a54-9d8d-2d01fa8a8f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:17.077413 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3882ed0-1a4a-4a54-9d8d-2d01fa8a8f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:17.079120 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3882ed0-1a4a-4a54-9d8d-2d01fa8a8f59 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:17.105532 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 817/1665] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:11:18.099104 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08390364-0707-4fb1-a048-e3c025e9f1d6 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:18.106905 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-08390364-0707-4fb1-a048-e3c025e9f1d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:18.196912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08390364-0707-4fb1-a048-e3c025e9f1d6 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:18.244333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e563cce-59da-402b-b9c4-2b24dfe7e9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:18.248024 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e563cce-59da-402b-b9c4-2b24dfe7e9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:18.249145 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e563cce-59da-402b-b9c4-2b24dfe7e9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:18.249607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e563cce-59da-402b-b9c4-2b24dfe7e9fc admin admin] PATH_INFO: `/v3/users/2871d4c1e19a4e97a95fb467fc3664f6` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:18.252181 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e563cce-59da-402b-b9c4-2b24dfe7e9fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2871d4c1e19a4e97a95fb467fc3664f6)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:18.257612 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e563cce-59da-402b-b9c4-2b24dfe7e9fc admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:18.277801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3882ed0-1a4a-4a54-9d8d-2d01fa8a8f59 service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:18.281375 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-c3882ed0-1a4a-4a54-9d8d-2d01fa8a8f59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:18.304749 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3882ed0-1a4a-4a54-9d8d-2d01fa8a8f59 service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:18.318065 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:18.323993 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21308a-60d4-422c-af48-f9916c16a3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:18.326011 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21308a-60d4-422c-af48-f9916c16a3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:18.326511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21308a-60d4-422c-af48-f9916c16a3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:18.326928 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21308a-60d4-422c-af48-f9916c16a3cf admin admin] PATH_INFO: `/v3/projects/1589ba4c99194698aa1b5ba7cf5b1758` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:18.328495 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21308a-60d4-422c-af48-f9916c16a3cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1589ba4c99194698aa1b5ba7cf5b1758)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:18.329870 dv-cinder-850318-6-smb devstack@keystone.service[80329]: WARNING py.warnings [None req-3e21308a-60d4-422c-af48-f9916c16a3cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 10:11:18.329870 dv-cinder-850318-6-smb devstack@keystone.service[80329]: warnings.warn(msg) Aug 02 10:11:18.329870 dv-cinder-850318-6-smb devstack@keystone.service[80329]: Aug 02 10:11:18.331386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21308a-60d4-422c-af48-f9916c16a3cf admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:18.447282 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3e563cce-59da-402b-b9c4-2b24dfe7e9fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2871d4c1e19a4e97a95fb467fc3664f6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:18.451905 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3e563cce-59da-402b-b9c4-2b24dfe7e9fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2871d4c1e19a4e97a95fb467fc3664f6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:18.482544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3e563cce-59da-402b-b9c4-2b24dfe7e9fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2871d4c1e19a4e97a95fb467fc3664f6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:18.525100 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3e563cce-59da-402b-b9c4-2b24dfe7e9fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2871d4c1e19a4e97a95fb467fc3664f6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:18.549543 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3e563cce-59da-402b-b9c4-2b24dfe7e9fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2871d4c1e19a4e97a95fb467fc3664f6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:18.574954 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 849/1666] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:18 2022] DELETE /identity/v3/users/2871d4c1e19a4e97a95fb467fc3664f6 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:18.574954 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12b3ad-cec0-4353-b4c6-6e5fe536aff0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:18.574954 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12b3ad-cec0-4353-b4c6-6e5fe536aff0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:18.574954 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f12b3ad-cec0-4353-b4c6-6e5fe536aff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:18.630629 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3e21308a-60d4-422c-af48-f9916c16a3cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1589ba4c99194698aa1b5ba7cf5b1758', 'request_id': 'req-3e21308a-60d4-422c-af48-f9916c16a3cf'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:18.646523 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3e21308a-60d4-422c-af48-f9916c16a3cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1589ba4c99194698aa1b5ba7cf5b1758', 'request_id': 'req-3e21308a-60d4-422c-af48-f9916c16a3cf'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:18.671655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7f12b3ad-cec0-4353-b4c6-6e5fe536aff0 None None] MFA Rules not processed for user `324d0f6b637647a29580091f3a248cda`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:18.673073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7f12b3ad-cec0-4353-b4c6-6e5fe536aff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:18.711191 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3e21308a-60d4-422c-af48-f9916c16a3cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1589ba4c99194698aa1b5ba7cf5b1758', 'request_id': 'req-3e21308a-60d4-422c-af48-f9916c16a3cf'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:18.753429 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3e21308a-60d4-422c-af48-f9916c16a3cf admin admin] The token cache is being invalidate because project 1589ba4c99194698aa1b5ba7cf5b1758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:18.753877 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3e21308a-60d4-422c-af48-f9916c16a3cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:18.757565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3e21308a-60d4-422c-af48-f9916c16a3cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:18.767475 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 818/1667] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:18 2022] DELETE /identity/v3/projects/1589ba4c99194698aa1b5ba7cf5b1758 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:11:18.769652 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80aa342-80e0-407a-b293-eabfb745e223 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:18.770649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80aa342-80e0-407a-b293-eabfb745e223 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:18.771074 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80aa342-80e0-407a-b293-eabfb745e223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:18.848675 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-a80aa342-80e0-407a-b293-eabfb745e223 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:18.851017 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a80aa342-80e0-407a-b293-eabfb745e223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:18.925823 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 850/1668] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:18.929421 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e753e-9f5b-40a2-90f0-890a370f006a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:18.929716 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e753e-9f5b-40a2-90f0-890a370f006a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:18.930004 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e753e-9f5b-40a2-90f0-890a370f006a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:18.996764 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:19.016434 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 819/1669] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:19.029608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80aa342-80e0-407a-b293-eabfb745e223 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:19.030921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-db7e753e-9f5b-40a2-90f0-890a370f006a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:19.030993 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a80aa342-80e0-407a-b293-eabfb745e223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:19.034943 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-db7e753e-9f5b-40a2-90f0-890a370f006a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:19.056516 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 851/1670] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:19.057659 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e753e-9f5b-40a2-90f0-890a370f006a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:19.063713 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-db7e753e-9f5b-40a2-90f0-890a370f006a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:19.087844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e753e-9f5b-40a2-90f0-890a370f006a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:19.111972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b772a0b-660e-461c-a740-248a35cb6e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:19.122233 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b772a0b-660e-461c-a740-248a35cb6e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:19.122728 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b772a0b-660e-461c-a740-248a35cb6e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:19.123128 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b772a0b-660e-461c-a740-248a35cb6e70 admin admin] PATH_INFO: `/v3/users/5d791b7676d6485794bb267b1bebdcad` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:19.127322 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b772a0b-660e-461c-a740-248a35cb6e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d791b7676d6485794bb267b1bebdcad)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:19.130964 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b772a0b-660e-461c-a740-248a35cb6e70 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:19.227535 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7b772a0b-660e-461c-a740-248a35cb6e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d791b7676d6485794bb267b1bebdcad'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:19.228323 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7b772a0b-660e-461c-a740-248a35cb6e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d791b7676d6485794bb267b1bebdcad'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:19.237802 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7b772a0b-660e-461c-a740-248a35cb6e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d791b7676d6485794bb267b1bebdcad'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:19.259406 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:DELETE=18,keystone:SELECT=81,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:19.261342 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7b772a0b-660e-461c-a740-248a35cb6e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d791b7676d6485794bb267b1bebdcad'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:19.281378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7b772a0b-660e-461c-a740-248a35cb6e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d791b7676d6485794bb267b1bebdcad'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:19.286030 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80aa342-80e0-407a-b293-eabfb745e223 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:19.304572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 852/1671] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:19 2022] DELETE /identity/v3/users/5d791b7676d6485794bb267b1bebdcad => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:19.306097 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7386ff-3765-4864-948e-bcdad486bc6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:19.306749 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7386ff-3765-4864-948e-bcdad486bc6f service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:19.307037 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7386ff-3765-4864-948e-bcdad486bc6f service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:19.307310 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7386ff-3765-4864-948e-bcdad486bc6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:19.308208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbd636-e302-4702-9dad-60f10b2c0bf0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:19.308519 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbd636-e302-4702-9dad-60f10b2c0bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:19.309768 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-5d7386ff-3765-4864-948e-bcdad486bc6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:19.313890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbd636-e302-4702-9dad-60f10b2c0bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:19.338646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7386ff-3765-4864-948e-bcdad486bc6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:19.340702 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7386ff-3765-4864-948e-bcdad486bc6f service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:19.347204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7abbd636-e302-4702-9dad-60f10b2c0bf0 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:19.349984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7abbd636-e302-4702-9dad-60f10b2c0bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:19.371938 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 820/1672] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:19.372955 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7386ff-3765-4864-948e-bcdad486bc6f service nova] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:19.379939 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-5d7386ff-3765-4864-948e-bcdad486bc6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:19.537006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 853/1673] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:19.537006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbd636-e302-4702-9dad-60f10b2c0bf0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:19.538353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7abbd636-e302-4702-9dad-60f10b2c0bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:19.541175 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7386ff-3765-4864-948e-bcdad486bc6f service nova] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:19.574690 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbd636-e302-4702-9dad-60f10b2c0bf0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:19.583783 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97822fc-6c46-41e8-9764-2938b904e70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:19.583783 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97822fc-6c46-41e8-9764-2938b904e70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:19.584149 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97822fc-6c46-41e8-9764-2938b904e70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:19.584351 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97822fc-6c46-41e8-9764-2938b904e70c admin admin] PATH_INFO: `/v3/projects/fd4a2c6ec3e74056b8a0c91bd5fdd513` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:19.585816 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97822fc-6c46-41e8-9764-2938b904e70c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd4a2c6ec3e74056b8a0c91bd5fdd513)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:19.587964 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97822fc-6c46-41e8-9764-2938b904e70c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:19.675650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c2925-95b5-4043-b553-5ec6e385481f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:19.678510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c2925-95b5-4043-b553-5ec6e385481f service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:19.678985 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c2925-95b5-4043-b553-5ec6e385481f service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:19.679407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c2925-95b5-4043-b553-5ec6e385481f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:19.682392 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-515c2925-95b5-4043-b553-5ec6e385481f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:19.704297 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a97822fc-6c46-41e8-9764-2938b904e70c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd4a2c6ec3e74056b8a0c91bd5fdd513', 'request_id': 'req-a97822fc-6c46-41e8-9764-2938b904e70c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:19.710840 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c2925-95b5-4043-b553-5ec6e385481f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:19.713953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c2925-95b5-4043-b553-5ec6e385481f service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:19.716171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a97822fc-6c46-41e8-9764-2938b904e70c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd4a2c6ec3e74056b8a0c91bd5fdd513', 'request_id': 'req-a97822fc-6c46-41e8-9764-2938b904e70c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:19.729138 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a97822fc-6c46-41e8-9764-2938b904e70c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd4a2c6ec3e74056b8a0c91bd5fdd513', 'request_id': 'req-a97822fc-6c46-41e8-9764-2938b904e70c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:19.731112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 821/1674] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:19.736202 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1d087-19cf-412f-907d-1f3a6d4abacb None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:19.736689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1d087-19cf-412f-907d-1f3a6d4abacb None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:19.737219 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1d087-19cf-412f-907d-1f3a6d4abacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:19.753827 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a97822fc-6c46-41e8-9764-2938b904e70c admin admin] The token cache is being invalidate because project fd4a2c6ec3e74056b8a0c91bd5fdd513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:19.755843 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a97822fc-6c46-41e8-9764-2938b904e70c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:19.756837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a97822fc-6c46-41e8-9764-2938b904e70c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:19.759657 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 854/1675] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:19 2022] DELETE /identity/v3/projects/fd4a2c6ec3e74056b8a0c91bd5fdd513 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:19.761020 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97822fc-6c46-41e8-9764-2938b904e70c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:19.763317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a97822fc-6c46-41e8-9764-2938b904e70c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:19.775028 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-bcb1d087-19cf-412f-907d-1f3a6d4abacb None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:19.777011 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-bcb1d087-19cf-412f-907d-1f3a6d4abacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:19.839845 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:19.876972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97822fc-6c46-41e8-9764-2938b904e70c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:19.902966 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 822/1676] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:19.903622 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86450ac1-9931-48d6-b516-b97d5ff05b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:19.905327 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1d087-19cf-412f-907d-1f3a6d4abacb None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:19.905671 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86450ac1-9931-48d6-b516-b97d5ff05b91 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:19.908960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86450ac1-9931-48d6-b516-b97d5ff05b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:19.909144 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-bcb1d087-19cf-412f-907d-1f3a6d4abacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:19.909618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86450ac1-9931-48d6-b516-b97d5ff05b91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:19.912335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86450ac1-9931-48d6-b516-b97d5ff05b91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:19.913068 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86450ac1-9931-48d6-b516-b97d5ff05b91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:19.915868 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86450ac1-9931-48d6-b516-b97d5ff05b91 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:19.939346 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 855/1677] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:19.940370 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86450ac1-9931-48d6-b516-b97d5ff05b91 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:19.944023 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-86450ac1-9931-48d6-b516-b97d5ff05b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:19.945610 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1d087-19cf-412f-907d-1f3a6d4abacb None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:19.955957 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956811d-5484-46b3-8633-c18d9f294173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:19.957015 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956811d-5484-46b3-8633-c18d9f294173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:19.958044 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956811d-5484-46b3-8633-c18d9f294173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:19.959219 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956811d-5484-46b3-8633-c18d9f294173 admin admin] PATH_INFO: `/v3/users/ae391516bf834d2bb1d4bd0abc08d9c0` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:19.961223 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956811d-5484-46b3-8633-c18d9f294173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae391516bf834d2bb1d4bd0abc08d9c0)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:19.962360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:19.965519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3956811d-5484-46b3-8633-c18d9f294173 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:20.059692 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86450ac1-9931-48d6-b516-b97d5ff05b91 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:20.070926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785878be-21f1-4e5e-8625-85e17a24aa22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:20.073648 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785878be-21f1-4e5e-8625-85e17a24aa22 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:20.076252 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785878be-21f1-4e5e-8625-85e17a24aa22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:20.077281 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785878be-21f1-4e5e-8625-85e17a24aa22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:20.079466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3956811d-5484-46b3-8633-c18d9f294173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae391516bf834d2bb1d4bd0abc08d9c0'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:20.081666 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3956811d-5484-46b3-8633-c18d9f294173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae391516bf834d2bb1d4bd0abc08d9c0'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:20.110086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785878be-21f1-4e5e-8625-85e17a24aa22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:20.113229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785878be-21f1-4e5e-8625-85e17a24aa22 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:20.115554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3956811d-5484-46b3-8633-c18d9f294173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae391516bf834d2bb1d4bd0abc08d9c0'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:20.138408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3956811d-5484-46b3-8633-c18d9f294173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae391516bf834d2bb1d4bd0abc08d9c0'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:20.139270 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3956811d-5484-46b3-8633-c18d9f294173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae391516bf834d2bb1d4bd0abc08d9c0'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:20.165745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 823/1678] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:19 2022] DELETE /identity/v3/users/ae391516bf834d2bb1d4bd0abc08d9c0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:20.167736 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956811d-5484-46b3-8633-c18d9f294173 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:20.172580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-3956811d-5484-46b3-8633-c18d9f294173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:20.174147 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 856/1679] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:20.340339 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956811d-5484-46b3-8633-c18d9f294173 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:20.364375 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8d76a-83be-4314-afcb-9838145d1dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:20.366035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8d76a-83be-4314-afcb-9838145d1dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:20.366526 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8d76a-83be-4314-afcb-9838145d1dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:20.367074 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8d76a-83be-4314-afcb-9838145d1dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:20.367911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8d76a-83be-4314-afcb-9838145d1dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:20.371244 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8d76a-83be-4314-afcb-9838145d1dc0 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:20.457671 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 824/1680] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:20 2022] POST /identity/v3/projects => generated 363 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:20.459538 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785878be-21f1-4e5e-8625-85e17a24aa22 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:20.482406 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785878be-21f1-4e5e-8625-85e17a24aa22 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:20.652025 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51edaeb-4cc6-462e-9e74-37c1652b6eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:20.652819 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51edaeb-4cc6-462e-9e74-37c1652b6eca admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:20.653116 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51edaeb-4cc6-462e-9e74-37c1652b6eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:20.653416 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51edaeb-4cc6-462e-9e74-37c1652b6eca admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:20.654116 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51edaeb-4cc6-462e-9e74-37c1652b6eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:20.658513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51edaeb-4cc6-462e-9e74-37c1652b6eca admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:20.715735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 857/1681] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:20 2022] POST /identity/v3/users => generated 282 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:20.722179 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8d76a-83be-4314-afcb-9838145d1dc0 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:20.738323 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8d76a-83be-4314-afcb-9838145d1dc0 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:20.760137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2eab8-e9f1-434c-9638-660b6652989d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:20.762104 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2eab8-e9f1-434c-9638-660b6652989d admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:20.762408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2eab8-e9f1-434c-9638-660b6652989d admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:20.762696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2eab8-e9f1-434c-9638-660b6652989d admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:20.763425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2eab8-e9f1-434c-9638-660b6652989d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:20.781661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2eab8-e9f1-434c-9638-660b6652989d admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:20.834137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 825/1682] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:20.835621 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51edaeb-4cc6-462e-9e74-37c1652b6eca admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:20.847396 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51edaeb-4cc6-462e-9e74-37c1652b6eca admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:20.870163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d63322-d7c7-4e37-8665-653eb099d39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:20.870815 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d63322-d7c7-4e37-8665-653eb099d39f admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:20.871100 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d63322-d7c7-4e37-8665-653eb099d39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:20.871378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d63322-d7c7-4e37-8665-653eb099d39f admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:20.872396 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d63322-d7c7-4e37-8665-653eb099d39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:20.874056 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d63322-d7c7-4e37-8665-653eb099d39f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:20.902447 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 858/1683] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:20.905483 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2eab8-e9f1-434c-9638-660b6652989d admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:20.922737 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2eab8-e9f1-434c-9638-660b6652989d admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:20.941121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb7fae-28a8-495b-868d-758225ea9e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:20.942441 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb7fae-28a8-495b-868d-758225ea9e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:20.943113 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb7fae-28a8-495b-868d-758225ea9e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:20.943571 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb7fae-28a8-495b-868d-758225ea9e9a admin admin] PATH_INFO: `/v3/projects/2e88ed108d424f6fa410eee0ca7c5eff/users/c7d2d655923f4e21857e09a93b74c767/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:20.990894 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb7fae-28a8-495b-868d-758225ea9e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e88ed108d424f6fa410eee0ca7c5eff, user_id=c7d2d655923f4e21857e09a93b74c767, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:20.993690 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb7fae-28a8-495b-868d-758225ea9e9a admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:21.016762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 826/1684] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:20 2022] PUT /identity/v3/projects/2e88ed108d424f6fa410eee0ca7c5eff/users/c7d2d655923f4e21857e09a93b74c767/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:21.029565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb31a8f-cdf8-4182-bfd5-e7b3a8dacf66 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:21.029859 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb31a8f-cdf8-4182-bfd5-e7b3a8dacf66 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:21.030190 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb31a8f-cdf8-4182-bfd5-e7b3a8dacf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:21.134820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7eb31a8f-cdf8-4182-bfd5-e7b3a8dacf66 None None] MFA Rules not processed for user `c7d2d655923f4e21857e09a93b74c767`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:21.136621 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7eb31a8f-cdf8-4182-bfd5-e7b3a8dacf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:21.370483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 859/1685] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:21.375074 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb7fae-28a8-495b-868d-758225ea9e9a admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:21.382262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:21.568713 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb7fae-28a8-495b-868d-758225ea9e9a admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:21.595416 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef946f36-dfad-4890-88b6-2f03b61b4391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:21.596068 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef946f36-dfad-4890-88b6-2f03b61b4391 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:21.596348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef946f36-dfad-4890-88b6-2f03b61b4391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:21.596651 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef946f36-dfad-4890-88b6-2f03b61b4391 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:21.597352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef946f36-dfad-4890-88b6-2f03b61b4391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:21.600130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef946f36-dfad-4890-88b6-2f03b61b4391 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:21.607443 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb31a8f-cdf8-4182-bfd5-e7b3a8dacf66 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:21.609520 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7eb31a8f-cdf8-4182-bfd5-e7b3a8dacf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:21.649827 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb31a8f-cdf8-4182-bfd5-e7b3a8dacf66 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:21.666047 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11cbd2-e34b-4f55-8c77-2def29575b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:21.679662 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11cbd2-e34b-4f55-8c77-2def29575b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:21.683275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11cbd2-e34b-4f55-8c77-2def29575b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:21.683734 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11cbd2-e34b-4f55-8c77-2def29575b24 admin admin] PATH_INFO: `/v3/projects/869bd898ead54451b7bab81457caecfd` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:21.689470 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11cbd2-e34b-4f55-8c77-2def29575b24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=869bd898ead54451b7bab81457caecfd)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:21.697334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11cbd2-e34b-4f55-8c77-2def29575b24 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:21.703073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 827/1686] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:21 2022] POST /identity/v3/projects => generated 365 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:21.705974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef946f36-dfad-4890-88b6-2f03b61b4391 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:21.757889 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:21.896696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ca11cbd2-e34b-4f55-8c77-2def29575b24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '869bd898ead54451b7bab81457caecfd', 'request_id': 'req-ca11cbd2-e34b-4f55-8c77-2def29575b24'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:21.916889 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ca11cbd2-e34b-4f55-8c77-2def29575b24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '869bd898ead54451b7bab81457caecfd', 'request_id': 'req-ca11cbd2-e34b-4f55-8c77-2def29575b24'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:21.930643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef946f36-dfad-4890-88b6-2f03b61b4391 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:21.953578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ca11cbd2-e34b-4f55-8c77-2def29575b24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '869bd898ead54451b7bab81457caecfd', 'request_id': 'req-ca11cbd2-e34b-4f55-8c77-2def29575b24'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:21.996594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ca11cbd2-e34b-4f55-8c77-2def29575b24 admin admin] The token cache is being invalidate because project 869bd898ead54451b7bab81457caecfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:21.998978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ca11cbd2-e34b-4f55-8c77-2def29575b24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:22.000154 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ca11cbd2-e34b-4f55-8c77-2def29575b24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:22.006082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 860/1687] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:21 2022] DELETE /identity/v3/projects/869bd898ead54451b7bab81457caecfd => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:11:22.007235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11cbd2-e34b-4f55-8c77-2def29575b24 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:22.018032 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ca11cbd2-e34b-4f55-8c77-2def29575b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:22.137422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1d013-79dd-4bf1-a21c-530e209c7ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:22.148809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1d013-79dd-4bf1-a21c-530e209c7ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:22.149179 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1d013-79dd-4bf1-a21c-530e209c7ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:22.149522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1d013-79dd-4bf1-a21c-530e209c7ab0 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:22.150203 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1d013-79dd-4bf1-a21c-530e209c7ab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:22.163500 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1d013-79dd-4bf1-a21c-530e209c7ab0 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:22.266805 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 828/1688] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:21 2022] POST /identity/v3/users => generated 289 bytes in 563 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:22.269847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11cbd2-e34b-4f55-8c77-2def29575b24 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:22.271342 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330a33f-d0b8-4b1d-b773-5e96f457731e None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:22.272977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330a33f-d0b8-4b1d-b773-5e96f457731e None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:22.274702 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330a33f-d0b8-4b1d-b773-5e96f457731e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:22.285015 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba815fa-04b2-43ee-a65d-6204c2f81c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:22.285779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba815fa-04b2-43ee-a65d-6204c2f81c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:22.286213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba815fa-04b2-43ee-a65d-6204c2f81c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:22.286629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba815fa-04b2-43ee-a65d-6204c2f81c4f admin admin] PATH_INFO: `/v3/projects/ab0b45bd550f4337b5d1bc094e6a200a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:22.289522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba815fa-04b2-43ee-a65d-6204c2f81c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab0b45bd550f4337b5d1bc094e6a200a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:22.291685 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba815fa-04b2-43ee-a65d-6204c2f81c4f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:22.322616 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-b330a33f-d0b8-4b1d-b773-5e96f457731e None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:22.324287 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b330a33f-d0b8-4b1d-b773-5e96f457731e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:22.352629 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 829/1689] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:22.354126 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330a33f-d0b8-4b1d-b773-5e96f457731e None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:22.368148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b330a33f-d0b8-4b1d-b773-5e96f457731e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:22.406088 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330a33f-d0b8-4b1d-b773-5e96f457731e None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:22.451164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7ba815fa-04b2-43ee-a65d-6204c2f81c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab0b45bd550f4337b5d1bc094e6a200a', 'request_id': 'req-7ba815fa-04b2-43ee-a65d-6204c2f81c4f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:22.473827 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7ba815fa-04b2-43ee-a65d-6204c2f81c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab0b45bd550f4337b5d1bc094e6a200a', 'request_id': 'req-7ba815fa-04b2-43ee-a65d-6204c2f81c4f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:22.476686 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:22.512416 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7ba815fa-04b2-43ee-a65d-6204c2f81c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab0b45bd550f4337b5d1bc094e6a200a', 'request_id': 'req-7ba815fa-04b2-43ee-a65d-6204c2f81c4f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:22.563873 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7ba815fa-04b2-43ee-a65d-6204c2f81c4f admin admin] The token cache is being invalidate because project ab0b45bd550f4337b5d1bc094e6a200a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:22.564197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7ba815fa-04b2-43ee-a65d-6204c2f81c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:22.565934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7ba815fa-04b2-43ee-a65d-6204c2f81c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:22.568291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 861/1690] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:22 2022] DELETE /identity/v3/projects/ab0b45bd550f4337b5d1bc094e6a200a => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:22.571794 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba815fa-04b2-43ee-a65d-6204c2f81c4f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:22.578892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7ba815fa-04b2-43ee-a65d-6204c2f81c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:22.645661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26579bb3-ab74-4b70-922a-87cce7c11677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:22.646335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26579bb3-ab74-4b70-922a-87cce7c11677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:22.646621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26579bb3-ab74-4b70-922a-87cce7c11677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:22.646900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26579bb3-ab74-4b70-922a-87cce7c11677 admin admin] PATH_INFO: `/v3/projects/ed55091f747640088a26f07f1d11c30e` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:22.650980 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26579bb3-ab74-4b70-922a-87cce7c11677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed55091f747640088a26f07f1d11c30e)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:22.652968 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26579bb3-ab74-4b70-922a-87cce7c11677 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:22.680494 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:22.773206 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba815fa-04b2-43ee-a65d-6204c2f81c4f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:22.793563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-26579bb3-ab74-4b70-922a-87cce7c11677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed55091f747640088a26f07f1d11c30e', 'request_id': 'req-26579bb3-ab74-4b70-922a-87cce7c11677'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:22.809078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-26579bb3-ab74-4b70-922a-87cce7c11677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed55091f747640088a26f07f1d11c30e', 'request_id': 'req-26579bb3-ab74-4b70-922a-87cce7c11677'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:22.825177 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-26579bb3-ab74-4b70-922a-87cce7c11677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed55091f747640088a26f07f1d11c30e', 'request_id': 'req-26579bb3-ab74-4b70-922a-87cce7c11677'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:22.853529 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-26579bb3-ab74-4b70-922a-87cce7c11677 admin admin] The token cache is being invalidate because project ed55091f747640088a26f07f1d11c30e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:22.853830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-26579bb3-ab74-4b70-922a-87cce7c11677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:22.856094 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-26579bb3-ab74-4b70-922a-87cce7c11677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:22.865059 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 830/1691] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:22 2022] DELETE /identity/v3/projects/ed55091f747640088a26f07f1d11c30e => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:22.865059 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ee3ee-6949-4b3b-a0a5-9ecf8cc04212 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:22.865059 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ee3ee-6949-4b3b-a0a5-9ecf8cc04212 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:22.865380 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ee3ee-6949-4b3b-a0a5-9ecf8cc04212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:22.909570 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-339ee3ee-6949-4b3b-a0a5-9ecf8cc04212 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:22.911382 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-339ee3ee-6949-4b3b-a0a5-9ecf8cc04212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:22.929832 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f6a7a-9af9-4cca-880a-7c94f47986ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:22.930478 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f6a7a-9af9-4cca-880a-7c94f47986ee admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:22.930760 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f6a7a-9af9-4cca-880a-7c94f47986ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:22.931050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f6a7a-9af9-4cca-880a-7c94f47986ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:22.931999 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f6a7a-9af9-4cca-880a-7c94f47986ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:22.937230 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 831/1692] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:22.937390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f6a7a-9af9-4cca-880a-7c94f47986ee admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:22.937566 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ee3ee-6949-4b3b-a0a5-9ecf8cc04212 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:22.940843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-339ee3ee-6949-4b3b-a0a5-9ecf8cc04212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:22.967498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 862/1693] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:22.967680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ee3ee-6949-4b3b-a0a5-9ecf8cc04212 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:22.967926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0dee0-6f60-43ca-b39f-127b36669697 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:22.968225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0dee0-6f60-43ca-b39f-127b36669697 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:22.968548 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0dee0-6f60-43ca-b39f-127b36669697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:22.986848 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed6217-b1ab-4f87-bfcf-247dfadb46d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:22.987514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed6217-b1ab-4f87-bfcf-247dfadb46d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:22.987935 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed6217-b1ab-4f87-bfcf-247dfadb46d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:22.989304 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed6217-b1ab-4f87-bfcf-247dfadb46d7 admin admin] PATH_INFO: `/v3/users/1627b28e7ed44b3982f2a36024184fd0` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:22.991212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed6217-b1ab-4f87-bfcf-247dfadb46d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1627b28e7ed44b3982f2a36024184fd0)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:22.993206 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed6217-b1ab-4f87-bfcf-247dfadb46d7 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:23.035774 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-86f0dee0-6f60-43ca-b39f-127b36669697 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:23.037280 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-86f0dee0-6f60-43ca-b39f-127b36669697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:23.072524 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 863/1694] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:23.072524 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0dee0-6f60-43ca-b39f-127b36669697 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:23.104111 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-03ed6217-b1ab-4f87-bfcf-247dfadb46d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1627b28e7ed44b3982f2a36024184fd0'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:23.104912 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-03ed6217-b1ab-4f87-bfcf-247dfadb46d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1627b28e7ed44b3982f2a36024184fd0'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:23.107520 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0dee0-6f60-43ca-b39f-127b36669697 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:23.124380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae3fe1-f095-490a-a5f9-f55a59033eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:23.127452 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae3fe1-f095-490a-a5f9-f55a59033eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:23.128061 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae3fe1-f095-490a-a5f9-f55a59033eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:23.128715 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae3fe1-f095-490a-a5f9-f55a59033eb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:23.133421 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae3fe1-f095-490a-a5f9-f55a59033eb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:23.133958 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae3fe1-f095-490a-a5f9-f55a59033eb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:23.135942 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae3fe1-f095-490a-a5f9-f55a59033eb9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:23.146161 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-03ed6217-b1ab-4f87-bfcf-247dfadb46d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1627b28e7ed44b3982f2a36024184fd0'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:23.163882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-03ed6217-b1ab-4f87-bfcf-247dfadb46d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1627b28e7ed44b3982f2a36024184fd0'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:23.166956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-03ed6217-b1ab-4f87-bfcf-247dfadb46d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1627b28e7ed44b3982f2a36024184fd0'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:23.179926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 864/1695] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:23.179926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae3fe1-f095-490a-a5f9-f55a59033eb9 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:23.185640 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-50ae3fe1-f095-490a-a5f9-f55a59033eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:23.208517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 832/1696] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:22 2022] DELETE /identity/v3/users/1627b28e7ed44b3982f2a36024184fd0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:23.210506 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff50318-593f-4d6c-8f97-ee9e7763cb43 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:23.210506 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff50318-593f-4d6c-8f97-ee9e7763cb43 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:23.211944 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff50318-593f-4d6c-8f97-ee9e7763cb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:23.228246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae3fe1-f095-490a-a5f9-f55a59033eb9 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:23.267453 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-fff50318-593f-4d6c-8f97-ee9e7763cb43 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:23.268910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-fff50318-593f-4d6c-8f97-ee9e7763cb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:23.293583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:23.401967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa704ef-639a-483b-aa3f-8702a55fcbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:23.402665 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa704ef-639a-483b-aa3f-8702a55fcbe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:23.404892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa704ef-639a-483b-aa3f-8702a55fcbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:23.405330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa704ef-639a-483b-aa3f-8702a55fcbe2 admin admin] PATH_INFO: `/v3/projects/0c8bb7b580c44ea1aa094024749d0872/users/dbb19dab63d14bf191117ab9942004bb/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:23.442991 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa704ef-639a-483b-aa3f-8702a55fcbe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c8bb7b580c44ea1aa094024749d0872, user_id=dbb19dab63d14bf191117ab9942004bb, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:23.448052 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa704ef-639a-483b-aa3f-8702a55fcbe2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:23.464668 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 833/1697] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:23.466574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff50318-593f-4d6c-8f97-ee9e7763cb43 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:23.468851 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-fff50318-593f-4d6c-8f97-ee9e7763cb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:23.483058 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 865/1698] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:23 2022] PUT /identity/v3/projects/0c8bb7b580c44ea1aa094024749d0872/users/dbb19dab63d14bf191117ab9942004bb/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:23.486799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa704ef-639a-483b-aa3f-8702a55fcbe2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:23.499184 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff50318-593f-4d6c-8f97-ee9e7763cb43 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:23.630701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:23.634844 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2d974-cf2f-4f49-8890-c601250b05d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:23.636088 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2d974-cf2f-4f49-8890-c601250b05d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:23.636394 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2d974-cf2f-4f49-8890-c601250b05d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:23.637779 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2d974-cf2f-4f49-8890-c601250b05d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:23.640443 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2d974-cf2f-4f49-8890-c601250b05d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:23.644806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2d974-cf2f-4f49-8890-c601250b05d3 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:23.692651 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa704ef-639a-483b-aa3f-8702a55fcbe2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:23.709501 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349af15-b12c-4981-b38b-c1f097b5fcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:23.710419 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349af15-b12c-4981-b38b-c1f097b5fcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:23.710845 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349af15-b12c-4981-b38b-c1f097b5fcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:23.711246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2349af15-b12c-4981-b38b-c1f097b5fcf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:23.712089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349af15-b12c-4981-b38b-c1f097b5fcf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:23.712598 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349af15-b12c-4981-b38b-c1f097b5fcf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:23.714380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2349af15-b12c-4981-b38b-c1f097b5fcf7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:23.722834 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 834/1699] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:23 2022] POST /identity/v3/projects => generated 365 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:23.724363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2d974-cf2f-4f49-8890-c601250b05d3 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:23.764261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 866/1700] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:23.765452 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349af15-b12c-4981-b38b-c1f097b5fcf7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:23.803187 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2349af15-b12c-4981-b38b-c1f097b5fcf7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:23.914950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2d974-cf2f-4f49-8890-c601250b05d3 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:23.925184 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dcc3d-dbd7-4b18-8461-91f88e78d492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:23.925820 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dcc3d-dbd7-4b18-8461-91f88e78d492 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:23.927172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dcc3d-dbd7-4b18-8461-91f88e78d492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:23.927172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0dcc3d-dbd7-4b18-8461-91f88e78d492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:23.927597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dcc3d-dbd7-4b18-8461-91f88e78d492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:23.929272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0dcc3d-dbd7-4b18-8461-91f88e78d492 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:23.942227 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 835/1701] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:23.943170 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dcc3d-dbd7-4b18-8461-91f88e78d492 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:23.966752 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0dcc3d-dbd7-4b18-8461-91f88e78d492 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:23.970108 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437450f-56c4-4957-9803-6c0558f0ca0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:23.970108 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437450f-56c4-4957-9803-6c0558f0ca0e admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:23.970108 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437450f-56c4-4957-9803-6c0558f0ca0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:23.970807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437450f-56c4-4957-9803-6c0558f0ca0e admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:23.972659 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437450f-56c4-4957-9803-6c0558f0ca0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:23.976381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437450f-56c4-4957-9803-6c0558f0ca0e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:23.981439 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba316ce-c6a9-4041-8858-f8ceb3f553b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:23.982312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba316ce-c6a9-4041-8858-f8ceb3f553b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:23.982703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba316ce-c6a9-4041-8858-f8ceb3f553b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:23.983109 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba316ce-c6a9-4041-8858-f8ceb3f553b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:23.983997 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba316ce-c6a9-4041-8858-f8ceb3f553b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:23.988019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba316ce-c6a9-4041-8858-f8ceb3f553b1 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:24.030224 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 867/1702] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:23 2022] POST /identity/v3/users => generated 283 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:24.031848 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e259a81-bccc-4f69-b04e-0cf9fd127af9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:24.032276 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e259a81-bccc-4f69-b04e-0cf9fd127af9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:24.032980 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e259a81-bccc-4f69-b04e-0cf9fd127af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:24.049544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 836/1703] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:23 2022] POST /identity/v3/projects => generated 403 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:24.053775 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9d300-3c87-4404-a7e0-197e9dc4805a None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:24.054130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9d300-3c87-4404-a7e0-197e9dc4805a None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:24.057660 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9d300-3c87-4404-a7e0-197e9dc4805a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:24.057783 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3e259a81-bccc-4f69-b04e-0cf9fd127af9 None None] MFA Rules not processed for user `324d0f6b637647a29580091f3a248cda`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:24.059008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3e259a81-bccc-4f69-b04e-0cf9fd127af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:24.137169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:24.141243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-4bb9d300-3c87-4404-a7e0-197e9dc4805a None None] MFA Rules not processed for user `4a52bffd247140b6892388500d398044`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:24.143540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4bb9d300-3c87-4404-a7e0-197e9dc4805a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:24.173737 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 868/1704] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:24.173737 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e259a81-bccc-4f69-b04e-0cf9fd127af9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:24.173737 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3e259a81-bccc-4f69-b04e-0cf9fd127af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:24.286546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 837/1705] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:24.287627 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9d300-3c87-4404-a7e0-197e9dc4805a None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:24.346049 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e259a81-bccc-4f69-b04e-0cf9fd127af9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:24.355831 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19e92d-50fd-4050-b7da-9cd4678acf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:24.356671 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19e92d-50fd-4050-b7da-9cd4678acf25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:24.356953 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19e92d-50fd-4050-b7da-9cd4678acf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:24.357230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19e92d-50fd-4050-b7da-9cd4678acf25 admin admin] PATH_INFO: `/v3/users/4f0a3d117fe14c47bc79306e634c9228` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:24.369689 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19e92d-50fd-4050-b7da-9cd4678acf25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f0a3d117fe14c47bc79306e634c9228)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:24.373889 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed19e92d-50fd-4050-b7da-9cd4678acf25 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:24.381809 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:24.467288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9d300-3c87-4404-a7e0-197e9dc4805a None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:24.472591 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be680685-d020-42dd-884d-a1b05ab83111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:24.473478 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be680685-d020-42dd-884d-a1b05ab83111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:24.473857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be680685-d020-42dd-884d-a1b05ab83111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:24.474178 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be680685-d020-42dd-884d-a1b05ab83111 admin admin] PATH_INFO: `/v3/projects/0c8bb7b580c44ea1aa094024749d0872/users/dbb19dab63d14bf191117ab9942004bb/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:24.475870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ed19e92d-50fd-4050-b7da-9cd4678acf25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f0a3d117fe14c47bc79306e634c9228'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:24.476640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be680685-d020-42dd-884d-a1b05ab83111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c8bb7b580c44ea1aa094024749d0872, user_id=dbb19dab63d14bf191117ab9942004bb, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:24.478705 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ed19e92d-50fd-4050-b7da-9cd4678acf25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f0a3d117fe14c47bc79306e634c9228'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:24.479522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be680685-d020-42dd-884d-a1b05ab83111 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:24.494242 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 838/1706] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:24 2022] PUT /identity/v3/projects/0c8bb7b580c44ea1aa094024749d0872/users/dbb19dab63d14bf191117ab9942004bb/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:24.494443 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ed19e92d-50fd-4050-b7da-9cd4678acf25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f0a3d117fe14c47bc79306e634c9228'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:24.495281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be680685-d020-42dd-884d-a1b05ab83111 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:24.509795 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ed19e92d-50fd-4050-b7da-9cd4678acf25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f0a3d117fe14c47bc79306e634c9228'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:24.523008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ed19e92d-50fd-4050-b7da-9cd4678acf25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f0a3d117fe14c47bc79306e634c9228'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:24.531008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 869/1707] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:24 2022] DELETE /identity/v3/users/4f0a3d117fe14c47bc79306e634c9228 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:24.532108 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19e92d-50fd-4050-b7da-9cd4678acf25 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:24.534394 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ed19e92d-50fd-4050-b7da-9cd4678acf25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:24.632026 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be680685-d020-42dd-884d-a1b05ab83111 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:24.721985 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19e92d-50fd-4050-b7da-9cd4678acf25 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:24.728244 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66d433-5b12-4b02-a793-218c1574c328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:24.729878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66d433-5b12-4b02-a793-218c1574c328 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:24.730183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66d433-5b12-4b02-a793-218c1574c328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:24.730465 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66d433-5b12-4b02-a793-218c1574c328 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:24.731305 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:24.732326 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66d433-5b12-4b02-a793-218c1574c328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:24.737425 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66d433-5b12-4b02-a793-218c1574c328 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:24.764347 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4fb02-8402-4085-9503-b6991bece09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:24.765262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4fb02-8402-4085-9503-b6991bece09d admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:24.765658 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4fb02-8402-4085-9503-b6991bece09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:24.766041 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4fb02-8402-4085-9503-b6991bece09d admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:24.766884 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4fb02-8402-4085-9503-b6991bece09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:24.767740 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 870/1708] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:24 2022] POST /identity/v3/users => generated 302 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:24.769080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66d433-5b12-4b02-a793-218c1574c328 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:24.774200 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4fb02-8402-4085-9503-b6991bece09d admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:24.774365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ee66d433-5b12-4b02-a793-218c1574c328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:24.792780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66d433-5b12-4b02-a793-218c1574c328 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:24.798773 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6925f43-9d62-482e-825c-4d7e88006eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:24.799438 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6925f43-9d62-482e-825c-4d7e88006eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:24.799715 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6925f43-9d62-482e-825c-4d7e88006eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:24.799984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6925f43-9d62-482e-825c-4d7e88006eac admin admin] PATH_INFO: `/v3/projects/af60ad8fc2974c16976c5e5ae468dcd1` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:24.802333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6925f43-9d62-482e-825c-4d7e88006eac admin admin] RBAC: Authorizing `identity:delete_project(project_id=af60ad8fc2974c16976c5e5ae468dcd1)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:24.806974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6925f43-9d62-482e-825c-4d7e88006eac admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:24.807379 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 839/1709] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:24.808834 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413506-af57-415d-b23d-527036e5891f None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:24.809130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413506-af57-415d-b23d-527036e5891f None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:24.809414 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413506-af57-415d-b23d-527036e5891f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:24.845914 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-2f413506-af57-415d-b23d-527036e5891f None None] MFA Rules not processed for user `4a52bffd247140b6892388500d398044`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:24.851457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2f413506-af57-415d-b23d-527036e5891f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:24.870790 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c6925f43-9d62-482e-825c-4d7e88006eac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af60ad8fc2974c16976c5e5ae468dcd1', 'request_id': 'req-c6925f43-9d62-482e-825c-4d7e88006eac'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:24.882399 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c6925f43-9d62-482e-825c-4d7e88006eac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af60ad8fc2974c16976c5e5ae468dcd1', 'request_id': 'req-c6925f43-9d62-482e-825c-4d7e88006eac'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:24.890161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c6925f43-9d62-482e-825c-4d7e88006eac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af60ad8fc2974c16976c5e5ae468dcd1', 'request_id': 'req-c6925f43-9d62-482e-825c-4d7e88006eac'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:24.905301 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=78,keystone:DELETE=17,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:24.914477 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c6925f43-9d62-482e-825c-4d7e88006eac admin admin] The token cache is being invalidate because project af60ad8fc2974c16976c5e5ae468dcd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:24.915835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c6925f43-9d62-482e-825c-4d7e88006eac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:24.916684 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c6925f43-9d62-482e-825c-4d7e88006eac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:24.918985 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 871/1710] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:24 2022] DELETE /identity/v3/projects/af60ad8fc2974c16976c5e5ae468dcd1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:24.921784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd24c96-87e0-4ff2-bffb-a7c79286f872 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:24.922297 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd24c96-87e0-4ff2-bffb-a7c79286f872 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:24.922629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd24c96-87e0-4ff2-bffb-a7c79286f872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:24.958528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2fd24c96-87e0-4ff2-bffb-a7c79286f872 None None] MFA Rules not processed for user `dbb19dab63d14bf191117ab9942004bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:24.958923 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 840/1711] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:24.959753 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2fd24c96-87e0-4ff2-bffb-a7c79286f872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:24.960230 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f30228-9b33-45f6-9c85-8517e5162c1e None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:24.960536 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f30228-9b33-45f6-9c85-8517e5162c1e None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:24.961055 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f30228-9b33-45f6-9c85-8517e5162c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:24.983759 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-70f30228-9b33-45f6-9c85-8517e5162c1e None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:24.985273 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-70f30228-9b33-45f6-9c85-8517e5162c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:25.058403 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 872/1712] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:25.060225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd24c96-87e0-4ff2-bffb-a7c79286f872 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:25.061796 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2fd24c96-87e0-4ff2-bffb-a7c79286f872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:25.078504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 841/1713] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:25.078638 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f30228-9b33-45f6-9c85-8517e5162c1e None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:25.079879 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-70f30228-9b33-45f6-9c85-8517e5162c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:25.100714 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f30228-9b33-45f6-9c85-8517e5162c1e None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:25.107022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf178db-c513-41f3-aa51-e3dd17f7f561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:25.108514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf178db-c513-41f3-aa51-e3dd17f7f561 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:25.108780 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf178db-c513-41f3-aa51-e3dd17f7f561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:25.109554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf178db-c513-41f3-aa51-e3dd17f7f561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:25.110558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf178db-c513-41f3-aa51-e3dd17f7f561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:25.112814 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf178db-c513-41f3-aa51-e3dd17f7f561 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:25.133427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 842/1714] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:25.133427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25e778-94f7-4ccb-8b04-488969b49064 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:25.133427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25e778-94f7-4ccb-8b04-488969b49064 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:25.133427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25e778-94f7-4ccb-8b04-488969b49064 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:25.134264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 843/1715] 10.222.0.85 () {54 vars in 912 bytes} [Tue Aug 2 10:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:11:25.135408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3301e-67ff-4dcd-b4e6-2287a4747dc8 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:25.135692 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3301e-67ff-4dcd-b4e6-2287a4747dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:25.136040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3301e-67ff-4dcd-b4e6-2287a4747dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:25.151510 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd24c96-87e0-4ff2-bffb-a7c79286f872 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:25.156664 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-a2b3301e-67ff-4dcd-b4e6-2287a4747dc8 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:25.157447 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b65db8-ea2a-439b-b37d-90fdb8e9ed13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:25.157922 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a2b3301e-67ff-4dcd-b4e6-2287a4747dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:25.158295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b65db8-ea2a-439b-b37d-90fdb8e9ed13 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:25.158670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b65db8-ea2a-439b-b37d-90fdb8e9ed13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:25.159025 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b65db8-ea2a-439b-b37d-90fdb8e9ed13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:25.161164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b65db8-ea2a-439b-b37d-90fdb8e9ed13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:25.162672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b65db8-ea2a-439b-b37d-90fdb8e9ed13 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:25.167241 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 844/1716] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:25.175286 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3301e-67ff-4dcd-b4e6-2287a4747dc8 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:25.179357 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a2b3301e-67ff-4dcd-b4e6-2287a4747dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:25.183879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 873/1717] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:25.184952 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b65db8-ea2a-439b-b37d-90fdb8e9ed13 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:25.188891 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-82b65db8-ea2a-439b-b37d-90fdb8e9ed13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:25.266719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b65db8-ea2a-439b-b37d-90fdb8e9ed13 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:25.271808 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd3738-e4cf-4238-9c03-f9ac0a1be286 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:25.272442 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd3738-e4cf-4238-9c03-f9ac0a1be286 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:25.272752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd3738-e4cf-4238-9c03-f9ac0a1be286 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:25.273037 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fd3738-e4cf-4238-9c03-f9ac0a1be286 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:25.279920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3301e-67ff-4dcd-b4e6-2287a4747dc8 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:25.286387 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d775f8-5f39-409f-9d86-04ad742f1924 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:25.287051 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d775f8-5f39-409f-9d86-04ad742f1924 service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:25.287336 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d775f8-5f39-409f-9d86-04ad742f1924 service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:25.287428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd3738-e4cf-4238-9c03-f9ac0a1be286 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:25.288074 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d775f8-5f39-409f-9d86-04ad742f1924 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:25.288838 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fd3738-e4cf-4238-9c03-f9ac0a1be286 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:25.289922 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-73d775f8-5f39-409f-9d86-04ad742f1924 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:25.298070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:25.304187 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d775f8-5f39-409f-9d86-04ad742f1924 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:25.306140 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d775f8-5f39-409f-9d86-04ad742f1924 service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:25.307863 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 874/1718] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:25.308978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd3738-e4cf-4238-9c03-f9ac0a1be286 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:25.310305 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f6fd3738-e4cf-4238-9c03-f9ac0a1be286 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:25.318598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 845/1719] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:25.319782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d775f8-5f39-409f-9d86-04ad742f1924 service nova] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:25.331283 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d775f8-5f39-409f-9d86-04ad742f1924 service nova] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:25.337028 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec91f9-0cec-4565-a6bc-d89e15eb4d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:25.338576 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec91f9-0cec-4565-a6bc-d89e15eb4d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:25.339182 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec91f9-0cec-4565-a6bc-d89e15eb4d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:25.339630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec91f9-0cec-4565-a6bc-d89e15eb4d4c admin admin] PATH_INFO: `/v3/projects/57262eec517f4f4591ffffc269495a3d/users/1dbd3b9a7d2243568bf432a755ce5e5f/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:25.343981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:25.381475 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec91f9-0cec-4565-a6bc-d89e15eb4d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=57262eec517f4f4591ffffc269495a3d, user_id=1dbd3b9a7d2243568bf432a755ce5e5f, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:25.381475 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec91f9-0cec-4565-a6bc-d89e15eb4d4c admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:25.401642 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fd3738-e4cf-4238-9c03-f9ac0a1be286 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:25.407264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89567e-ddca-416c-b083-81b014f82760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:25.408265 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89567e-ddca-416c-b083-81b014f82760 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:25.408695 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89567e-ddca-416c-b083-81b014f82760 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:25.408983 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89567e-ddca-416c-b083-81b014f82760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:25.417931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 846/1720] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:25 2022] PUT /identity/v3/projects/57262eec517f4f4591ffffc269495a3d/users/1dbd3b9a7d2243568bf432a755ce5e5f/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:25.421093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c777c5f-565b-43f3-a02c-cd617db27c4b None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:25.421381 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c777c5f-565b-43f3-a02c-cd617db27c4b None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:25.421652 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c777c5f-565b-43f3-a02c-cd617db27c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:25.441640 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89567e-ddca-416c-b083-81b014f82760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:25.444144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89567e-ddca-416c-b083-81b014f82760 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:25.464695 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 875/1721] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:25.466300 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a6e37-1304-4011-bdae-8b3dca4a835a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:25.466606 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a6e37-1304-4011-bdae-8b3dca4a835a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:25.467506 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a6e37-1304-4011-bdae-8b3dca4a835a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:25.492238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-128a6e37-1304-4011-bdae-8b3dca4a835a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:25.493739 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-128a6e37-1304-4011-bdae-8b3dca4a835a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:25.530044 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-4c777c5f-565b-43f3-a02c-cd617db27c4b None None] MFA Rules not processed for user `828eb58cdce44ca8827f1ce2be7c19d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:25.531925 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4c777c5f-565b-43f3-a02c-cd617db27c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:25.640552 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 876/1722] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:25.643445 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a6e37-1304-4011-bdae-8b3dca4a835a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:25.668107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a6e37-1304-4011-bdae-8b3dca4a835a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:25.679770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 847/1723] 10.222.0.85 () {58 vars in 1009 bytes} [Tue Aug 2 10:11:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:25.681406 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc2414-b9e9-4c2c-81d5-89ebf39546b1 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:25.681894 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc2414-b9e9-4c2c-81d5-89ebf39546b1 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:25.682364 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc2414-b9e9-4c2c-81d5-89ebf39546b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:25.689148 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0cd82-d85e-49cf-bfa9-72081679ec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:25.689802 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0cd82-d85e-49cf-bfa9-72081679ec21 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:25.690081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0cd82-d85e-49cf-bfa9-72081679ec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:25.690352 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0cd82-d85e-49cf-bfa9-72081679ec21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:25.691056 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0cd82-d85e-49cf-bfa9-72081679ec21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:25.693349 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0cd82-d85e-49cf-bfa9-72081679ec21 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:25.725594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 877/1724] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:25.728187 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0cd82-d85e-49cf-bfa9-72081679ec21 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:25.780284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-58cc2414-b9e9-4c2c-81d5-89ebf39546b1 None None] MFA Rules not processed for user `1dbd3b9a7d2243568bf432a755ce5e5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:25.784995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-58cc2414-b9e9-4c2c-81d5-89ebf39546b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:25.904230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0cd82-d85e-49cf-bfa9-72081679ec21 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:25.909407 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a9554-a372-44b7-bca0-ba7d0a80ee9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:25.910044 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a9554-a372-44b7-bca0-ba7d0a80ee9e service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:25.910902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a9554-a372-44b7-bca0-ba7d0a80ee9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:25.911647 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a9554-a372-44b7-bca0-ba7d0a80ee9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:25.914003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-688a9554-a372-44b7-bca0-ba7d0a80ee9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:25.950520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 848/1725] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:25.951942 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc2414-b9e9-4c2c-81d5-89ebf39546b1 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:25.978763 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc2414-b9e9-4c2c-81d5-89ebf39546b1 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:25.990956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1d0b2-e78e-465f-a1b4-57e7205a6171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:25.991740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1d0b2-e78e-465f-a1b4-57e7205a6171 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:25.992022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1d0b2-e78e-465f-a1b4-57e7205a6171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:25.992297 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1d0b2-e78e-465f-a1b4-57e7205a6171 admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:25.993037 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1d0b2-e78e-465f-a1b4-57e7205a6171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:25.993343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1d0b2-e78e-465f-a1b4-57e7205a6171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:25.994970 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1d0b2-e78e-465f-a1b4-57e7205a6171 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:26.035527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 849/1726] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:26.036438 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1d0b2-e78e-465f-a1b4-57e7205a6171 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:26.048125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1d0b2-e78e-465f-a1b4-57e7205a6171 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:26.055329 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8833249-de90-4a2b-8cff-826b7e729e46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:26.058838 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8833249-de90-4a2b-8cff-826b7e729e46 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:26.059182 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8833249-de90-4a2b-8cff-826b7e729e46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:26.060969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8833249-de90-4a2b-8cff-826b7e729e46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:26.074915 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8833249-de90-4a2b-8cff-826b7e729e46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:26.076374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8833249-de90-4a2b-8cff-826b7e729e46 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:26.091111 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 850/1727] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:26.091766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8833249-de90-4a2b-8cff-826b7e729e46 service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:26.094604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a9554-a372-44b7-bca0-ba7d0a80ee9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:26.096092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a9554-a372-44b7-bca0-ba7d0a80ee9e service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:26.116895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8833249-de90-4a2b-8cff-826b7e729e46 service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:26.122078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe6880-df0e-433c-875a-18228c888267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:26.123016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe6880-df0e-433c-875a-18228c888267 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:26.123435 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe6880-df0e-433c-875a-18228c888267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:26.123845 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe6880-df0e-433c-875a-18228c888267 admin admin] PATH_INFO: `/v3/projects/d7b4fa92e8234603a3240114699905d8/users/803ec6cf30804b59b0d48ce84ee0282b/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:26.129866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 878/1728] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:26.138339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a9554-a372-44b7-bca0-ba7d0a80ee9e service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:26.142770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe6880-df0e-433c-875a-18228c888267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7b4fa92e8234603a3240114699905d8, user_id=803ec6cf30804b59b0d48ce84ee0282b, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:26.144360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-688a9554-a372-44b7-bca0-ba7d0a80ee9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:26.146573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe6880-df0e-433c-875a-18228c888267 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:26.168940 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 851/1729] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:26 2022] PUT /identity/v3/projects/d7b4fa92e8234603a3240114699905d8/users/803ec6cf30804b59b0d48ce84ee0282b/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:26.168940 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe6880-df0e-433c-875a-18228c888267 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:26.169968 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a9554-a372-44b7-bca0-ba7d0a80ee9e service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:26.177546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:26.183111 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:26.307262 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589254b-feb7-460a-b31d-7eb19529c308 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:26.308184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589254b-feb7-460a-b31d-7eb19529c308 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:26.308680 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589254b-feb7-460a-b31d-7eb19529c308 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:26.309137 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589254b-feb7-460a-b31d-7eb19529c308 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:26.345410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe6880-df0e-433c-875a-18228c888267 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:26.365076 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ad6317-4045-4fe7-b832-a31643ac31c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:26.366539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad6317-4045-4fe7-b832-a31643ac31c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:26.366838 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad6317-4045-4fe7-b832-a31643ac31c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:26.368130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ad6317-4045-4fe7-b832-a31643ac31c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:26.368976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad6317-4045-4fe7-b832-a31643ac31c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:26.373562 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ad6317-4045-4fe7-b832-a31643ac31c7 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:26.439207 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 852/1730] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:26 2022] POST /identity/v3/projects => generated 385 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:26.443159 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81d937-a479-4972-9fa9-ecc1fcff9b92 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:26.443650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81d937-a479-4972-9fa9-ecc1fcff9b92 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:26.444203 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81d937-a479-4972-9fa9-ecc1fcff9b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:26.461947 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589254b-feb7-460a-b31d-7eb19529c308 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:26.465598 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589254b-feb7-460a-b31d-7eb19529c308 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:26.493733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-2b81d937-a479-4972-9fa9-ecc1fcff9b92 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:26.495153 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2b81d937-a479-4972-9fa9-ecc1fcff9b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:26.510458 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 879/1731] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:26.512118 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589254b-feb7-460a-b31d-7eb19529c308 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:26.517983 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8589254b-feb7-460a-b31d-7eb19529c308 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:26.584233 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 853/1732] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:26.585782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c41bb3-86e6-4806-9f69-6188d3c06865 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:26.586872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c41bb3-86e6-4806-9f69-6188d3c06865 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:26.587276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c41bb3-86e6-4806-9f69-6188d3c06865 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:26.591690 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 854/1733] 10.222.0.85 () {54 vars in 912 bytes} [Tue Aug 2 10:11:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:11:26.592648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c41bb3-86e6-4806-9f69-6188d3c06865 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:26.596092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589254b-feb7-460a-b31d-7eb19529c308 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:26.614483 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c41bb3-86e6-4806-9f69-6188d3c06865 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:26.617427 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f35ce-bdda-48b0-baad-ddf0fe34c224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:26.618210 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f35ce-bdda-48b0-baad-ddf0fe34c224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:26.618493 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f35ce-bdda-48b0-baad-ddf0fe34c224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:26.618916 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f35ce-bdda-48b0-baad-ddf0fe34c224 admin admin] PATH_INFO: `/v3/projects/16f86229b59e440986f3b0b843cce356` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:26.620775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f35ce-bdda-48b0-baad-ddf0fe34c224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16f86229b59e440986f3b0b843cce356)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:26.621406 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96013a-c6a1-43b2-951c-10d510f5380f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:26.622440 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96013a-c6a1-43b2-951c-10d510f5380f admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:26.622730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f35ce-bdda-48b0-baad-ddf0fe34c224 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:26.623294 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96013a-c6a1-43b2-951c-10d510f5380f admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:26.624052 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96013a-c6a1-43b2-951c-10d510f5380f admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:26.625180 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96013a-c6a1-43b2-951c-10d510f5380f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:26.627746 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96013a-c6a1-43b2-951c-10d510f5380f admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:26.673412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 855/1734] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:26 2022] POST /identity/v3/users => generated 293 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:26.675125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96013a-c6a1-43b2-951c-10d510f5380f admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:26.680016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-9d96013a-c6a1-43b2-951c-10d510f5380f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:26.753469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9c5f35ce-bdda-48b0-baad-ddf0fe34c224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16f86229b59e440986f3b0b843cce356', 'request_id': 'req-9c5f35ce-bdda-48b0-baad-ddf0fe34c224'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:26.765695 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9c5f35ce-bdda-48b0-baad-ddf0fe34c224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16f86229b59e440986f3b0b843cce356', 'request_id': 'req-9c5f35ce-bdda-48b0-baad-ddf0fe34c224'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:26.777965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9c5f35ce-bdda-48b0-baad-ddf0fe34c224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16f86229b59e440986f3b0b843cce356', 'request_id': 'req-9c5f35ce-bdda-48b0-baad-ddf0fe34c224'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:26.813470 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9c5f35ce-bdda-48b0-baad-ddf0fe34c224 admin admin] The token cache is being invalidate because project 16f86229b59e440986f3b0b843cce356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:26.814540 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9c5f35ce-bdda-48b0-baad-ddf0fe34c224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:26.816985 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9c5f35ce-bdda-48b0-baad-ddf0fe34c224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:26.827626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 880/1735] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:26 2022] DELETE /identity/v3/projects/16f86229b59e440986f3b0b843cce356 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:26.831997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904556d-cf55-4190-8343-426272f9b1df None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:26.833259 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904556d-cf55-4190-8343-426272f9b1df None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:26.835200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904556d-cf55-4190-8343-426272f9b1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:26.849456 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96013a-c6a1-43b2-951c-10d510f5380f admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:26.888371 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0904556d-cf55-4190-8343-426272f9b1df None None] MFA Rules not processed for user `828eb58cdce44ca8827f1ce2be7c19d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:26.892183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0904556d-cf55-4190-8343-426272f9b1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:26.900912 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:26.980407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66535936-9e70-493e-8cba-119be61c3763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:26.982223 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66535936-9e70-493e-8cba-119be61c3763 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:26.984105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66535936-9e70-493e-8cba-119be61c3763 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:26.984566 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66535936-9e70-493e-8cba-119be61c3763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:26.990703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-66535936-9e70-493e-8cba-119be61c3763 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:27.017053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:27.043365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 881/1736] 10.222.0.85 () {58 vars in 1009 bytes} [Tue Aug 2 10:11:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:27.044286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904556d-cf55-4190-8343-426272f9b1df None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:27.046552 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0904556d-cf55-4190-8343-426272f9b1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:27.121267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66535936-9e70-493e-8cba-119be61c3763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:27.124025 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66535936-9e70-493e-8cba-119be61c3763 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:27.175349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 856/1737] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:27.196043 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66535936-9e70-493e-8cba-119be61c3763 service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:27.200835 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-66535936-9e70-493e-8cba-119be61c3763 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:27.271709 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66535936-9e70-493e-8cba-119be61c3763 service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:27.279126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904556d-cf55-4190-8343-426272f9b1df None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:27.292909 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb98c6a-3b1a-429c-8add-d4fd80b2f476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:27.293558 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb98c6a-3b1a-429c-8add-d4fd80b2f476 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:27.293843 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb98c6a-3b1a-429c-8add-d4fd80b2f476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:27.294118 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb98c6a-3b1a-429c-8add-d4fd80b2f476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:27.294834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb98c6a-3b1a-429c-8add-d4fd80b2f476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:27.296477 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb98c6a-3b1a-429c-8add-d4fd80b2f476 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:27.309976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80306bdd-32bb-454a-8afd-d8a41d4e9aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:27.311120 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80306bdd-32bb-454a-8afd-d8a41d4e9aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:27.311412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80306bdd-32bb-454a-8afd-d8a41d4e9aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:27.311691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80306bdd-32bb-454a-8afd-d8a41d4e9aa4 admin admin] PATH_INFO: `/v3/users/14d30305e5884fe8a67a535966a10ba8` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:27.315200 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80306bdd-32bb-454a-8afd-d8a41d4e9aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14d30305e5884fe8a67a535966a10ba8)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:27.319884 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80306bdd-32bb-454a-8afd-d8a41d4e9aa4 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:27.337426 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 882/1738] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:27.338615 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb98c6a-3b1a-429c-8add-d4fd80b2f476 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:27.342327 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6eb98c6a-3b1a-429c-8add-d4fd80b2f476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:27.369417 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb98c6a-3b1a-429c-8add-d4fd80b2f476 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:27.375573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7681a6-1595-4c0e-a621-84accf6029b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:27.376556 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7681a6-1595-4c0e-a621-84accf6029b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:27.376984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7681a6-1595-4c0e-a621-84accf6029b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:27.377701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7681a6-1595-4c0e-a621-84accf6029b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:27.394197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7681a6-1595-4c0e-a621-84accf6029b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:27.400630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7681a6-1595-4c0e-a621-84accf6029b4 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:27.405891 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-80306bdd-32bb-454a-8afd-d8a41d4e9aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14d30305e5884fe8a67a535966a10ba8'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:27.415926 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-80306bdd-32bb-454a-8afd-d8a41d4e9aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14d30305e5884fe8a67a535966a10ba8'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:27.416105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 883/1739] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:27.416105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc8fb3-ef34-4b1e-ab8e-30800a4deaf0 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:27.416105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc8fb3-ef34-4b1e-ab8e-30800a4deaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:27.416105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc8fb3-ef34-4b1e-ab8e-30800a4deaf0 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:27.424075 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 884/1740] 10.222.0.85 () {54 vars in 961 bytes} [Tue Aug 2 10:11:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:11:27.425027 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc8fb3-ef34-4b1e-ab8e-30800a4deaf0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:27.434380 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-80306bdd-32bb-454a-8afd-d8a41d4e9aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14d30305e5884fe8a67a535966a10ba8'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:27.451566 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-80306bdd-32bb-454a-8afd-d8a41d4e9aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14d30305e5884fe8a67a535966a10ba8'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:27.452080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc8fb3-ef34-4b1e-ab8e-30800a4deaf0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:27.452434 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-80306bdd-32bb-454a-8afd-d8a41d4e9aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14d30305e5884fe8a67a535966a10ba8'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:27.469622 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2d9a5-96f9-4df5-8731-3dfcc88aa901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:27.471280 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2d9a5-96f9-4df5-8731-3dfcc88aa901 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:27.471971 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2d9a5-96f9-4df5-8731-3dfcc88aa901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:27.472125 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2d9a5-96f9-4df5-8731-3dfcc88aa901 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:27.473298 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2d9a5-96f9-4df5-8731-3dfcc88aa901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:27.475948 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2d9a5-96f9-4df5-8731-3dfcc88aa901 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:27.483602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 857/1741] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:27 2022] DELETE /identity/v3/users/14d30305e5884fe8a67a535966a10ba8 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:27.486261 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb2ce7-2da7-49f9-880e-d82c3788ae64 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:27.486825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb2ce7-2da7-49f9-880e-d82c3788ae64 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:27.502656 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb2ce7-2da7-49f9-880e-d82c3788ae64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:27.554201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 885/1742] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:27.558067 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2d9a5-96f9-4df5-8731-3dfcc88aa901 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:27.559890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-13fb2ce7-2da7-49f9-880e-d82c3788ae64 None None] MFA Rules not processed for user `a2a420cc676e4f2bb2766826a1de3b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:27.563768 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-13fb2ce7-2da7-49f9-880e-d82c3788ae64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:27.575151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bae2d9a5-96f9-4df5-8731-3dfcc88aa901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:27.594859 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2d9a5-96f9-4df5-8731-3dfcc88aa901 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:27.707001 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7822f0-1fd2-4800-bb12-85bbfe29f85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:27.707787 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7822f0-1fd2-4800-bb12-85bbfe29f85f admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:27.708432 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7822f0-1fd2-4800-bb12-85bbfe29f85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:27.708826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7822f0-1fd2-4800-bb12-85bbfe29f85f admin admin] PATH_INFO: `/v3/projects/cc9b3f84408a4497b8c7ba21dceac8c9/users/e2650daa6208485bb5322d504695309a/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:27.717734 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:27.733771 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7822f0-1fd2-4800-bb12-85bbfe29f85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc9b3f84408a4497b8c7ba21dceac8c9, user_id=e2650daa6208485bb5322d504695309a, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:27.737905 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7822f0-1fd2-4800-bb12-85bbfe29f85f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:27.761377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 886/1743] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:27 2022] PUT /identity/v3/projects/cc9b3f84408a4497b8c7ba21dceac8c9/users/e2650daa6208485bb5322d504695309a/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:27.772949 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff888a8f-05dd-4b35-a4d4-a96995fa0226 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:27.773628 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff888a8f-05dd-4b35-a4d4-a96995fa0226 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:27.774106 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff888a8f-05dd-4b35-a4d4-a96995fa0226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:27.793760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 858/1744] 10.222.0.85 () {58 vars in 1058 bytes} [Tue Aug 2 10:11:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:27.806297 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb2ce7-2da7-49f9-880e-d82c3788ae64 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:27.849560 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb2ce7-2da7-49f9-880e-d82c3788ae64 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:27.900173 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ff888a8f-05dd-4b35-a4d4-a96995fa0226 None None] MFA Rules not processed for user `e2650daa6208485bb5322d504695309a`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:27.901699 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ff888a8f-05dd-4b35-a4d4-a96995fa0226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:28.062952 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:28.075399 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39716ef-0487-46ad-bbcf-5eb783f9cf1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2a420cc676e4f2bb2766826a1de3b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:28.076051 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39716ef-0487-46ad-bbcf-5eb783f9cf1c service placement] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:28.076338 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39716ef-0487-46ad-bbcf-5eb783f9cf1c service placement] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:28.076648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39716ef-0487-46ad-bbcf-5eb783f9cf1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:28.081131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e39716ef-0487-46ad-bbcf-5eb783f9cf1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:28.105626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 887/1745] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:28.107917 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39716ef-0487-46ad-bbcf-5eb783f9cf1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:28.109078 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff888a8f-05dd-4b35-a4d4-a96995fa0226 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:28.112629 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39716ef-0487-46ad-bbcf-5eb783f9cf1c service placement] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:28.129186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 859/1746] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:28.198569 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39716ef-0487-46ad-bbcf-5eb783f9cf1c service placement] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:28.200015 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e39716ef-0487-46ad-bbcf-5eb783f9cf1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:28.406417 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff888a8f-05dd-4b35-a4d4-a96995fa0226 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:28.431720 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451cb8a-ebad-49af-9dc0-3c1b742d6883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:28.434794 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451cb8a-ebad-49af-9dc0-3c1b742d6883 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:28.436282 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451cb8a-ebad-49af-9dc0-3c1b742d6883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:28.436282 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451cb8a-ebad-49af-9dc0-3c1b742d6883 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:28.437091 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451cb8a-ebad-49af-9dc0-3c1b742d6883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:28.439115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1451cb8a-ebad-49af-9dc0-3c1b742d6883 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:28.486893 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39716ef-0487-46ad-bbcf-5eb783f9cf1c service placement] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:28.503322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acfc50-1d25-4853-a124-b0dced845910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:28.504080 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acfc50-1d25-4853-a124-b0dced845910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:28.504827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acfc50-1d25-4853-a124-b0dced845910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:28.504827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acfc50-1d25-4853-a124-b0dced845910 admin admin] PATH_INFO: `/v3/projects/09b6e4c93e204e9cadec6ff605987e9e` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:28.509317 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acfc50-1d25-4853-a124-b0dced845910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b6e4c93e204e9cadec6ff605987e9e)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:28.517352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32acfc50-1d25-4853-a124-b0dced845910 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:28.536321 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 888/1747] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:28 2022] POST /identity/v3/projects => generated 387 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:11:28.537918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451cb8a-ebad-49af-9dc0-3c1b742d6883 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:28.651817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-32acfc50-1d25-4853-a124-b0dced845910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b6e4c93e204e9cadec6ff605987e9e', 'request_id': 'req-32acfc50-1d25-4853-a124-b0dced845910'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:28.674103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-32acfc50-1d25-4853-a124-b0dced845910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b6e4c93e204e9cadec6ff605987e9e', 'request_id': 'req-32acfc50-1d25-4853-a124-b0dced845910'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:28.687282 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-32acfc50-1d25-4853-a124-b0dced845910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b6e4c93e204e9cadec6ff605987e9e', 'request_id': 'req-32acfc50-1d25-4853-a124-b0dced845910'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:28.733194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451cb8a-ebad-49af-9dc0-3c1b742d6883 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:28.734920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-32acfc50-1d25-4853-a124-b0dced845910 admin admin] The token cache is being invalidate because project 09b6e4c93e204e9cadec6ff605987e9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:28.737176 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-32acfc50-1d25-4853-a124-b0dced845910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:28.738275 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-32acfc50-1d25-4853-a124-b0dced845910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:28.743967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 860/1748] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:28 2022] DELETE /identity/v3/projects/09b6e4c93e204e9cadec6ff605987e9e => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:11:28.748901 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b7242-cb65-4902-b610-efca2b22bc46 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:28.749602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b7242-cb65-4902-b610-efca2b22bc46 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:28.750107 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b7242-cb65-4902-b610-efca2b22bc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:28.793972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:28.808488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-2e4b7242-cb65-4902-b610-efca2b22bc46 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:28.816101 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2e4b7242-cb65-4902-b610-efca2b22bc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:29.002724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cead5-8343-4777-8244-e92f39017fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:29.004291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cead5-8343-4777-8244-e92f39017fcf admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:29.005056 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cead5-8343-4777-8244-e92f39017fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:29.005461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1cead5-8343-4777-8244-e92f39017fcf admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:29.008295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1cead5-8343-4777-8244-e92f39017fcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:29.008656 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 861/1749] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:29.012055 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a77a1-7cbc-45f9-ba9b-7de5f01678f0 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:29.012378 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a77a1-7cbc-45f9-ba9b-7de5f01678f0 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:29.013968 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a77a1-7cbc-45f9-ba9b-7de5f01678f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:29.018122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1cead5-8343-4777-8244-e92f39017fcf admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:29.065253 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-ab4a77a1-7cbc-45f9-ba9b-7de5f01678f0 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:29.066463 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ab4a77a1-7cbc-45f9-ba9b-7de5f01678f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:29.090816 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 862/1750] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:29.090936 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 889/1751] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:28 2022] POST /identity/v3/users => generated 300 bytes in 553 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:29.095472 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a77a1-7cbc-45f9-ba9b-7de5f01678f0 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:29.096284 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cead5-8343-4777-8244-e92f39017fcf admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:29.098386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ab4a77a1-7cbc-45f9-ba9b-7de5f01678f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:29.110281 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:29.127018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1cead5-8343-4777-8244-e92f39017fcf admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:29.130715 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a77a1-7cbc-45f9-ba9b-7de5f01678f0 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:29.141250 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91770b78-7469-45a4-9dcc-db27853d4e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:29.142053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91770b78-7469-45a4-9dcc-db27853d4e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:29.142442 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91770b78-7469-45a4-9dcc-db27853d4e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:29.142852 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91770b78-7469-45a4-9dcc-db27853d4e01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:29.143764 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91770b78-7469-45a4-9dcc-db27853d4e01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:29.143911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239de148-0718-495f-9779-121de605b686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:29.144164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91770b78-7469-45a4-9dcc-db27853d4e01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:29.146345 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239de148-0718-495f-9779-121de605b686 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:29.146710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239de148-0718-495f-9779-121de605b686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:29.146990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239de148-0718-495f-9779-121de605b686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:29.147945 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91770b78-7469-45a4-9dcc-db27853d4e01 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:29.148991 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239de148-0718-495f-9779-121de605b686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:29.154654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239de148-0718-495f-9779-121de605b686 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:29.182574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 863/1752] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:29.186319 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239de148-0718-495f-9779-121de605b686 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:29.189138 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 890/1753] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:29.194319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91770b78-7469-45a4-9dcc-db27853d4e01 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:29.208390 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239de148-0718-495f-9779-121de605b686 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:29.213798 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91770b78-7469-45a4-9dcc-db27853d4e01 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:29.220754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270291b-e5e9-4502-a1e2-41b050000297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:29.222121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270291b-e5e9-4502-a1e2-41b050000297 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:29.223976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270291b-e5e9-4502-a1e2-41b050000297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:29.224415 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9270291b-e5e9-4502-a1e2-41b050000297 admin admin] PATH_INFO: `/v3/projects/7c8537c1e4394719b130ff5d5557e26c/users/86b3f159314544a7a9c457252ba50206/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:29.225251 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580565c-8a0e-4b02-886a-0c314122a24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:29.227627 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580565c-8a0e-4b02-886a-0c314122a24b admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:29.229400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580565c-8a0e-4b02-886a-0c314122a24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:29.229738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580565c-8a0e-4b02-886a-0c314122a24b admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:29.230353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580565c-8a0e-4b02-886a-0c314122a24b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:29.233948 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580565c-8a0e-4b02-886a-0c314122a24b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:29.271008 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270291b-e5e9-4502-a1e2-41b050000297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c8537c1e4394719b130ff5d5557e26c, user_id=86b3f159314544a7a9c457252ba50206, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:29.284573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9270291b-e5e9-4502-a1e2-41b050000297 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:29.319434 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 891/1754] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:29 2022] POST /identity/v3/projects => generated 369 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:29.323423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580565c-8a0e-4b02-886a-0c314122a24b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:29.328748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 864/1755] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:29 2022] PUT /identity/v3/projects/7c8537c1e4394719b130ff5d5557e26c/users/86b3f159314544a7a9c457252ba50206/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:29.330792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270291b-e5e9-4502-a1e2-41b050000297 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:29.493430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580565c-8a0e-4b02-886a-0c314122a24b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:29.508194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee221e65-b9ab-4875-b1c5-89bb788face0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:29.525221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9270291b-e5e9-4502-a1e2-41b050000297 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:29.530568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e22137-5c6d-483f-9f79-bc39cba2d1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:29.531216 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e22137-5c6d-483f-9f79-bc39cba2d1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:29.531526 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e22137-5c6d-483f-9f79-bc39cba2d1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:29.531971 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e22137-5c6d-483f-9f79-bc39cba2d1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:29.532751 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e22137-5c6d-483f-9f79-bc39cba2d1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:29.534676 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e22137-5c6d-483f-9f79-bc39cba2d1a4 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:29.540708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee221e65-b9ab-4875-b1c5-89bb788face0 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:29.541007 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee221e65-b9ab-4875-b1c5-89bb788face0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:29.541338 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee221e65-b9ab-4875-b1c5-89bb788face0 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:29.544188 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee221e65-b9ab-4875-b1c5-89bb788face0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:29.548713 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 865/1756] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:29.548713 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e22137-5c6d-483f-9f79-bc39cba2d1a4 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:29.549173 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-c7e22137-5c6d-483f-9f79-bc39cba2d1a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:29.552571 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee221e65-b9ab-4875-b1c5-89bb788face0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:29.564762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e22137-5c6d-483f-9f79-bc39cba2d1a4 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:29.571883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2565c9-789d-4812-84bb-988421f05845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:29.572863 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2565c9-789d-4812-84bb-988421f05845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:29.573291 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2565c9-789d-4812-84bb-988421f05845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:29.573579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2565c9-789d-4812-84bb-988421f05845 admin admin] PATH_INFO: `/v3/users/c7d2d655923f4e21857e09a93b74c767` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:29.575006 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2565c9-789d-4812-84bb-988421f05845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7d2d655923f4e21857e09a93b74c767)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:29.577755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2565c9-789d-4812-84bb-988421f05845 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:29.642198 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 892/1757] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:29 2022] POST /identity/v3/users => generated 285 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:11:29.643538 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44107266-1600-4c0f-9865-621beea684fc None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:29.643911 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44107266-1600-4c0f-9865-621beea684fc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:29.644207 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44107266-1600-4c0f-9865-621beea684fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:29.715799 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-8d2565c9-789d-4812-84bb-988421f05845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7d2d655923f4e21857e09a93b74c767'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:29.716643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-8d2565c9-789d-4812-84bb-988421f05845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7d2d655923f4e21857e09a93b74c767'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:29.730508 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-44107266-1600-4c0f-9865-621beea684fc None None] MFA Rules not processed for user `803ec6cf30804b59b0d48ce84ee0282b`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:29.732074 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-44107266-1600-4c0f-9865-621beea684fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:29.745576 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:29.765233 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-8d2565c9-789d-4812-84bb-988421f05845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7d2d655923f4e21857e09a93b74c767'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:29.795368 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-8d2565c9-789d-4812-84bb-988421f05845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7d2d655923f4e21857e09a93b74c767'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:29.796222 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-8d2565c9-789d-4812-84bb-988421f05845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7d2d655923f4e21857e09a93b74c767'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:29.821102 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 866/1758] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:29 2022] DELETE /identity/v3/users/c7d2d655923f4e21857e09a93b74c767 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:29.822624 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2565c9-789d-4812-84bb-988421f05845 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:29.825298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-8d2565c9-789d-4812-84bb-988421f05845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:29.949850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 893/1759] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:29 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:29.951546 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44107266-1600-4c0f-9865-621beea684fc None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:29.961389 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-44107266-1600-4c0f-9865-621beea684fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:29.991225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2565c9-789d-4812-84bb-988421f05845 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:29.997245 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b2c42-3464-4b2f-a1b8-b1ee7368b12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:29.998445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b2c42-3464-4b2f-a1b8-b1ee7368b12e admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:29.998794 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b2c42-3464-4b2f-a1b8-b1ee7368b12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:30.014608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b2c42-3464-4b2f-a1b8-b1ee7368b12e admin admin] PATH_INFO: `/v3/projects/7c8537c1e4394719b130ff5d5557e26c/users/86b3f159314544a7a9c457252ba50206/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:30.021047 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b2c42-3464-4b2f-a1b8-b1ee7368b12e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c8537c1e4394719b130ff5d5557e26c, user_id=86b3f159314544a7a9c457252ba50206, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:30.026682 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44107266-1600-4c0f-9865-621beea684fc None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:30.030225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b2c42-3464-4b2f-a1b8-b1ee7368b12e admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:30.041392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc07b4-7e52-4ffe-97d9-9258b5f94688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:30.043201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc07b4-7e52-4ffe-97d9-9258b5f94688 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:30.043496 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc07b4-7e52-4ffe-97d9-9258b5f94688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:30.043778 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc07b4-7e52-4ffe-97d9-9258b5f94688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:30.047329 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc07b4-7e52-4ffe-97d9-9258b5f94688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:30.053766 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc07b4-7e52-4ffe-97d9-9258b5f94688 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:30.076659 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 867/1760] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:29 2022] PUT /identity/v3/projects/7c8537c1e4394719b130ff5d5557e26c/users/86b3f159314544a7a9c457252ba50206/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:30.079824 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f028da-9609-41b6-bc50-35bb9f18f2f9 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:30.081631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f028da-9609-41b6-bc50-35bb9f18f2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:30.083480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f028da-9609-41b6-bc50-35bb9f18f2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:30.103142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 894/1761] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:30.103142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc07b4-7e52-4ffe-97d9-9258b5f94688 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:30.119448 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-09fc07b4-7e52-4ffe-97d9-9258b5f94688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:30.138253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc07b4-7e52-4ffe-97d9-9258b5f94688 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:30.142873 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-35f028da-9609-41b6-bc50-35bb9f18f2f9 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:30.144505 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-35f028da-9609-41b6-bc50-35bb9f18f2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:30.233910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:30.250953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 868/1762] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:30.252384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3570b4-31ce-43f3-8864-89ed839d3fec None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:30.252801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3570b4-31ce-43f3-8864-89ed839d3fec None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:30.253526 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3570b4-31ce-43f3-8864-89ed839d3fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:30.330576 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537d2be-376f-4e18-b5f5-a5fc8730d23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:30.333160 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-3c3570b4-31ce-43f3-8864-89ed839d3fec None None] MFA Rules not processed for user `86b3f159314544a7a9c457252ba50206`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:30.334654 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537d2be-376f-4e18-b5f5-a5fc8730d23f admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:30.335150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-3c3570b4-31ce-43f3-8864-89ed839d3fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:30.337083 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537d2be-376f-4e18-b5f5-a5fc8730d23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:30.338116 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537d2be-376f-4e18-b5f5-a5fc8730d23f admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:30.338979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537d2be-376f-4e18-b5f5-a5fc8730d23f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:30.343750 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537d2be-376f-4e18-b5f5-a5fc8730d23f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:30.413491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:30.419476 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 895/1763] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:30 2022] POST /identity/v3/projects => generated 405 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:30.431229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 869/1764] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:30.432403 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3570b4-31ce-43f3-8864-89ed839d3fec None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:30.433264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537d2be-376f-4e18-b5f5-a5fc8730d23f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:30.434978 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-3c3570b4-31ce-43f3-8864-89ed839d3fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:30.578809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3570b4-31ce-43f3-8864-89ed839d3fec None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:30.600913 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537d2be-376f-4e18-b5f5-a5fc8730d23f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:30.605994 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9407f5a-a04d-45f4-b5e8-473a7a90254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:30.606781 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9407f5a-a04d-45f4-b5e8-473a7a90254a admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:30.607143 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9407f5a-a04d-45f4-b5e8-473a7a90254a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:30.607492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9407f5a-a04d-45f4-b5e8-473a7a90254a admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:30.608289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9407f5a-a04d-45f4-b5e8-473a7a90254a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:30.610448 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9407f5a-a04d-45f4-b5e8-473a7a90254a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:30.628706 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 896/1765] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:30.628706 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9407f5a-a04d-45f4-b5e8-473a7a90254a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:30.641715 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9407f5a-a04d-45f4-b5e8-473a7a90254a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:30.648236 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535bfdcb-f3a4-4fa8-9e1c-5b8a183ac6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:30.649436 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bfdcb-f3a4-4fa8-9e1c-5b8a183ac6a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:30.649900 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bfdcb-f3a4-4fa8-9e1c-5b8a183ac6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:30.650376 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bfdcb-f3a4-4fa8-9e1c-5b8a183ac6a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:30.652297 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535bfdcb-f3a4-4fa8-9e1c-5b8a183ac6a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:30.654573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535bfdcb-f3a4-4fa8-9e1c-5b8a183ac6a7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:30.656776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89113dd5-6fbc-49f3-8645-8b1f20633bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:30.657440 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89113dd5-6fbc-49f3-8645-8b1f20633bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:30.657726 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89113dd5-6fbc-49f3-8645-8b1f20633bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:30.658005 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89113dd5-6fbc-49f3-8645-8b1f20633bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:30.670156 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89113dd5-6fbc-49f3-8645-8b1f20633bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:30.672134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89113dd5-6fbc-49f3-8645-8b1f20633bc5 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:30.684107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 897/1766] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:30 2022] POST /identity/v3/users => generated 309 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:30.685330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535bfdcb-f3a4-4fa8-9e1c-5b8a183ac6a7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:30.687220 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-535bfdcb-f3a4-4fa8-9e1c-5b8a183ac6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:30.687672 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 870/1767] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:30.688398 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89113dd5-6fbc-49f3-8645-8b1f20633bc5 service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:30.700342 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89113dd5-6fbc-49f3-8645-8b1f20633bc5 service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:30.708221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecee638-3ba4-4bf1-9e14-d590416ad9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:30.709243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecee638-3ba4-4bf1-9e14-d590416ad9d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:30.709783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecee638-3ba4-4bf1-9e14-d590416ad9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:30.710117 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecee638-3ba4-4bf1-9e14-d590416ad9d5 admin admin] PATH_INFO: `/v3/projects/ff3fc87cc8b54861b25c5abea149cf14/users/f478be04e98140a79309ad4a310a0e34/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:30.739488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecee638-3ba4-4bf1-9e14-d590416ad9d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff3fc87cc8b54861b25c5abea149cf14, user_id=f478be04e98140a79309ad4a310a0e34, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:30.743709 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecee638-3ba4-4bf1-9e14-d590416ad9d5 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:30.765554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 871/1768] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:30 2022] PUT /identity/v3/projects/ff3fc87cc8b54861b25c5abea149cf14/users/f478be04e98140a79309ad4a310a0e34/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:30.769859 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecee638-3ba4-4bf1-9e14-d590416ad9d5 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:30.824742 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535bfdcb-f3a4-4fa8-9e1c-5b8a183ac6a7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:30.909175 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecee638-3ba4-4bf1-9e14-d590416ad9d5 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:30.916751 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba76cc-3811-41ef-8086-944673a5f944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:30.917647 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba76cc-3811-41ef-8086-944673a5f944 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:30.918133 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba76cc-3811-41ef-8086-944673a5f944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:30.918643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba76cc-3811-41ef-8086-944673a5f944 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:30.919573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba76cc-3811-41ef-8086-944673a5f944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:30.921731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba76cc-3811-41ef-8086-944673a5f944 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:30.937552 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 872/1769] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:30.939432 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeade2a-f0e1-461c-97d8-bafb6209594f None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:30.940147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeade2a-f0e1-461c-97d8-bafb6209594f None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:30.940664 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeade2a-f0e1-461c-97d8-bafb6209594f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:30.984052 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-cdeade2a-f0e1-461c-97d8-bafb6209594f None None] MFA Rules not processed for user `f478be04e98140a79309ad4a310a0e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:30.986096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-cdeade2a-f0e1-461c-97d8-bafb6209594f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:30.997875 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d16a7-3ecc-4e3b-862c-aa5d3f527e6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:30.999317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d16a7-3ecc-4e3b-862c-aa5d3f527e6e service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:31.000324 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d16a7-3ecc-4e3b-862c-aa5d3f527e6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:31.002172 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d16a7-3ecc-4e3b-862c-aa5d3f527e6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:31.006702 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:31.027190 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:31.119791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 873/1770] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:31.120834 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeade2a-f0e1-461c-97d8-bafb6209594f None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:31.151699 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d16a7-3ecc-4e3b-862c-aa5d3f527e6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:31.153716 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43d16a7-3ecc-4e3b-862c-aa5d3f527e6e service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:31.165184 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeade2a-f0e1-461c-97d8-bafb6209594f None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:31.175210 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f15097-939c-4b77-89e6-9f8242641645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:31.176896 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f15097-939c-4b77-89e6-9f8242641645 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:31.177428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f15097-939c-4b77-89e6-9f8242641645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:31.177813 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f15097-939c-4b77-89e6-9f8242641645 admin admin] PATH_INFO: `/v3/projects/c29c1587608c40108e7785e9150f4e46/users/30dc6521866a4e4e895c79b2c455d156/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:31.189509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 898/1771] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:31.191847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d16a7-3ecc-4e3b-862c-aa5d3f527e6e service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:31.230141 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f15097-939c-4b77-89e6-9f8242641645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29c1587608c40108e7785e9150f4e46, user_id=30dc6521866a4e4e895c79b2c455d156, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:31.238734 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43d16a7-3ecc-4e3b-862c-aa5d3f527e6e service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:31.240027 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f15097-939c-4b77-89e6-9f8242641645 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:31.266186 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc53a2-e756-448c-8bed-661a1a5b26e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:31.267076 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc53a2-e756-448c-8bed-661a1a5b26e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:31.267375 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc53a2-e756-448c-8bed-661a1a5b26e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:31.267656 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc53a2-e756-448c-8bed-661a1a5b26e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:31.268341 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc53a2-e756-448c-8bed-661a1a5b26e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:31.274953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 874/1772] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:31 2022] PUT /identity/v3/projects/c29c1587608c40108e7785e9150f4e46/users/30dc6521866a4e4e895c79b2c455d156/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:31.276060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f15097-939c-4b77-89e6-9f8242641645 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:31.278229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc53a2-e756-448c-8bed-661a1a5b26e9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:31.367899 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 899/1773] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:31 2022] POST /identity/v3/projects => generated 367 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:31.372849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc53a2-e756-448c-8bed-661a1a5b26e9 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:31.437390 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f15097-939c-4b77-89e6-9f8242641645 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:31.467521 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc53a2-e756-448c-8bed-661a1a5b26e9 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:31.478069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6224d5-a942-4a76-9c24-49abb044d29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:31.478709 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6224d5-a942-4a76-9c24-49abb044d29d admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:31.478992 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6224d5-a942-4a76-9c24-49abb044d29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:31.479557 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6224d5-a942-4a76-9c24-49abb044d29d admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:31.480090 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6224d5-a942-4a76-9c24-49abb044d29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:31.481846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6224d5-a942-4a76-9c24-49abb044d29d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:31.493446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 900/1774] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:31.494248 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6224d5-a942-4a76-9c24-49abb044d29d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:31.504324 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6224d5-a942-4a76-9c24-49abb044d29d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:31.509329 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728a782-d3c1-46b2-a480-f7e11d6d89dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:31.509922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728a782-d3c1-46b2-a480-f7e11d6d89dc admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:31.510204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728a782-d3c1-46b2-a480-f7e11d6d89dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:31.510482 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728a782-d3c1-46b2-a480-f7e11d6d89dc admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:31.511154 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728a782-d3c1-46b2-a480-f7e11d6d89dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:31.513163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728a782-d3c1-46b2-a480-f7e11d6d89dc admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:31.514982 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253a219-6e43-4536-a5af-b93e050ca813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:31.515622 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253a219-6e43-4536-a5af-b93e050ca813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:31.515973 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253a219-6e43-4536-a5af-b93e050ca813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:31.516313 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253a219-6e43-4536-a5af-b93e050ca813 admin admin] PATH_INFO: `/v3/users/e2650daa6208485bb5322d504695309a` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:31.517648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253a219-6e43-4536-a5af-b93e050ca813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2650daa6208485bb5322d504695309a)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:31.520575 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253a219-6e43-4536-a5af-b93e050ca813 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:31.544031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 901/1775] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:31 2022] POST /identity/v3/users => generated 290 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:31.545030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728a782-d3c1-46b2-a480-f7e11d6d89dc admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:31.550219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0728a782-d3c1-46b2-a480-f7e11d6d89dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:31.577596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728a782-d3c1-46b2-a480-f7e11d6d89dc admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:31.596658 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b9bea-88eb-4a8e-b7e3-35e909094934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:31.597332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b9bea-88eb-4a8e-b7e3-35e909094934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:31.597672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b9bea-88eb-4a8e-b7e3-35e909094934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:31.597957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b9bea-88eb-4a8e-b7e3-35e909094934 admin admin] PATH_INFO: `/v3/projects/2e88ed108d424f6fa410eee0ca7c5eff` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:31.602336 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:31.602977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b9bea-88eb-4a8e-b7e3-35e909094934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e88ed108d424f6fa410eee0ca7c5eff)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:31.610055 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b9bea-88eb-4a8e-b7e3-35e909094934 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:31.620057 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-4253a219-6e43-4536-a5af-b93e050ca813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2650daa6208485bb5322d504695309a'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:31.620835 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-4253a219-6e43-4536-a5af-b93e050ca813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2650daa6208485bb5322d504695309a'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:31.648935 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-4253a219-6e43-4536-a5af-b93e050ca813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2650daa6208485bb5322d504695309a'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:31.674955 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-4253a219-6e43-4536-a5af-b93e050ca813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2650daa6208485bb5322d504695309a'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:31.675704 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-4253a219-6e43-4536-a5af-b93e050ca813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2650daa6208485bb5322d504695309a'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:31.702672 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 875/1776] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:31 2022] DELETE /identity/v3/users/e2650daa6208485bb5322d504695309a => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:31.704848 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253a219-6e43-4536-a5af-b93e050ca813 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:31.710492 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4253a219-6e43-4536-a5af-b93e050ca813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:31.728751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-610b9bea-88eb-4a8e-b7e3-35e909094934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e88ed108d424f6fa410eee0ca7c5eff', 'request_id': 'req-610b9bea-88eb-4a8e-b7e3-35e909094934'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:31.744738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-610b9bea-88eb-4a8e-b7e3-35e909094934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e88ed108d424f6fa410eee0ca7c5eff', 'request_id': 'req-610b9bea-88eb-4a8e-b7e3-35e909094934'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:31.749103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:31.758469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-610b9bea-88eb-4a8e-b7e3-35e909094934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e88ed108d424f6fa410eee0ca7c5eff', 'request_id': 'req-610b9bea-88eb-4a8e-b7e3-35e909094934'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:31.801511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-610b9bea-88eb-4a8e-b7e3-35e909094934 admin admin] The token cache is being invalidate because project 2e88ed108d424f6fa410eee0ca7c5eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:31.804480 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-610b9bea-88eb-4a8e-b7e3-35e909094934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:31.806865 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-610b9bea-88eb-4a8e-b7e3-35e909094934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:31.817096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 902/1777] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:31 2022] DELETE /identity/v3/projects/2e88ed108d424f6fa410eee0ca7c5eff => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:31.818082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b9bea-88eb-4a8e-b7e3-35e909094934 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:31.827207 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-610b9bea-88eb-4a8e-b7e3-35e909094934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:31.846068 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253a219-6e43-4536-a5af-b93e050ca813 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:31.859460 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a80f60-6c1c-4587-8c84-e9ca18bfb9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:31.860809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a80f60-6c1c-4587-8c84-e9ca18bfb9b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:31.861237 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a80f60-6c1c-4587-8c84-e9ca18bfb9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:31.861684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a80f60-6c1c-4587-8c84-e9ca18bfb9b8 admin admin] PATH_INFO: `/v3/projects/c29c1587608c40108e7785e9150f4e46/users/30dc6521866a4e4e895c79b2c455d156/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:31.867241 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a80f60-6c1c-4587-8c84-e9ca18bfb9b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29c1587608c40108e7785e9150f4e46, user_id=30dc6521866a4e4e895c79b2c455d156, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:31.875274 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a80f60-6c1c-4587-8c84-e9ca18bfb9b8 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:31.901612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 876/1778] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:31 2022] PUT /identity/v3/projects/c29c1587608c40108e7785e9150f4e46/users/30dc6521866a4e4e895c79b2c455d156/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:31.904014 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd364741-7e4b-4d9d-8050-873e7610d334 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:31.904440 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd364741-7e4b-4d9d-8050-873e7610d334 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:31.905041 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd364741-7e4b-4d9d-8050-873e7610d334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:31.935820 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-bd364741-7e4b-4d9d-8050-873e7610d334 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:31.937816 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-bd364741-7e4b-4d9d-8050-873e7610d334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:31.981393 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b9bea-88eb-4a8e-b7e3-35e909094934 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:32.074932 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0927c-66cf-486f-964e-d9a251353b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:32.075672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0927c-66cf-486f-964e-d9a251353b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:32.076023 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0927c-66cf-486f-964e-d9a251353b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:32.076308 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0927c-66cf-486f-964e-d9a251353b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:32.077055 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0927c-66cf-486f-964e-d9a251353b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:32.079074 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0927c-66cf-486f-964e-d9a251353b5c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:32.080583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 877/1779] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:32.082044 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e3002-4c6d-4560-80a4-722ed51c5b93 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:32.082347 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e3002-4c6d-4560-80a4-722ed51c5b93 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:32.090797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e3002-4c6d-4560-80a4-722ed51c5b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:32.096334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 903/1780] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:32.101320 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0927c-66cf-486f-964e-d9a251353b5c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:32.103636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-21a0927c-66cf-486f-964e-d9a251353b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:32.130743 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0927c-66cf-486f-964e-d9a251353b5c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:32.139307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0896b98-d624-47da-b1f7-1b0b87e0680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:32.139988 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0896b98-d624-47da-b1f7-1b0b87e0680e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:32.146398 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0896b98-d624-47da-b1f7-1b0b87e0680e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:32.146398 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0896b98-d624-47da-b1f7-1b0b87e0680e admin admin] PATH_INFO: `/v3/users/dbb19dab63d14bf191117ab9942004bb` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:32.151008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0896b98-d624-47da-b1f7-1b0b87e0680e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbb19dab63d14bf191117ab9942004bb)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:32.155904 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0896b98-d624-47da-b1f7-1b0b87e0680e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:32.247857 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b0896b98-d624-47da-b1f7-1b0b87e0680e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbb19dab63d14bf191117ab9942004bb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:32.248112 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b0896b98-d624-47da-b1f7-1b0b87e0680e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbb19dab63d14bf191117ab9942004bb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:32.253268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-7a7e3002-4c6d-4560-80a4-722ed51c5b93 None None] MFA Rules not processed for user `f43a16e2dcab4872963222c557853d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:32.255612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7a7e3002-4c6d-4560-80a4-722ed51c5b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:32.257701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b0896b98-d624-47da-b1f7-1b0b87e0680e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbb19dab63d14bf191117ab9942004bb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:32.279364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b0896b98-d624-47da-b1f7-1b0b87e0680e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbb19dab63d14bf191117ab9942004bb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:32.304310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b0896b98-d624-47da-b1f7-1b0b87e0680e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbb19dab63d14bf191117ab9942004bb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:32.307226 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:32.314560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 904/1781] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:32 2022] DELETE /identity/v3/users/dbb19dab63d14bf191117ab9942004bb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:32.315900 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0896b98-d624-47da-b1f7-1b0b87e0680e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:32.323170 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b0896b98-d624-47da-b1f7-1b0b87e0680e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:32.327819 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:32.436299 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 878/1782] 10.222.0.85 () {58 vars in 1009 bytes} [Tue Aug 2 10:11:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:32.437528 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e3002-4c6d-4560-80a4-722ed51c5b93 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:32.439243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7a7e3002-4c6d-4560-80a4-722ed51c5b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:32.550565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0896b98-d624-47da-b1f7-1b0b87e0680e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:32.561190 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de24da-2109-43d8-864a-a945b055c7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:32.561877 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de24da-2109-43d8-864a-a945b055c7a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:32.562387 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de24da-2109-43d8-864a-a945b055c7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:32.562791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de24da-2109-43d8-864a-a945b055c7a5 admin admin] PATH_INFO: `/v3/projects/c6dd3178f6754abdb075a3935a65b278/users/7ae707c3dc5c4ca7a064f056d6295f74/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:32.583321 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de24da-2109-43d8-864a-a945b055c7a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6dd3178f6754abdb075a3935a65b278, user_id=7ae707c3dc5c4ca7a064f056d6295f74, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:32.586283 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de24da-2109-43d8-864a-a945b055c7a5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:32.593902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e3002-4c6d-4560-80a4-722ed51c5b93 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:32.609600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 905/1783] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:32 2022] PUT /identity/v3/projects/c6dd3178f6754abdb075a3935a65b278/users/7ae707c3dc5c4ca7a064f056d6295f74/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:32.612798 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de24da-2109-43d8-864a-a945b055c7a5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:32.690344 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c30ad6-abfe-4739-a424-75d705476919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:32.691129 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c30ad6-abfe-4739-a424-75d705476919 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:32.691483 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c30ad6-abfe-4739-a424-75d705476919 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:32.691912 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c30ad6-abfe-4739-a424-75d705476919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:32.694651 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f7c30ad6-abfe-4739-a424-75d705476919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:32.731667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c30ad6-abfe-4739-a424-75d705476919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:32.736856 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c30ad6-abfe-4739-a424-75d705476919 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:32.739493 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de24da-2109-43d8-864a-a945b055c7a5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:32.745883 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc7da1-6806-4fe8-8377-11964615d4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:32.746715 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc7da1-6806-4fe8-8377-11964615d4fe admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:32.747070 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc7da1-6806-4fe8-8377-11964615d4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:32.747410 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fc7da1-6806-4fe8-8377-11964615d4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:32.748619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc7da1-6806-4fe8-8377-11964615d4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:32.759819 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 879/1784] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:32.763681 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fc7da1-6806-4fe8-8377-11964615d4fe admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:32.764049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c30ad6-abfe-4739-a424-75d705476919 service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:32.766165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f7c30ad6-abfe-4739-a424-75d705476919 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:32.796347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 906/1785] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:32.802216 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc7da1-6806-4fe8-8377-11964615d4fe admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:32.831835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fc7da1-6806-4fe8-8377-11964615d4fe admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:32.838538 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9b105-a1f5-44ea-bd72-b5687325c0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:32.839742 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9b105-a1f5-44ea-bd72-b5687325c0a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:32.840362 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9b105-a1f5-44ea-bd72-b5687325c0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:32.840844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9b105-a1f5-44ea-bd72-b5687325c0a0 admin admin] PATH_INFO: `/v3/projects/c6dd3178f6754abdb075a3935a65b278/users/7ae707c3dc5c4ca7a064f056d6295f74/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:32.844886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9b105-a1f5-44ea-bd72-b5687325c0a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6dd3178f6754abdb075a3935a65b278, user_id=7ae707c3dc5c4ca7a064f056d6295f74, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:32.848860 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9b105-a1f5-44ea-bd72-b5687325c0a0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:32.862610 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 907/1786] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:32 2022] PUT /identity/v3/projects/c6dd3178f6754abdb075a3935a65b278/users/7ae707c3dc5c4ca7a064f056d6295f74/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:11:32.875223 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c86f6-1fc5-4334-a813-6cad13961144 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:32.875889 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c86f6-1fc5-4334-a813-6cad13961144 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:32.876414 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c86f6-1fc5-4334-a813-6cad13961144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:32.924861 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-988c86f6-1fc5-4334-a813-6cad13961144 None None] MFA Rules not processed for user `7ae707c3dc5c4ca7a064f056d6295f74`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:32.926939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-988c86f6-1fc5-4334-a813-6cad13961144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:32.969888 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:32.975140 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c30ad6-abfe-4739-a424-75d705476919 service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:32.994097 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:33.028484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 908/1787] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:11:33.036825 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c86f6-1fc5-4334-a813-6cad13961144 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:33.038689 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-988c86f6-1fc5-4334-a813-6cad13961144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:33.073836 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce6bed-3eb6-4a25-8de8-e6f3e0d5ccce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cfed2469a7419f8fcbe09d25cb896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:33.074476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce6bed-3eb6-4a25-8de8-e6f3e0d5ccce service swift] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:33.074812 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce6bed-3eb6-4a25-8de8-e6f3e0d5ccce service swift] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:33.075092 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce6bed-3eb6-4a25-8de8-e6f3e0d5ccce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:33.146557 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c86f6-1fc5-4334-a813-6cad13961144 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:33.156197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce6bed-3eb6-4a25-8de8-e6f3e0d5ccce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:33.159601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce6bed-3eb6-4a25-8de8-e6f3e0d5ccce service swift] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:33.162043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779f3c1-8d06-423c-bb6b-452e42ee5d27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:33.162692 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779f3c1-8d06-423c-bb6b-452e42ee5d27 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:33.162972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779f3c1-8d06-423c-bb6b-452e42ee5d27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:33.163241 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779f3c1-8d06-423c-bb6b-452e42ee5d27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:33.178311 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 880/1788] 10.222.0.85 () {60 vars in 1384 bytes} [Tue Aug 2 10:11:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 10:11:33.193361 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779f3c1-8d06-423c-bb6b-452e42ee5d27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:33.196573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779f3c1-8d06-423c-bb6b-452e42ee5d27 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:33.229077 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 909/1789] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:33.833879 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce6bed-3eb6-4a25-8de8-e6f3e0d5ccce service swift] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:33.835944 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-74ce6bed-3eb6-4a25-8de8-e6f3e0d5ccce service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:34.030219 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce6bed-3eb6-4a25-8de8-e6f3e0d5ccce service swift] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:34.049132 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a06ce7-e4b4-4223-8a73-f987d1ad6c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:34.050230 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a06ce7-e4b4-4223-8a73-f987d1ad6c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:34.050663 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a06ce7-e4b4-4223-8a73-f987d1ad6c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:34.051698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a06ce7-e4b4-4223-8a73-f987d1ad6c14 admin admin] PATH_INFO: `/v3/projects/0c8bb7b580c44ea1aa094024749d0872` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:34.053496 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a06ce7-e4b4-4223-8a73-f987d1ad6c14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c8bb7b580c44ea1aa094024749d0872)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:34.055771 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a06ce7-e4b4-4223-8a73-f987d1ad6c14 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:34.101713 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a098d5-ee88-405e-b443-ebc46734bb65 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:34.102465 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a098d5-ee88-405e-b443-ebc46734bb65 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:34.103110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a098d5-ee88-405e-b443-ebc46734bb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:34.178945 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:34.187372 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-19a06ce7-e4b4-4223-8a73-f987d1ad6c14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c8bb7b580c44ea1aa094024749d0872', 'request_id': 'req-19a06ce7-e4b4-4223-8a73-f987d1ad6c14'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:34.213148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-19a06ce7-e4b4-4223-8a73-f987d1ad6c14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c8bb7b580c44ea1aa094024749d0872', 'request_id': 'req-19a06ce7-e4b4-4223-8a73-f987d1ad6c14'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:34.217048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a8a098d5-ee88-405e-b443-ebc46734bb65 None None] MFA Rules not processed for user `828eb58cdce44ca8827f1ce2be7c19d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:34.218282 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a8a098d5-ee88-405e-b443-ebc46734bb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:34.237893 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-19a06ce7-e4b4-4223-8a73-f987d1ad6c14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c8bb7b580c44ea1aa094024749d0872', 'request_id': 'req-19a06ce7-e4b4-4223-8a73-f987d1ad6c14'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:34.269308 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-19a06ce7-e4b4-4223-8a73-f987d1ad6c14 admin admin] The token cache is being invalidate because project 0c8bb7b580c44ea1aa094024749d0872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:34.273310 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-19a06ce7-e4b4-4223-8a73-f987d1ad6c14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:34.277459 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-19a06ce7-e4b4-4223-8a73-f987d1ad6c14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:34.283540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 881/1790] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:33 2022] DELETE /identity/v3/projects/0c8bb7b580c44ea1aa094024749d0872 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:34.289468 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e812d0-2c8a-44f8-9df7-28bc598aef0f None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:34.289762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e812d0-2c8a-44f8-9df7-28bc598aef0f None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:34.290043 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e812d0-2c8a-44f8-9df7-28bc598aef0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:34.373354 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-43e812d0-2c8a-44f8-9df7-28bc598aef0f None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:34.377664 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-43e812d0-2c8a-44f8-9df7-28bc598aef0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:34.432112 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 910/1791] 10.222.0.60 () {58 vars in 1015 bytes} [Tue Aug 2 10:11:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:34.569861 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 882/1792] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:34.578073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9f653-85b1-4bd0-9d13-acb53f538085 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:34.578685 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9f653-85b1-4bd0-9d13-acb53f538085 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:34.579210 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9f653-85b1-4bd0-9d13-acb53f538085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:34.618314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-bdc9f653-85b1-4bd0-9d13-acb53f538085 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:34.622139 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bdc9f653-85b1-4bd0-9d13-acb53f538085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:34.648398 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 911/1793] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:34.652705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e812d0-2c8a-44f8-9df7-28bc598aef0f None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:34.671541 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e812d0-2c8a-44f8-9df7-28bc598aef0f None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:34.686478 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abed91c-9b72-4748-a0e9-77e638d93b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:34.687267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abed91c-9b72-4748-a0e9-77e638d93b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:34.687705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abed91c-9b72-4748-a0e9-77e638d93b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:34.688075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abed91c-9b72-4748-a0e9-77e638d93b93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:34.688957 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abed91c-9b72-4748-a0e9-77e638d93b93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:34.689398 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abed91c-9b72-4748-a0e9-77e638d93b93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:34.700634 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abed91c-9b72-4748-a0e9-77e638d93b93 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:34.706789 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9f653-85b1-4bd0-9d13-acb53f538085 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:34.709175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bdc9f653-85b1-4bd0-9d13-acb53f538085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:34.737211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9f653-85b1-4bd0-9d13-acb53f538085 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:34.751257 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccacfd-dfb2-436e-b853-1d8d5afef386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:34.752014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccacfd-dfb2-436e-b853-1d8d5afef386 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:34.752368 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccacfd-dfb2-436e-b853-1d8d5afef386 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:34.752787 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccacfd-dfb2-436e-b853-1d8d5afef386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:34.761992 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 883/1794] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:34.768158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abed91c-9b72-4748-a0e9-77e638d93b93 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:34.780219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccacfd-dfb2-436e-b853-1d8d5afef386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:34.784762 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccacfd-dfb2-436e-b853-1d8d5afef386 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:34.802508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abed91c-9b72-4748-a0e9-77e638d93b93 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:34.815334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 912/1795] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:11:34.827121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489db23c-d131-46a7-b810-187853529ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:34.827748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489db23c-d131-46a7-b810-187853529ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:34.828038 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489db23c-d131-46a7-b810-187853529ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:34.828364 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489db23c-d131-46a7-b810-187853529ec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:34.829047 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489db23c-d131-46a7-b810-187853529ec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:34.831251 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489db23c-d131-46a7-b810-187853529ec1 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:34.967496 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 884/1796] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:34 2022] POST /identity/v3/projects => generated 369 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:34.972212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccacfd-dfb2-436e-b853-1d8d5afef386 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:34.998158 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccacfd-dfb2-436e-b853-1d8d5afef386 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:35.251979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5d8aa-ee97-42bb-893e-8ffb4ece40ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:35.253443 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5d8aa-ee97-42bb-893e-8ffb4ece40ff admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:35.254656 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5d8aa-ee97-42bb-893e-8ffb4ece40ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:35.256053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5d8aa-ee97-42bb-893e-8ffb4ece40ff admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:35.257013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5d8aa-ee97-42bb-893e-8ffb4ece40ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:35.264215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5d8aa-ee97-42bb-893e-8ffb4ece40ff admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:35.357433 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 913/1797] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:34 2022] POST /identity/v3/users => generated 285 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:35.361660 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489db23c-d131-46a7-b810-187853529ec1 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:35.382391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489db23c-d131-46a7-b810-187853529ec1 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:35.424740 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5d8aa-ee97-42bb-893e-8ffb4ece40ff admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:35.425255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f24e9-b24f-428a-bcfe-ce5e4b87954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:35.426575 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f24e9-b24f-428a-bcfe-ce5e4b87954b admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:35.426863 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f24e9-b24f-428a-bcfe-ce5e4b87954b admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:35.427147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f24e9-b24f-428a-bcfe-ce5e4b87954b admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:35.427873 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f24e9-b24f-428a-bcfe-ce5e4b87954b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:35.428556 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bbf5d8aa-ee97-42bb-893e-8ffb4ece40ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:35.429922 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f24e9-b24f-428a-bcfe-ce5e4b87954b admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:35.452519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 885/1798] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:35.456379 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f24e9-b24f-428a-bcfe-ce5e4b87954b admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:35.460126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5d8aa-ee97-42bb-893e-8ffb4ece40ff admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:35.476253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87504a8c-3d21-4977-9bb1-42f67e59e13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:35.479541 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87504a8c-3d21-4977-9bb1-42f67e59e13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:35.480137 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87504a8c-3d21-4977-9bb1-42f67e59e13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:35.480641 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87504a8c-3d21-4977-9bb1-42f67e59e13f admin admin] PATH_INFO: `/v3/projects/cc9b3f84408a4497b8c7ba21dceac8c9` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:35.483592 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87504a8c-3d21-4977-9bb1-42f67e59e13f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc9b3f84408a4497b8c7ba21dceac8c9)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:35.495137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f24e9-b24f-428a-bcfe-ce5e4b87954b admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:35.499261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87504a8c-3d21-4977-9bb1-42f67e59e13f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:35.520406 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c47c38-d914-43e7-9dde-86afc4c2321f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:35.521235 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c47c38-d914-43e7-9dde-86afc4c2321f admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:35.521675 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c47c38-d914-43e7-9dde-86afc4c2321f admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:35.521800 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c47c38-d914-43e7-9dde-86afc4c2321f admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:35.522594 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c47c38-d914-43e7-9dde-86afc4c2321f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:35.524650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c47c38-d914-43e7-9dde-86afc4c2321f admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:35.555243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:35.556423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 886/1799] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:11:35.562892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c47c38-d914-43e7-9dde-86afc4c2321f admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:35.578255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c47c38-d914-43e7-9dde-86afc4c2321f admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:35.591888 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d67ee-72f1-4362-a6c9-4ca7bc296b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:35.592669 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d67ee-72f1-4362-a6c9-4ca7bc296b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:35.593108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d67ee-72f1-4362-a6c9-4ca7bc296b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:35.593542 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d67ee-72f1-4362-a6c9-4ca7bc296b2e admin admin] PATH_INFO: `/v3/projects/3b6af4ad150f4e5f9a8d925244f5c502/users/7e3af12bd8f04116b0aeb3e39cb3b208/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:35.642943 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d67ee-72f1-4362-a6c9-4ca7bc296b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b6af4ad150f4e5f9a8d925244f5c502, user_id=7e3af12bd8f04116b0aeb3e39cb3b208, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:35.651454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d67ee-72f1-4362-a6c9-4ca7bc296b2e admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:35.697044 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 887/1800] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:35 2022] PUT /identity/v3/projects/3b6af4ad150f4e5f9a8d925244f5c502/users/7e3af12bd8f04116b0aeb3e39cb3b208/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:11:35.705164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-87504a8c-3d21-4977-9bb1-42f67e59e13f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc9b3f84408a4497b8c7ba21dceac8c9', 'request_id': 'req-87504a8c-3d21-4977-9bb1-42f67e59e13f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:35.712580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4628d-6ae6-48a9-9f1d-589c506e535f None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:35.713798 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4628d-6ae6-48a9-9f1d-589c506e535f None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:35.714180 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4628d-6ae6-48a9-9f1d-589c506e535f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:35.731366 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-87504a8c-3d21-4977-9bb1-42f67e59e13f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc9b3f84408a4497b8c7ba21dceac8c9', 'request_id': 'req-87504a8c-3d21-4977-9bb1-42f67e59e13f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:35.767545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-87504a8c-3d21-4977-9bb1-42f67e59e13f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc9b3f84408a4497b8c7ba21dceac8c9', 'request_id': 'req-87504a8c-3d21-4977-9bb1-42f67e59e13f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:35.815052 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-87504a8c-3d21-4977-9bb1-42f67e59e13f admin admin] The token cache is being invalidate because project cc9b3f84408a4497b8c7ba21dceac8c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:35.816017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-87504a8c-3d21-4977-9bb1-42f67e59e13f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:35.817575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-87504a8c-3d21-4977-9bb1-42f67e59e13f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:35.827507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 914/1801] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:35 2022] DELETE /identity/v3/projects/cc9b3f84408a4497b8c7ba21dceac8c9 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:35.829827 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87504a8c-3d21-4977-9bb1-42f67e59e13f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:35.831859 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-87504a8c-3d21-4977-9bb1-42f67e59e13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:35.837746 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-0dd4628d-6ae6-48a9-9f1d-589c506e535f None None] MFA Rules not processed for user `7e3af12bd8f04116b0aeb3e39cb3b208`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:35.840061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-0dd4628d-6ae6-48a9-9f1d-589c506e535f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:35.963732 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:36.012788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 888/1802] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:36.021070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4628d-6ae6-48a9-9f1d-589c506e535f None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:36.024756 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-0dd4628d-6ae6-48a9-9f1d-589c506e535f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:36.079415 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87504a8c-3d21-4977-9bb1-42f67e59e13f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:36.171398 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4628d-6ae6-48a9-9f1d-589c506e535f None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:36.183494 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79aa221-526e-4fd7-9905-1fd3f96c3a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:36.184393 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79aa221-526e-4fd7-9905-1fd3f96c3a6c admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:36.190094 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79aa221-526e-4fd7-9905-1fd3f96c3a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:36.190472 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79aa221-526e-4fd7-9905-1fd3f96c3a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:36.193035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79aa221-526e-4fd7-9905-1fd3f96c3a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:36.200073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79aa221-526e-4fd7-9905-1fd3f96c3a6c admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:36.272013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6507f74-4526-42d8-8723-4f9895234a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:36.273589 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6507f74-4526-42d8-8723-4f9895234a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:36.274023 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6507f74-4526-42d8-8723-4f9895234a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:36.274428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6507f74-4526-42d8-8723-4f9895234a2f admin admin] PATH_INFO: `/v3/users/86b3f159314544a7a9c457252ba50206` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:36.279428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6507f74-4526-42d8-8723-4f9895234a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=86b3f159314544a7a9c457252ba50206)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:36.281945 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6507f74-4526-42d8-8723-4f9895234a2f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:36.302997 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 889/1803] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:36 2022] POST /identity/v3/projects => generated 369 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:11:36.308076 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a86998-0a46-48c7-87f8-a9f818a9b457 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:36.308204 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a86998-0a46-48c7-87f8-a9f818a9b457 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:36.308428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a86998-0a46-48c7-87f8-a9f818a9b457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:36.421729 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-42a86998-0a46-48c7-87f8-a9f818a9b457 None None] MFA Rules not processed for user `30dc6521866a4e4e895c79b2c455d156`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:36.428085 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-42a86998-0a46-48c7-87f8-a9f818a9b457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:36.433841 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:36.436002 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f6507f74-4526-42d8-8723-4f9895234a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86b3f159314544a7a9c457252ba50206'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:36.439044 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f6507f74-4526-42d8-8723-4f9895234a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86b3f159314544a7a9c457252ba50206'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:36.458482 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f6507f74-4526-42d8-8723-4f9895234a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86b3f159314544a7a9c457252ba50206'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:36.490955 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f6507f74-4526-42d8-8723-4f9895234a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86b3f159314544a7a9c457252ba50206'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:36.506815 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f6507f74-4526-42d8-8723-4f9895234a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86b3f159314544a7a9c457252ba50206'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:36.516728 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 915/1804] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:35 2022] DELETE /identity/v3/users/86b3f159314544a7a9c457252ba50206 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:11:36.518011 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6507f74-4526-42d8-8723-4f9895234a2f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:36.521849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f6507f74-4526-42d8-8723-4f9895234a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:36.640494 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 890/1805] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:36 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:36.716782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6507f74-4526-42d8-8723-4f9895234a2f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:36.723870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbc709-c420-41b4-85c0-571be8de0db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:36.724868 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbc709-c420-41b4-85c0-571be8de0db5 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:36.725261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbc709-c420-41b4-85c0-571be8de0db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:36.725739 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbc709-c420-41b4-85c0-571be8de0db5 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:36.727828 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbc709-c420-41b4-85c0-571be8de0db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:36.730833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbc709-c420-41b4-85c0-571be8de0db5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:36.802325 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 916/1806] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:36 2022] POST /identity/v3/users => generated 291 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:36.805657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a86998-0a46-48c7-87f8-a9f818a9b457 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:36.956615 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:36.975461 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a86998-0a46-48c7-87f8-a9f818a9b457 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:36.987820 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817101c-9521-4fb9-889d-91d62ae39fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:36.989762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817101c-9521-4fb9-889d-91d62ae39fae admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:36.992056 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817101c-9521-4fb9-889d-91d62ae39fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:36.992391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817101c-9521-4fb9-889d-91d62ae39fae admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:36.995786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817101c-9521-4fb9-889d-91d62ae39fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:36.998281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f817101c-9521-4fb9-889d-91d62ae39fae admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:37.047717 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 891/1807] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:37.053362 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbc709-c420-41b4-85c0-571be8de0db5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:37.070915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbc709-c420-41b4-85c0-571be8de0db5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:37.103129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5214a1-0b82-4b92-a81d-6b3cb6fb9096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:37.103941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5214a1-0b82-4b92-a81d-6b3cb6fb9096 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:37.105467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5214a1-0b82-4b92-a81d-6b3cb6fb9096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:37.105767 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5214a1-0b82-4b92-a81d-6b3cb6fb9096 admin admin] PATH_INFO: `/v3/projects/3fc7a9efd0274cceb59b0757ddf603cb/users/ae76dcf4b8e7452a8fb04b3e23195f04/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:37.155953 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5214a1-0b82-4b92-a81d-6b3cb6fb9096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fc7a9efd0274cceb59b0757ddf603cb, user_id=ae76dcf4b8e7452a8fb04b3e23195f04, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:37.159564 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5214a1-0b82-4b92-a81d-6b3cb6fb9096 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:37.240791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 917/1808] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:37 2022] PUT /identity/v3/projects/3fc7a9efd0274cceb59b0757ddf603cb/users/ae76dcf4b8e7452a8fb04b3e23195f04/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:37.245900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817101c-9521-4fb9-889d-91d62ae39fae admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:37.259360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817101c-9521-4fb9-889d-91d62ae39fae admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:37.518155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecb410-e0a4-442f-ba96-b4a46fe9cfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:37.518865 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecb410-e0a4-442f-ba96-b4a46fe9cfbc admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:37.520505 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecb410-e0a4-442f-ba96-b4a46fe9cfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:37.520987 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecb410-e0a4-442f-ba96-b4a46fe9cfbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:37.523366 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecb410-e0a4-442f-ba96-b4a46fe9cfbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:37.525619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecb410-e0a4-442f-ba96-b4a46fe9cfbc admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:37.549761 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5214a1-0b82-4b92-a81d-6b3cb6fb9096 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:37.553181 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8e5214a1-0b82-4b92-a81d-6b3cb6fb9096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:37.591332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 892/1809] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:11:37.609617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d5eb1-ce66-47db-bb75-1c3477b2eb0d None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:37.610331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d5eb1-ce66-47db-bb75-1c3477b2eb0d None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:37.610717 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d5eb1-ce66-47db-bb75-1c3477b2eb0d None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:37.624259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 893/1810] 10.222.0.85 () {54 vars in 921 bytes} [Tue Aug 2 10:11:37 2022] GET /identity => generated 270 bytes in 31 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:11:37.625219 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d5eb1-ce66-47db-bb75-1c3477b2eb0d None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:37.637740 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5214a1-0b82-4b92-a81d-6b3cb6fb9096 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:37.648419 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d5eb1-ce66-47db-bb75-1c3477b2eb0d None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:37.650929 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad83c2a-75f8-4f3e-a002-432729caa743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:37.651693 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad83c2a-75f8-4f3e-a002-432729caa743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:37.667913 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad83c2a-75f8-4f3e-a002-432729caa743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:37.693588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb987b-28ce-4def-8efd-032df0fee5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:37.694452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb987b-28ce-4def-8efd-032df0fee5d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:37.695472 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb987b-28ce-4def-8efd-032df0fee5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:37.697107 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb987b-28ce-4def-8efd-032df0fee5d1 admin admin] PATH_INFO: `/v3/projects/3fc7a9efd0274cceb59b0757ddf603cb/users/ae76dcf4b8e7452a8fb04b3e23195f04/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:37.701449 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad83c2a-75f8-4f3e-a002-432729caa743 admin admin] PATH_INFO: `/v3/users/f478be04e98140a79309ad4a310a0e34` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:37.705226 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb987b-28ce-4def-8efd-032df0fee5d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fc7a9efd0274cceb59b0757ddf603cb, user_id=ae76dcf4b8e7452a8fb04b3e23195f04, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:37.707689 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad83c2a-75f8-4f3e-a002-432729caa743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f478be04e98140a79309ad4a310a0e34)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:37.717263 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad83c2a-75f8-4f3e-a002-432729caa743 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:37.723068 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb987b-28ce-4def-8efd-032df0fee5d1 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:37.808710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 894/1811] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:37 2022] PUT /identity/v3/projects/3fc7a9efd0274cceb59b0757ddf603cb/users/ae76dcf4b8e7452a8fb04b3e23195f04/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:37.822364 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b069c12-00a4-4417-893a-bbca7793d15c None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:37.825820 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b069c12-00a4-4417-893a-bbca7793d15c None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:37.829328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b069c12-00a4-4417-893a-bbca7793d15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:37.914065 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-4b069c12-00a4-4417-893a-bbca7793d15c None None] MFA Rules not processed for user `310867deefd34a598cfef2f3e4245ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:37.916961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4b069c12-00a4-4417-893a-bbca7793d15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:37.932986 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7ad83c2a-75f8-4f3e-a002-432729caa743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f478be04e98140a79309ad4a310a0e34'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:37.933977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7ad83c2a-75f8-4f3e-a002-432729caa743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f478be04e98140a79309ad4a310a0e34'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:37.971465 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7ad83c2a-75f8-4f3e-a002-432729caa743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f478be04e98140a79309ad4a310a0e34'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:38.010539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7ad83c2a-75f8-4f3e-a002-432729caa743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f478be04e98140a79309ad4a310a0e34'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:38.027088 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7ad83c2a-75f8-4f3e-a002-432729caa743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f478be04e98140a79309ad4a310a0e34'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:38.031799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=81,keystone:DELETE=13,keystone:INSERT=6 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:38.052828 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 918/1812] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:37 2022] DELETE /identity/v3/users/f478be04e98140a79309ad4a310a0e34 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:38.057801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f633daf-2b21-43c0-ab55-f5edd67f73fc None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:38.058431 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f633daf-2b21-43c0-ab55-f5edd67f73fc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:38.061287 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f633daf-2b21-43c0-ab55-f5edd67f73fc None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:38.063322 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 919/1813] 10.222.0.85 () {54 vars in 921 bytes} [Tue Aug 2 10:11:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:11:38.067408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866f080-ce54-44a7-8d6c-4147c67c1cb0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:38.068324 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866f080-ce54-44a7-8d6c-4147c67c1cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:38.070254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f866f080-ce54-44a7-8d6c-4147c67c1cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:38.151856 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 895/1814] 10.222.0.85 () {58 vars in 1018 bytes} [Tue Aug 2 10:11:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:38.153220 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b069c12-00a4-4417-893a-bbca7793d15c None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:38.159210 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4b069c12-00a4-4417-893a-bbca7793d15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:38.160825 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f866f080-ce54-44a7-8d6c-4147c67c1cb0 None None] MFA Rules not processed for user `ae76dcf4b8e7452a8fb04b3e23195f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:38.162358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f866f080-ce54-44a7-8d6c-4147c67c1cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:38.353127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b069c12-00a4-4417-893a-bbca7793d15c None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:38.361939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 920/1815] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:38 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:38.363915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100991d-dc2d-4833-81f3-489075923833 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:38.364208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100991d-dc2d-4833-81f3-489075923833 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:38.364501 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100991d-dc2d-4833-81f3-489075923833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:38.371610 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:38.463844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7100991d-dc2d-4833-81f3-489075923833 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:38.469941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7100991d-dc2d-4833-81f3-489075923833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:38.521883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11da44e-befe-4280-a1b4-282dc221f722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:38.524866 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11da44e-befe-4280-a1b4-282dc221f722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:38.526255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11da44e-befe-4280-a1b4-282dc221f722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:38.526653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11da44e-befe-4280-a1b4-282dc221f722 admin admin] PATH_INFO: `/v3/projects/7c8537c1e4394719b130ff5d5557e26c` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:38.533063 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11da44e-befe-4280-a1b4-282dc221f722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c8537c1e4394719b130ff5d5557e26c)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:38.538600 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11da44e-befe-4280-a1b4-282dc221f722 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:38.711945 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 921/1816] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:38.717408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c11da44e-befe-4280-a1b4-282dc221f722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c8537c1e4394719b130ff5d5557e26c', 'request_id': 'req-c11da44e-befe-4280-a1b4-282dc221f722'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:38.719899 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f5b5a-c995-4bb2-87c4-aac9222f74be None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:38.720575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f5b5a-c995-4bb2-87c4-aac9222f74be None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:38.721078 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f5b5a-c995-4bb2-87c4-aac9222f74be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:38.727613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c11da44e-befe-4280-a1b4-282dc221f722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c8537c1e4394719b130ff5d5557e26c', 'request_id': 'req-c11da44e-befe-4280-a1b4-282dc221f722'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:38.735434 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c11da44e-befe-4280-a1b4-282dc221f722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c8537c1e4394719b130ff5d5557e26c', 'request_id': 'req-c11da44e-befe-4280-a1b4-282dc221f722'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:38.763477 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c11da44e-befe-4280-a1b4-282dc221f722 admin admin] The token cache is being invalidate because project 7c8537c1e4394719b130ff5d5557e26c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:38.763969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c11da44e-befe-4280-a1b4-282dc221f722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:38.765996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c11da44e-befe-4280-a1b4-282dc221f722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:38.772561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-699f5b5a-c995-4bb2-87c4-aac9222f74be None None] MFA Rules not processed for user `310867deefd34a598cfef2f3e4245ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:38.773139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 896/1817] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:38 2022] DELETE /identity/v3/projects/7c8537c1e4394719b130ff5d5557e26c => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:38.774208 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11da44e-befe-4280-a1b4-282dc221f722 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:38.777829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-c11da44e-befe-4280-a1b4-282dc221f722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:38.780866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-699f5b5a-c995-4bb2-87c4-aac9222f74be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:38.888418 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11da44e-befe-4280-a1b4-282dc221f722 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:38.895046 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a850d94-939f-49af-bb09-2984ea86869d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:38.896589 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a850d94-939f-49af-bb09-2984ea86869d service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:38.896980 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a850d94-939f-49af-bb09-2984ea86869d service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:38.897370 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a850d94-939f-49af-bb09-2984ea86869d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:38.899452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2a850d94-939f-49af-bb09-2984ea86869d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:38.914310 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a850d94-939f-49af-bb09-2984ea86869d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:38.916245 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a850d94-939f-49af-bb09-2984ea86869d service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:38.930172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 897/1818] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:38.931585 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a850d94-939f-49af-bb09-2984ea86869d service nova] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:38.933296 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2a850d94-939f-49af-bb09-2984ea86869d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:38.969133 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 922/1819] 10.222.0.85 () {58 vars in 1018 bytes} [Tue Aug 2 10:11:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:38.971041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dff499-0d74-450e-b2a2-3b65be52a3cf None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:38.971041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dff499-0d74-450e-b2a2-3b65be52a3cf None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:38.971041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dff499-0d74-450e-b2a2-3b65be52a3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:38.973837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:39.036078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a850d94-939f-49af-bb09-2984ea86869d service nova] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:39.045948 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc0846-bf80-4403-8bd2-dc207568dfb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:39.047978 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc0846-bf80-4403-8bd2-dc207568dfb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:39.049608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-26dff499-0d74-450e-b2a2-3b65be52a3cf None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:39.049744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc0846-bf80-4403-8bd2-dc207568dfb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:39.051359 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-26dff499-0d74-450e-b2a2-3b65be52a3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:39.051674 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dc0846-bf80-4403-8bd2-dc207568dfb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:39.057398 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e5dc0846-bf80-4403-8bd2-dc207568dfb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:39.102612 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:39.262396 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 923/1820] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:39.263481 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dff499-0d74-450e-b2a2-3b65be52a3cf None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:39.266591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-26dff499-0d74-450e-b2a2-3b65be52a3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:39.279622 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc0846-bf80-4403-8bd2-dc207568dfb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:39.281311 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dc0846-bf80-4403-8bd2-dc207568dfb4 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:39.324539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 898/1821] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:38 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:39.326188 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc0846-bf80-4403-8bd2-dc207568dfb4 service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:39.334188 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e5dc0846-bf80-4403-8bd2-dc207568dfb4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:39.374667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dc0846-bf80-4403-8bd2-dc207568dfb4 service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:39.393774 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bef767-f176-45f6-9949-e9fda586a571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:39.395482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bef767-f176-45f6-9949-e9fda586a571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:39.395934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bef767-f176-45f6-9949-e9fda586a571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:39.396386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bef767-f176-45f6-9949-e9fda586a571 admin admin] PATH_INFO: `/v3/users/1dbd3b9a7d2243568bf432a755ce5e5f` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:39.398781 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bef767-f176-45f6-9949-e9fda586a571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dbd3b9a7d2243568bf432a755ce5e5f)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:39.403274 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bef767-f176-45f6-9949-e9fda586a571 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:39.459656 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dff499-0d74-450e-b2a2-3b65be52a3cf None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:39.464864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e66243-89f8-471a-9c23-e16a4a96dc8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:39.465954 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e66243-89f8-471a-9c23-e16a4a96dc8f service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:39.466379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e66243-89f8-471a-9c23-e16a4a96dc8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:39.466779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e66243-89f8-471a-9c23-e16a4a96dc8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:39.470129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-56e66243-89f8-471a-9c23-e16a4a96dc8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:39.488098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e66243-89f8-471a-9c23-e16a4a96dc8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:39.490998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e66243-89f8-471a-9c23-e16a4a96dc8f service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:39.506880 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 924/1822] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:39.507108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-15bef767-f176-45f6-9949-e9fda586a571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dbd3b9a7d2243568bf432a755ce5e5f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:39.508255 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e66243-89f8-471a-9c23-e16a4a96dc8f service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:39.508436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-15bef767-f176-45f6-9949-e9fda586a571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dbd3b9a7d2243568bf432a755ce5e5f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:39.524685 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e66243-89f8-471a-9c23-e16a4a96dc8f service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:39.531058 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e30ee5-eacd-40b6-8bac-283ef486e7e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:39.532592 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e30ee5-eacd-40b6-8bac-283ef486e7e7 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:39.533392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e30ee5-eacd-40b6-8bac-283ef486e7e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:39.533392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e30ee5-eacd-40b6-8bac-283ef486e7e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:39.547310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e30ee5-eacd-40b6-8bac-283ef486e7e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:39.549727 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e30ee5-eacd-40b6-8bac-283ef486e7e7 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:39.555493 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-15bef767-f176-45f6-9949-e9fda586a571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dbd3b9a7d2243568bf432a755ce5e5f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:39.571177 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-15bef767-f176-45f6-9949-e9fda586a571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dbd3b9a7d2243568bf432a755ce5e5f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:39.572290 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-15bef767-f176-45f6-9949-e9fda586a571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dbd3b9a7d2243568bf432a755ce5e5f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:39.587409 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 925/1823] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:39.590867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01858a98-b6ec-4dfc-b9dd-485ae4d5283e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:39.590867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01858a98-b6ec-4dfc-b9dd-485ae4d5283e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:39.593283 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01858a98-b6ec-4dfc-b9dd-485ae4d5283e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:39.618643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 899/1824] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:39 2022] DELETE /identity/v3/users/1dbd3b9a7d2243568bf432a755ce5e5f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:39.623483 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bef767-f176-45f6-9949-e9fda586a571 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:39.627273 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-15bef767-f176-45f6-9949-e9fda586a571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:39.642686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-01858a98-b6ec-4dfc-b9dd-485ae4d5283e None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:39.645531 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-01858a98-b6ec-4dfc-b9dd-485ae4d5283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:39.794690 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bef767-f176-45f6-9949-e9fda586a571 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:39.808485 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f2f19-0329-437b-a05e-ef251292033a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:39.808485 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f2f19-0329-437b-a05e-ef251292033a service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:39.808485 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f2f19-0329-437b-a05e-ef251292033a service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:39.808485 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f2f19-0329-437b-a05e-ef251292033a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:39.808907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-852f2f19-0329-437b-a05e-ef251292033a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:39.817435 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:39.827486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 926/1825] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:39.831295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee48a9-1902-4e17-aa44-63199fa991dd None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:39.832279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee48a9-1902-4e17-aa44-63199fa991dd None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:39.832928 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee48a9-1902-4e17-aa44-63199fa991dd None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:39.837677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 927/1826] 10.222.0.85 () {54 vars in 921 bytes} [Tue Aug 2 10:11:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:11:39.842192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457463a-76b0-4da7-b063-81d5e00cfc2b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:39.843136 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457463a-76b0-4da7-b063-81d5e00cfc2b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:39.846150 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7457463a-76b0-4da7-b063-81d5e00cfc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:39.888725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7457463a-76b0-4da7-b063-81d5e00cfc2b None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:39.890066 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7457463a-76b0-4da7-b063-81d5e00cfc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:39.929605 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 928/1827] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:39.931660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457463a-76b0-4da7-b063-81d5e00cfc2b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:39.933552 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f2f19-0329-437b-a05e-ef251292033a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:39.942834 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f2f19-0329-437b-a05e-ef251292033a service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:39.955694 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7457463a-76b0-4da7-b063-81d5e00cfc2b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:39.960363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 900/1828] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:39.971110 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093d21f-0f14-4332-bde1-2e97f897ca8f None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:39.971573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093d21f-0f14-4332-bde1-2e97f897ca8f None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:39.972076 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093d21f-0f14-4332-bde1-2e97f897ca8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:39.981078 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d972ebb-d6c5-4f9f-a705-586fc95ee27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:39.982274 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d972ebb-d6c5-4f9f-a705-586fc95ee27e admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:39.982843 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d972ebb-d6c5-4f9f-a705-586fc95ee27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:39.983598 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d972ebb-d6c5-4f9f-a705-586fc95ee27e admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:39.988113 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d972ebb-d6c5-4f9f-a705-586fc95ee27e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:39.989675 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d972ebb-d6c5-4f9f-a705-586fc95ee27e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:39.996707 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d972ebb-d6c5-4f9f-a705-586fc95ee27e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:40.003249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-1093d21f-0f14-4332-bde1-2e97f897ca8f None None] MFA Rules not processed for user `a2a420cc676e4f2bb2766826a1de3b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:40.004951 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-1093d21f-0f14-4332-bde1-2e97f897ca8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:40.033510 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 929/1829] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:40.034688 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d972ebb-d6c5-4f9f-a705-586fc95ee27e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:40.044863 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4d972ebb-d6c5-4f9f-a705-586fc95ee27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:40.106696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:40.139417 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 901/1830] 10.222.0.85 () {58 vars in 1018 bytes} [Tue Aug 2 10:11:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:40.140878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093d21f-0f14-4332-bde1-2e97f897ca8f None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:40.153048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d972ebb-d6c5-4f9f-a705-586fc95ee27e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:40.159046 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba7e0d-fa6b-4e18-8165-eac6118ac68d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:40.160241 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba7e0d-fa6b-4e18-8165-eac6118ac68d service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:40.160241 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba7e0d-fa6b-4e18-8165-eac6118ac68d service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:40.160564 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba7e0d-fa6b-4e18-8165-eac6118ac68d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:40.169442 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093d21f-0f14-4332-bde1-2e97f897ca8f None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:40.186417 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0ae99-31fd-49dd-8cd7-69b53b0d8260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:40.187090 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0ae99-31fd-49dd-8cd7-69b53b0d8260 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:40.188851 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0ae99-31fd-49dd-8cd7-69b53b0d8260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:40.189142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0ae99-31fd-49dd-8cd7-69b53b0d8260 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:40.189869 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0ae99-31fd-49dd-8cd7-69b53b0d8260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:40.197304 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a0ae99-31fd-49dd-8cd7-69b53b0d8260 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:40.201649 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba7e0d-fa6b-4e18-8165-eac6118ac68d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:40.204929 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba7e0d-fa6b-4e18-8165-eac6118ac68d service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:40.236776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 930/1831] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:40.263114 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 902/1832] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:40 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:40.273230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba7e0d-fa6b-4e18-8165-eac6118ac68d service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:40.302938 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba7e0d-fa6b-4e18-8165-eac6118ac68d service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:40.484501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0ae99-31fd-49dd-8cd7-69b53b0d8260 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:40.486903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-50a0ae99-31fd-49dd-8cd7-69b53b0d8260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:40.571314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dd52e-c21a-49cb-9a06-9b0517ba2871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:40.585060 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dd52e-c21a-49cb-9a06-9b0517ba2871 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:40.585394 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dd52e-c21a-49cb-9a06-9b0517ba2871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:40.585627 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dd52e-c21a-49cb-9a06-9b0517ba2871 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:40.586340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dd52e-c21a-49cb-9a06-9b0517ba2871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:40.588309 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dd52e-c21a-49cb-9a06-9b0517ba2871 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:40.667161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 931/1833] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:40 2022] POST /identity/v3/users => generated 294 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:11:40.672934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dd52e-c21a-49cb-9a06-9b0517ba2871 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:40.708878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dd52e-c21a-49cb-9a06-9b0517ba2871 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:40.739444 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c798e-0122-4bae-aebe-10c5385d8575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:40.740009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c798e-0122-4bae-aebe-10c5385d8575 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:40.740576 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c798e-0122-4bae-aebe-10c5385d8575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:40.740860 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c798e-0122-4bae-aebe-10c5385d8575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:40.741574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c798e-0122-4bae-aebe-10c5385d8575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:40.743207 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c798e-0122-4bae-aebe-10c5385d8575 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:40.765354 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a0ae99-31fd-49dd-8cd7-69b53b0d8260 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:40.784169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e36da-791d-41ab-b256-267d9d9ffb0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2a420cc676e4f2bb2766826a1de3b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:40.785168 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e36da-791d-41ab-b256-267d9d9ffb0f service placement] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:40.787118 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 932/1834] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:40.787674 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e36da-791d-41ab-b256-267d9d9ffb0f service placement] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:40.788317 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e36da-791d-41ab-b256-267d9d9ffb0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:40.793469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c798e-0122-4bae-aebe-10c5385d8575 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:40.818388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e36da-791d-41ab-b256-267d9d9ffb0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:40.820929 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e36da-791d-41ab-b256-267d9d9ffb0f service placement] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:40.856837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c798e-0122-4bae-aebe-10c5385d8575 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:40.860610 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 903/1835] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:40.877689 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdded573-eb13-4b2b-86c6-a4b562489eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:40.879832 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdded573-eb13-4b2b-86c6-a4b562489eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:40.880830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdded573-eb13-4b2b-86c6-a4b562489eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:40.882348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdded573-eb13-4b2b-86c6-a4b562489eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:40.884148 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdded573-eb13-4b2b-86c6-a4b562489eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:40.889220 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdded573-eb13-4b2b-86c6-a4b562489eb7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:40.937461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 933/1836] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:40.940206 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e36da-791d-41ab-b256-267d9d9ffb0f service placement] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:40.964910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e36da-791d-41ab-b256-267d9d9ffb0f service placement] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:40.975069 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13d3bb-2e4b-440d-8b07-07cf76f0c07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:40.976648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13d3bb-2e4b-440d-8b07-07cf76f0c07b admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:40.976995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13d3bb-2e4b-440d-8b07-07cf76f0c07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:40.977349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13d3bb-2e4b-440d-8b07-07cf76f0c07b admin admin] PATH_INFO: `/v3/projects/5f1aed57aacd42418993d743b59c68cb/users/92877069407f4745ad5f7620a1a0d4a5/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:40.983958 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:41.013745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13d3bb-2e4b-440d-8b07-07cf76f0c07b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1aed57aacd42418993d743b59c68cb, user_id=92877069407f4745ad5f7620a1a0d4a5, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:41.017069 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13d3bb-2e4b-440d-8b07-07cf76f0c07b admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:41.048926 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 904/1837] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:40 2022] PUT /identity/v3/projects/5f1aed57aacd42418993d743b59c68cb/users/92877069407f4745ad5f7620a1a0d4a5/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:41.060949 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1e3b8-776b-49d9-9d18-00357d02fdf9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:41.061242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1e3b8-776b-49d9-9d18-00357d02fdf9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:41.061574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1e3b8-776b-49d9-9d18-00357d02fdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:41.131841 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-eed1e3b8-776b-49d9-9d18-00357d02fdf9 None None] MFA Rules not processed for user `92877069407f4745ad5f7620a1a0d4a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:41.133972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-eed1e3b8-776b-49d9-9d18-00357d02fdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:41.272808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13d3bb-2e4b-440d-8b07-07cf76f0c07b admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:41.277602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-5c13d3bb-2e4b-440d-8b07-07cf76f0c07b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:41.279833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 934/1838] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:41.281317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1e3b8-776b-49d9-9d18-00357d02fdf9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:41.359337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:41.432135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13d3bb-2e4b-440d-8b07-07cf76f0c07b admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:41.445164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad00ea-4871-48ff-9263-8f512a60319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:41.446037 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad00ea-4871-48ff-9263-8f512a60319e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:41.460345 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad00ea-4871-48ff-9263-8f512a60319e admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:41.462681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad00ea-4871-48ff-9263-8f512a60319e admin admin] PATH_INFO: `/v3/projects/ff3fc87cc8b54861b25c5abea149cf14` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:41.468163 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad00ea-4871-48ff-9263-8f512a60319e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff3fc87cc8b54861b25c5abea149cf14)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:41.470679 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fad00ea-4871-48ff-9263-8f512a60319e admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:41.472256 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1e3b8-776b-49d9-9d18-00357d02fdf9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:41.482776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5d48a-1fc0-451a-b747-0636e915805e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:41.486978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5d48a-1fc0-451a-b747-0636e915805e admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:41.487362 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5d48a-1fc0-451a-b747-0636e915805e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:41.487712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5d48a-1fc0-451a-b747-0636e915805e admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:41.491343 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5d48a-1fc0-451a-b747-0636e915805e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:41.497160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5d48a-1fc0-451a-b747-0636e915805e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:41.614395 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 935/1839] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:41 2022] POST /identity/v3/projects => generated 389 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:41.621797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5d48a-1fc0-451a-b747-0636e915805e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:41.632984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3fad00ea-4871-48ff-9263-8f512a60319e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff3fc87cc8b54861b25c5abea149cf14', 'request_id': 'req-3fad00ea-4871-48ff-9263-8f512a60319e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:41.644918 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3fad00ea-4871-48ff-9263-8f512a60319e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff3fc87cc8b54861b25c5abea149cf14', 'request_id': 'req-3fad00ea-4871-48ff-9263-8f512a60319e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:41.661983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3fad00ea-4871-48ff-9263-8f512a60319e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff3fc87cc8b54861b25c5abea149cf14', 'request_id': 'req-3fad00ea-4871-48ff-9263-8f512a60319e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:41.693193 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3fad00ea-4871-48ff-9263-8f512a60319e admin admin] The token cache is being invalidate because project ff3fc87cc8b54861b25c5abea149cf14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:41.694689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3fad00ea-4871-48ff-9263-8f512a60319e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:41.696648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3fad00ea-4871-48ff-9263-8f512a60319e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:41.698963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 905/1840] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:41 2022] DELETE /identity/v3/projects/ff3fc87cc8b54861b25c5abea149cf14 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:41.704641 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad00ea-4871-48ff-9263-8f512a60319e admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:41.708239 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-3fad00ea-4871-48ff-9263-8f512a60319e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:41.785370 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5d48a-1fc0-451a-b747-0636e915805e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:41.793301 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040f118-b569-4b91-9d93-763af4760ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:41.796240 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040f118-b569-4b91-9d93-763af4760ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:41.796803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040f118-b569-4b91-9d93-763af4760ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:41.797738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040f118-b569-4b91-9d93-763af4760ab7 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:41.799744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040f118-b569-4b91-9d93-763af4760ab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:41.805423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040f118-b569-4b91-9d93-763af4760ab7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:41.861103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fad00ea-4871-48ff-9263-8f512a60319e admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:41.866695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737a2bb-ed1b-4ea3-a80b-41e58cfc1fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:41.867920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737a2bb-ed1b-4ea3-a80b-41e58cfc1fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:41.868379 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737a2bb-ed1b-4ea3-a80b-41e58cfc1fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:41.868692 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737a2bb-ed1b-4ea3-a80b-41e58cfc1fc4 admin admin] PATH_INFO: `/v3/users/7ae707c3dc5c4ca7a064f056d6295f74` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:41.870360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737a2bb-ed1b-4ea3-a80b-41e58cfc1fc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ae707c3dc5c4ca7a064f056d6295f74)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:41.873209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 936/1841] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:41 2022] POST /identity/v3/users => generated 301 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:41.875033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1737a2bb-ed1b-4ea3-a80b-41e58cfc1fc4 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:41.876562 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040f118-b569-4b91-9d93-763af4760ab7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:41.878484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9040f118-b569-4b91-9d93-763af4760ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:41.907407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:41.944786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040f118-b569-4b91-9d93-763af4760ab7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:41.944786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29113db-bc7e-46fe-89c6-72ff3cc8995a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:41.944786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29113db-bc7e-46fe-89c6-72ff3cc8995a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:41.944786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29113db-bc7e-46fe-89c6-72ff3cc8995a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:41.945093 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29113db-bc7e-46fe-89c6-72ff3cc8995a admin admin] PATH_INFO: `/v3/projects/57262eec517f4f4591ffffc269495a3d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:41.945358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29113db-bc7e-46fe-89c6-72ff3cc8995a admin admin] RBAC: Authorizing `identity:delete_project(project_id=57262eec517f4f4591ffffc269495a3d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:41.954088 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29113db-bc7e-46fe-89c6-72ff3cc8995a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:41.994744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-1737a2bb-ed1b-4ea3-a80b-41e58cfc1fc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ae707c3dc5c4ca7a064f056d6295f74'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:41.998094 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-1737a2bb-ed1b-4ea3-a80b-41e58cfc1fc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ae707c3dc5c4ca7a064f056d6295f74'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:42.039065 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-1737a2bb-ed1b-4ea3-a80b-41e58cfc1fc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ae707c3dc5c4ca7a064f056d6295f74'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:42.051818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-1737a2bb-ed1b-4ea3-a80b-41e58cfc1fc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ae707c3dc5c4ca7a064f056d6295f74'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:42.052819 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-1737a2bb-ed1b-4ea3-a80b-41e58cfc1fc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ae707c3dc5c4ca7a064f056d6295f74'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:42.094939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d29113db-bc7e-46fe-89c6-72ff3cc8995a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57262eec517f4f4591ffffc269495a3d', 'request_id': 'req-d29113db-bc7e-46fe-89c6-72ff3cc8995a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:42.104538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 906/1842] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:41 2022] DELETE /identity/v3/users/7ae707c3dc5c4ca7a064f056d6295f74 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:42.105453 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737a2bb-ed1b-4ea3-a80b-41e58cfc1fc4 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:42.107764 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-1737a2bb-ed1b-4ea3-a80b-41e58cfc1fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:42.115923 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d29113db-bc7e-46fe-89c6-72ff3cc8995a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57262eec517f4f4591ffffc269495a3d', 'request_id': 'req-d29113db-bc7e-46fe-89c6-72ff3cc8995a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:42.130128 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d29113db-bc7e-46fe-89c6-72ff3cc8995a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57262eec517f4f4591ffffc269495a3d', 'request_id': 'req-d29113db-bc7e-46fe-89c6-72ff3cc8995a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:42.154021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d29113db-bc7e-46fe-89c6-72ff3cc8995a admin admin] The token cache is being invalidate because project 57262eec517f4f4591ffffc269495a3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:42.154391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d29113db-bc7e-46fe-89c6-72ff3cc8995a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:42.155582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d29113db-bc7e-46fe-89c6-72ff3cc8995a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:42.162375 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 937/1843] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:41 2022] DELETE /identity/v3/projects/57262eec517f4f4591ffffc269495a3d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:42.163402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29113db-bc7e-46fe-89c6-72ff3cc8995a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:42.168372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d29113db-bc7e-46fe-89c6-72ff3cc8995a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:42.254486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:42.290051 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737a2bb-ed1b-4ea3-a80b-41e58cfc1fc4 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:42.310424 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ada70a-d3e7-4071-a1f6-9c0d3b3302e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:42.310745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ada70a-d3e7-4071-a1f6-9c0d3b3302e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:42.311031 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ada70a-d3e7-4071-a1f6-9c0d3b3302e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:42.311312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ada70a-d3e7-4071-a1f6-9c0d3b3302e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:42.312029 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ada70a-d3e7-4071-a1f6-9c0d3b3302e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:42.313681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ada70a-d3e7-4071-a1f6-9c0d3b3302e3 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:42.354687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 907/1844] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:42.359975 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8f132-5d33-4a99-b082-349706e4facc None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:42.360825 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29113db-bc7e-46fe-89c6-72ff3cc8995a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:42.361850 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8f132-5d33-4a99-b082-349706e4facc None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:42.362134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8f132-5d33-4a99-b082-349706e4facc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:42.379349 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23498d19-84f8-40bb-b7bd-01f3a02d8ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:42.380032 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23498d19-84f8-40bb-b7bd-01f3a02d8ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:42.380320 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23498d19-84f8-40bb-b7bd-01f3a02d8ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:42.384360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23498d19-84f8-40bb-b7bd-01f3a02d8ea7 admin admin] PATH_INFO: `/v3/users/803ec6cf30804b59b0d48ce84ee0282b` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:42.391274 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23498d19-84f8-40bb-b7bd-01f3a02d8ea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=803ec6cf30804b59b0d48ce84ee0282b)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:42.393288 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23498d19-84f8-40bb-b7bd-01f3a02d8ea7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:42.420311 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-61e8f132-5d33-4a99-b082-349706e4facc None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:42.424613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-61e8f132-5d33-4a99-b082-349706e4facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:42.453572 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 908/1845] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:42.454466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8f132-5d33-4a99-b082-349706e4facc None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:42.464934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-61e8f132-5d33-4a99-b082-349706e4facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:42.520554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8f132-5d33-4a99-b082-349706e4facc None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:42.522766 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-23498d19-84f8-40bb-b7bd-01f3a02d8ea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '803ec6cf30804b59b0d48ce84ee0282b'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:42.523572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-23498d19-84f8-40bb-b7bd-01f3a02d8ea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '803ec6cf30804b59b0d48ce84ee0282b'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:42.535478 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-23498d19-84f8-40bb-b7bd-01f3a02d8ea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '803ec6cf30804b59b0d48ce84ee0282b'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:42.543274 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c0ba4-06a6-4908-846e-3b327ee11a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:42.553803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-23498d19-84f8-40bb-b7bd-01f3a02d8ea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '803ec6cf30804b59b0d48ce84ee0282b'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:42.560602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c0ba4-06a6-4908-846e-3b327ee11a01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:42.561388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c0ba4-06a6-4908-846e-3b327ee11a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:42.561388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c0ba4-06a6-4908-846e-3b327ee11a01 admin admin] PATH_INFO: `/v3/projects/1a9bb95b7aea4c87bb2d31942286f99b/users/1160506537f84a77a88f5bc323025e3c/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:42.568607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-23498d19-84f8-40bb-b7bd-01f3a02d8ea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '803ec6cf30804b59b0d48ce84ee0282b'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:42.585563 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 938/1846] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:42 2022] DELETE /identity/v3/users/803ec6cf30804b59b0d48ce84ee0282b => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:42.591014 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c0ba4-06a6-4908-846e-3b327ee11a01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9bb95b7aea4c87bb2d31942286f99b, user_id=1160506537f84a77a88f5bc323025e3c, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:42.591663 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f0493-4513-4959-819d-6233a7578348 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:42.593114 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f0493-4513-4959-819d-6233a7578348 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:42.593851 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c0ba4-06a6-4908-846e-3b327ee11a01 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:42.594276 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f0493-4513-4959-819d-6233a7578348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:42.635067 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 909/1847] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:42 2022] PUT /identity/v3/projects/1a9bb95b7aea4c87bb2d31942286f99b/users/1160506537f84a77a88f5bc323025e3c/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:42.639427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c0ba4-06a6-4908-846e-3b327ee11a01 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:42.644869 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-445c0ba4-06a6-4908-846e-3b327ee11a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:42.655591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ff0f0493-4513-4959-819d-6233a7578348 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:42.657622 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ff0f0493-4513-4959-819d-6233a7578348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:42.843183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 939/1848] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:42.845051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f0493-4513-4959-819d-6233a7578348 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:42.849304 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c0ba4-06a6-4908-846e-3b327ee11a01 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:42.855316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154be823-0cc7-486d-a21d-83d82eb813b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:42.855899 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154be823-0cc7-486d-a21d-83d82eb813b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:42.856186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154be823-0cc7-486d-a21d-83d82eb813b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:42.856482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154be823-0cc7-486d-a21d-83d82eb813b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:42.857208 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154be823-0cc7-486d-a21d-83d82eb813b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:42.859101 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154be823-0cc7-486d-a21d-83d82eb813b7 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:42.861164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:42.877505 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 910/1849] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:42.882655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f0493-4513-4959-819d-6233a7578348 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:42.883187 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154be823-0cc7-486d-a21d-83d82eb813b7 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:42.911295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25bf86-6780-4c21-bfeb-0d661bc89f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:42.912246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25bf86-6780-4c21-bfeb-0d661bc89f62 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:42.914138 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25bf86-6780-4c21-bfeb-0d661bc89f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:42.914688 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25bf86-6780-4c21-bfeb-0d661bc89f62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:42.915690 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25bf86-6780-4c21-bfeb-0d661bc89f62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:42.916529 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25bf86-6780-4c21-bfeb-0d661bc89f62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:42.922775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25bf86-6780-4c21-bfeb-0d661bc89f62 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:42.934490 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154be823-0cc7-486d-a21d-83d82eb813b7 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:42.946990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece15e5-db96-413b-8624-4dec25a08c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:42.948703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece15e5-db96-413b-8624-4dec25a08c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:42.950226 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece15e5-db96-413b-8624-4dec25a08c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:42.950654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece15e5-db96-413b-8624-4dec25a08c76 admin admin] PATH_INFO: `/v3/projects/1a9bb95b7aea4c87bb2d31942286f99b/users/1160506537f84a77a88f5bc323025e3c/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:42.953764 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece15e5-db96-413b-8624-4dec25a08c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9bb95b7aea4c87bb2d31942286f99b, user_id=1160506537f84a77a88f5bc323025e3c, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:42.958093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece15e5-db96-413b-8624-4dec25a08c76 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:42.967208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 940/1850] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:42.980291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25bf86-6780-4c21-bfeb-0d661bc89f62 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:42.990941 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 911/1851] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:42 2022] PUT /identity/v3/projects/1a9bb95b7aea4c87bb2d31942286f99b/users/1160506537f84a77a88f5bc323025e3c/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:42.994828 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25bf86-6780-4c21-bfeb-0d661bc89f62 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:43.002767 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b52eb-bbf5-4305-8801-b2014e9d70f2 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:43.003060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b52eb-bbf5-4305-8801-b2014e9d70f2 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:43.003388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b52eb-bbf5-4305-8801-b2014e9d70f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:43.065070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-214b52eb-bbf5-4305-8801-b2014e9d70f2 None None] MFA Rules not processed for user `1160506537f84a77a88f5bc323025e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:43.067994 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-214b52eb-bbf5-4305-8801-b2014e9d70f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:43.076568 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:43.149926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40b9c4-8d1d-43f1-af98-ae2c0c1ae2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:43.151005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40b9c4-8d1d-43f1-af98-ae2c0c1ae2bf admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:43.151960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40b9c4-8d1d-43f1-af98-ae2c0c1ae2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:43.152317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40b9c4-8d1d-43f1-af98-ae2c0c1ae2bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:43.153833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40b9c4-8d1d-43f1-af98-ae2c0c1ae2bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:43.155882 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40b9c4-8d1d-43f1-af98-ae2c0c1ae2bf admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:43.252533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 941/1852] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:42 2022] POST /identity/v3/projects => generated 357 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:43.257084 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40b9c4-8d1d-43f1-af98-ae2c0c1ae2bf admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:43.268707 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 912/1853] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:43 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:11:43.281391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b52eb-bbf5-4305-8801-b2014e9d70f2 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:43.284688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-214b52eb-bbf5-4305-8801-b2014e9d70f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:43.359237 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b52eb-bbf5-4305-8801-b2014e9d70f2 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:43.512984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40b9c4-8d1d-43f1-af98-ae2c0c1ae2bf admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:43.529929 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1c078-fb95-4c46-8e63-909bcb1b42bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:43.530722 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1c078-fb95-4c46-8e63-909bcb1b42bb admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:43.531020 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1c078-fb95-4c46-8e63-909bcb1b42bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:43.531463 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1c078-fb95-4c46-8e63-909bcb1b42bb admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:43.532250 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1c078-fb95-4c46-8e63-909bcb1b42bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:43.532959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc986c49-7486-4baf-a105-2f616a534561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:43.534007 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc986c49-7486-4baf-a105-2f616a534561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:43.534580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc986c49-7486-4baf-a105-2f616a534561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:43.535278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc986c49-7486-4baf-a105-2f616a534561 admin admin] PATH_INFO: `/v3/projects/d7b4fa92e8234603a3240114699905d8` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:43.536593 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1c078-fb95-4c46-8e63-909bcb1b42bb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:43.538474 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc986c49-7486-4baf-a105-2f616a534561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7b4fa92e8234603a3240114699905d8)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:43.542690 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc986c49-7486-4baf-a105-2f616a534561 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:43.591540 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 942/1854] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:43 2022] POST /identity/v3/users => generated 279 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:43.593119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1c078-fb95-4c46-8e63-909bcb1b42bb admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:43.594996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-96b1c078-fb95-4c46-8e63-909bcb1b42bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:43.668699 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-dc986c49-7486-4baf-a105-2f616a534561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7b4fa92e8234603a3240114699905d8', 'request_id': 'req-dc986c49-7486-4baf-a105-2f616a534561'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:43.682474 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-dc986c49-7486-4baf-a105-2f616a534561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7b4fa92e8234603a3240114699905d8', 'request_id': 'req-dc986c49-7486-4baf-a105-2f616a534561'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:43.703050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-dc986c49-7486-4baf-a105-2f616a534561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7b4fa92e8234603a3240114699905d8', 'request_id': 'req-dc986c49-7486-4baf-a105-2f616a534561'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:43.717849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:43.730803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-dc986c49-7486-4baf-a105-2f616a534561 admin admin] The token cache is being invalidate because project d7b4fa92e8234603a3240114699905d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:43.733862 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-dc986c49-7486-4baf-a105-2f616a534561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:43.737290 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-dc986c49-7486-4baf-a105-2f616a534561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:43.740113 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 913/1855] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:43 2022] DELETE /identity/v3/projects/d7b4fa92e8234603a3240114699905d8 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:43.741657 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc986c49-7486-4baf-a105-2f616a534561 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:43.747128 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1c078-fb95-4c46-8e63-909bcb1b42bb admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:43.748198 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-dc986c49-7486-4baf-a105-2f616a534561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:43.839437 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebb66e-3a4a-41f5-94ea-51b6b6484b4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:43.840093 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebb66e-3a4a-41f5-94ea-51b6b6484b4e service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:43.840446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebb66e-3a4a-41f5-94ea-51b6b6484b4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:43.840828 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebb66e-3a4a-41f5-94ea-51b6b6484b4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:43.843378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-26ebb66e-3a4a-41f5-94ea-51b6b6484b4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:43.876181 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:43.880216 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc986c49-7486-4baf-a105-2f616a534561 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:43.889382 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08984af2-f372-4d51-ba31-863ca9613e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:43.890168 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08984af2-f372-4d51-ba31-863ca9613e42 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:43.892714 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08984af2-f372-4d51-ba31-863ca9613e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:43.893095 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08984af2-f372-4d51-ba31-863ca9613e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:43.896794 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08984af2-f372-4d51-ba31-863ca9613e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:43.901020 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08984af2-f372-4d51-ba31-863ca9613e42 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:43.932878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 914/1856] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:43.936844 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08984af2-f372-4d51-ba31-863ca9613e42 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:43.939514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-08984af2-f372-4d51-ba31-863ca9613e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:43.962515 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08984af2-f372-4d51-ba31-863ca9613e42 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:43.967837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7c7e4-c297-4e3e-b852-0720827ad844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:43.968641 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7c7e4-c297-4e3e-b852-0720827ad844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:43.969003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7c7e4-c297-4e3e-b852-0720827ad844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:43.969448 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd7c7e4-c297-4e3e-b852-0720827ad844 admin admin] PATH_INFO: `/v3/projects/c6dd3178f6754abdb075a3935a65b278` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:43.970800 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7c7e4-c297-4e3e-b852-0720827ad844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6dd3178f6754abdb075a3935a65b278)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:43.974685 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd7c7e4-c297-4e3e-b852-0720827ad844 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:43.976209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebb66e-3a4a-41f5-94ea-51b6b6484b4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:43.977701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebb66e-3a4a-41f5-94ea-51b6b6484b4e service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:44.012216 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 943/1857] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:43 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:44.013258 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebb66e-3a4a-41f5-94ea-51b6b6484b4e service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:44.018159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-26ebb66e-3a4a-41f5-94ea-51b6b6484b4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:44.067123 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebb66e-3a4a-41f5-94ea-51b6b6484b4e service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:44.105855 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fcd7c7e4-c297-4e3e-b852-0720827ad844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6dd3178f6754abdb075a3935a65b278', 'request_id': 'req-fcd7c7e4-c297-4e3e-b852-0720827ad844'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:44.138388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fcd7c7e4-c297-4e3e-b852-0720827ad844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6dd3178f6754abdb075a3935a65b278', 'request_id': 'req-fcd7c7e4-c297-4e3e-b852-0720827ad844'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:44.157703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fcd7c7e4-c297-4e3e-b852-0720827ad844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6dd3178f6754abdb075a3935a65b278', 'request_id': 'req-fcd7c7e4-c297-4e3e-b852-0720827ad844'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:44.218813 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fcd7c7e4-c297-4e3e-b852-0720827ad844 admin admin] The token cache is being invalidate because project c6dd3178f6754abdb075a3935a65b278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:44.219109 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fcd7c7e4-c297-4e3e-b852-0720827ad844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:44.220381 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fcd7c7e4-c297-4e3e-b852-0720827ad844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:44.222001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 915/1858] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:43 2022] DELETE /identity/v3/projects/c6dd3178f6754abdb075a3935a65b278 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:44.222896 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7c7e4-c297-4e3e-b852-0720827ad844 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:44.237524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-fcd7c7e4-c297-4e3e-b852-0720827ad844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:44.259656 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ee1ea-b4cf-412f-940f-56ef223bdc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:44.260757 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ee1ea-b4cf-412f-940f-56ef223bdc81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:44.261245 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ee1ea-b4cf-412f-940f-56ef223bdc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:44.261746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ee1ea-b4cf-412f-940f-56ef223bdc81 admin admin] PATH_INFO: `/v3/users/30dc6521866a4e4e895c79b2c455d156` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:44.265034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ee1ea-b4cf-412f-940f-56ef223bdc81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30dc6521866a4e4e895c79b2c455d156)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:44.267447 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ee1ea-b4cf-412f-940f-56ef223bdc81 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:44.404946 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-130ee1ea-b4cf-412f-940f-56ef223bdc81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30dc6521866a4e4e895c79b2c455d156'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:44.406715 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-130ee1ea-b4cf-412f-940f-56ef223bdc81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30dc6521866a4e4e895c79b2c455d156'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:44.424497 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd7c7e4-c297-4e3e-b852-0720827ad844 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:44.433267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa79255-57ea-4e51-bace-c174312faf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:44.434058 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa79255-57ea-4e51-bace-c174312faf30 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:44.434559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa79255-57ea-4e51-bace-c174312faf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:44.434943 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa79255-57ea-4e51-bace-c174312faf30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:44.436899 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-130ee1ea-b4cf-412f-940f-56ef223bdc81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30dc6521866a4e4e895c79b2c455d156'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:44.439448 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa79255-57ea-4e51-bace-c174312faf30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:44.442573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa79255-57ea-4e51-bace-c174312faf30 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:44.461592 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 916/1859] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:44.463016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59460183-543c-4ed3-b143-8a613cafe5e1 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:44.463468 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59460183-543c-4ed3-b143-8a613cafe5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:44.463807 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59460183-543c-4ed3-b143-8a613cafe5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:44.467593 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-130ee1ea-b4cf-412f-940f-56ef223bdc81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30dc6521866a4e4e895c79b2c455d156'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:44.483478 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-130ee1ea-b4cf-412f-940f-56ef223bdc81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30dc6521866a4e4e895c79b2c455d156'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:44.498846 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-59460183-543c-4ed3-b143-8a613cafe5e1 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:44.500058 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-59460183-543c-4ed3-b143-8a613cafe5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:44.508997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 944/1860] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:44 2022] DELETE /identity/v3/users/30dc6521866a4e4e895c79b2c455d156 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:44.513806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 917/1861] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:44.514649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59460183-543c-4ed3-b143-8a613cafe5e1 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:44.516230 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-59460183-543c-4ed3-b143-8a613cafe5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:44.522083 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ee1ea-b4cf-412f-940f-56ef223bdc81 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:44.527977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-130ee1ea-b4cf-412f-940f-56ef223bdc81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:44.530470 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59460183-543c-4ed3-b143-8a613cafe5e1 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:44.541619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:44.643093 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:44.669407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bd5edc-4c91-494c-bc20-78db2f4a9060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:44.671083 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd5edc-4c91-494c-bc20-78db2f4a9060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:44.671464 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd5edc-4c91-494c-bc20-78db2f4a9060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:44.672131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bd5edc-4c91-494c-bc20-78db2f4a9060 admin admin] PATH_INFO: `/v3/users/92877069407f4745ad5f7620a1a0d4a5` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:44.679388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd5edc-4c91-494c-bc20-78db2f4a9060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92877069407f4745ad5f7620a1a0d4a5)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:44.684844 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bd5edc-4c91-494c-bc20-78db2f4a9060 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:44.760030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ee1ea-b4cf-412f-940f-56ef223bdc81 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:44.792440 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee123425-f220-4379-9c38-e0a7ff54bba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:44.793259 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee123425-f220-4379-9c38-e0a7ff54bba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:44.793610 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee123425-f220-4379-9c38-e0a7ff54bba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:44.793967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee123425-f220-4379-9c38-e0a7ff54bba2 admin admin] PATH_INFO: `/v3/projects/f96e2e42bc944b568ceb1d430c855c75/users/300e88af89f24205adcb68ea4fef32cd/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:44.849924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee123425-f220-4379-9c38-e0a7ff54bba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f96e2e42bc944b568ceb1d430c855c75, user_id=300e88af89f24205adcb68ea4fef32cd, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:44.854216 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee123425-f220-4379-9c38-e0a7ff54bba2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:44.873393 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e1bd5edc-4c91-494c-bc20-78db2f4a9060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92877069407f4745ad5f7620a1a0d4a5'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:44.874252 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e1bd5edc-4c91-494c-bc20-78db2f4a9060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92877069407f4745ad5f7620a1a0d4a5'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:44.903122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e1bd5edc-4c91-494c-bc20-78db2f4a9060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92877069407f4745ad5f7620a1a0d4a5'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:44.914842 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e1bd5edc-4c91-494c-bc20-78db2f4a9060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92877069407f4745ad5f7620a1a0d4a5'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:44.918293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e1bd5edc-4c91-494c-bc20-78db2f4a9060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92877069407f4745ad5f7620a1a0d4a5'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:44.927954 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 945/1862] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:44 2022] PUT /identity/v3/projects/f96e2e42bc944b568ceb1d430c855c75/users/300e88af89f24205adcb68ea4fef32cd/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:44.938176 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b51018-cf41-442a-a5fd-b4e3cf21bef7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:44.938459 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b51018-cf41-442a-a5fd-b4e3cf21bef7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:44.938759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b51018-cf41-442a-a5fd-b4e3cf21bef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:44.952259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 918/1863] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:44 2022] DELETE /identity/v3/users/92877069407f4745ad5f7620a1a0d4a5 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:44.952918 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e9b85-0b36-4994-8f9f-48a1b6744804 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:44.953201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e9b85-0b36-4994-8f9f-48a1b6744804 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:44.953475 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e9b85-0b36-4994-8f9f-48a1b6744804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:44.972125 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e5b51018-cf41-442a-a5fd-b4e3cf21bef7 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:44.976517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e5b51018-cf41-442a-a5fd-b4e3cf21bef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:44.986827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-e92e9b85-0b36-4994-8f9f-48a1b6744804 None None] MFA Rules not processed for user `300e88af89f24205adcb68ea4fef32cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:44.988202 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e92e9b85-0b36-4994-8f9f-48a1b6744804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:45.138974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 919/1864] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:45.138974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b9f9e-88bd-4ddb-902a-35a2b9cde44a None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:45.138974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b9f9e-88bd-4ddb-902a-35a2b9cde44a None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:45.138974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b9f9e-88bd-4ddb-902a-35a2b9cde44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:45.149901 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 946/1865] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:45.150945 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b51018-cf41-442a-a5fd-b4e3cf21bef7 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:45.153851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e5b51018-cf41-442a-a5fd-b4e3cf21bef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:45.175103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-cd7b9f9e-88bd-4ddb-902a-35a2b9cde44a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:45.177587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-cd7b9f9e-88bd-4ddb-902a-35a2b9cde44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:45.185353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b51018-cf41-442a-a5fd-b4e3cf21bef7 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:45.192145 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 920/1866] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:45.195622 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b9f9e-88bd-4ddb-902a-35a2b9cde44a None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:45.195622 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-cd7b9f9e-88bd-4ddb-902a-35a2b9cde44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:45.195751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2ea61-2a70-4577-ac07-fb751d981ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:45.201993 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2ea61-2a70-4577-ac07-fb751d981ff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:45.204579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2ea61-2a70-4577-ac07-fb751d981ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:45.209032 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2ea61-2a70-4577-ac07-fb751d981ff1 admin admin] PATH_INFO: `/v3/projects/c29c1587608c40108e7785e9150f4e46` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:45.210750 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2ea61-2a70-4577-ac07-fb751d981ff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c29c1587608c40108e7785e9150f4e46)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:45.213089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2ea61-2a70-4577-ac07-fb751d981ff1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:45.231539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b9f9e-88bd-4ddb-902a-35a2b9cde44a None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:45.240617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf78947-3823-4e3f-9386-3b19910ffe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:45.241385 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf78947-3823-4e3f-9386-3b19910ffe63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:45.241673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf78947-3823-4e3f-9386-3b19910ffe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:45.241972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf78947-3823-4e3f-9386-3b19910ffe63 admin admin] PATH_INFO: `/v3/users/7e3af12bd8f04116b0aeb3e39cb3b208` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:45.243282 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf78947-3823-4e3f-9386-3b19910ffe63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e3af12bd8f04116b0aeb3e39cb3b208)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:45.245913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf78947-3823-4e3f-9386-3b19910ffe63 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:45.248665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:45.322504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-bdf78947-3823-4e3f-9386-3b19910ffe63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e3af12bd8f04116b0aeb3e39cb3b208'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:45.323472 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-bdf78947-3823-4e3f-9386-3b19910ffe63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e3af12bd8f04116b0aeb3e39cb3b208'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:45.327149 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-18a2ea61-2a70-4577-ac07-fb751d981ff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c29c1587608c40108e7785e9150f4e46', 'request_id': 'req-18a2ea61-2a70-4577-ac07-fb751d981ff1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:45.337909 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-bdf78947-3823-4e3f-9386-3b19910ffe63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e3af12bd8f04116b0aeb3e39cb3b208'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:45.338200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-18a2ea61-2a70-4577-ac07-fb751d981ff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c29c1587608c40108e7785e9150f4e46', 'request_id': 'req-18a2ea61-2a70-4577-ac07-fb751d981ff1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:45.349421 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-18a2ea61-2a70-4577-ac07-fb751d981ff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c29c1587608c40108e7785e9150f4e46', 'request_id': 'req-18a2ea61-2a70-4577-ac07-fb751d981ff1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:45.350595 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-bdf78947-3823-4e3f-9386-3b19910ffe63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e3af12bd8f04116b0aeb3e39cb3b208'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:45.351671 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-bdf78947-3823-4e3f-9386-3b19910ffe63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e3af12bd8f04116b0aeb3e39cb3b208'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:45.368307 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 921/1867] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:45 2022] DELETE /identity/v3/users/7e3af12bd8f04116b0aeb3e39cb3b208 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:45.368965 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf78947-3823-4e3f-9386-3b19910ffe63 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:45.370307 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-bdf78947-3823-4e3f-9386-3b19910ffe63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:45.374292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-18a2ea61-2a70-4577-ac07-fb751d981ff1 admin admin] The token cache is being invalidate because project c29c1587608c40108e7785e9150f4e46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:45.375034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-18a2ea61-2a70-4577-ac07-fb751d981ff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:45.376394 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-18a2ea61-2a70-4577-ac07-fb751d981ff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:45.381528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 947/1868] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:45 2022] DELETE /identity/v3/projects/c29c1587608c40108e7785e9150f4e46 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:45.382988 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2ea61-2a70-4577-ac07-fb751d981ff1 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:45.385446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-18a2ea61-2a70-4577-ac07-fb751d981ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:45.451922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:45.472143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf78947-3823-4e3f-9386-3b19910ffe63 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:45.479744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35917db4-378c-428c-9ac6-a35fc6b3696d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:45.480705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35917db4-378c-428c-9ac6-a35fc6b3696d admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:45.481144 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35917db4-378c-428c-9ac6-a35fc6b3696d admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:45.481580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35917db4-378c-428c-9ac6-a35fc6b3696d admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:45.482641 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35917db4-378c-428c-9ac6-a35fc6b3696d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:45.485234 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2ea61-2a70-4577-ac07-fb751d981ff1 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:45.486107 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35917db4-378c-428c-9ac6-a35fc6b3696d admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:45.490723 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a906af-d6d4-43f0-8fb6-17c9ed7abc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:45.491338 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a906af-d6d4-43f0-8fb6-17c9ed7abc0b admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:45.491613 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a906af-d6d4-43f0-8fb6-17c9ed7abc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:45.491882 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a906af-d6d4-43f0-8fb6-17c9ed7abc0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:45.492636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a906af-d6d4-43f0-8fb6-17c9ed7abc0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:45.492938 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a906af-d6d4-43f0-8fb6-17c9ed7abc0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:45.494547 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a906af-d6d4-43f0-8fb6-17c9ed7abc0b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:45.508201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 948/1869] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:45.509328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a906af-d6d4-43f0-8fb6-17c9ed7abc0b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:45.510905 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e1a906af-d6d4-43f0-8fb6-17c9ed7abc0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:45.546073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 922/1870] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:45 2022] POST /identity/v3/projects => generated 357 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:45.546073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3b04a-6f8d-46fc-9e1e-fa194c497095 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:45.546370 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3b04a-6f8d-46fc-9e1e-fa194c497095 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:45.546660 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3b04a-6f8d-46fc-9e1e-fa194c497095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:45.576876 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-2af3b04a-6f8d-46fc-9e1e-fa194c497095 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:45.578372 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2af3b04a-6f8d-46fc-9e1e-fa194c497095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:45.586970 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a906af-d6d4-43f0-8fb6-17c9ed7abc0b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:45.654827 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520b898-263b-460f-9586-abe091e853ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:45.655383 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520b898-263b-460f-9586-abe091e853ef service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:45.655666 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520b898-263b-460f-9586-abe091e853ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:45.655944 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f520b898-263b-460f-9586-abe091e853ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:45.656090 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 923/1871] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:45.657894 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f520b898-263b-460f-9586-abe091e853ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:45.658196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db8c96-058d-43e8-87b4-c4fdb41fa539 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:45.658693 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db8c96-058d-43e8-87b4-c4fdb41fa539 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:45.659205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db8c96-058d-43e8-87b4-c4fdb41fa539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:45.682509 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:45.687069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520b898-263b-460f-9586-abe091e853ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:45.689433 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f520b898-263b-460f-9586-abe091e853ef service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:45.690827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-74db8c96-058d-43e8-87b4-c4fdb41fa539 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:45.693678 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-74db8c96-058d-43e8-87b4-c4fdb41fa539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:45.705944 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 949/1872] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:45.707478 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520b898-263b-460f-9586-abe091e853ef service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:45.720505 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 924/1873] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:45.720505 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db8c96-058d-43e8-87b4-c4fdb41fa539 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:45.720505 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-74db8c96-058d-43e8-87b4-c4fdb41fa539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:45.726300 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f520b898-263b-460f-9586-abe091e853ef service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:45.729614 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db8c96-058d-43e8-87b4-c4fdb41fa539 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:45.733384 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90c06b-7d1d-4e02-b350-cf4a5a6175e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:45.734462 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90c06b-7d1d-4e02-b350-cf4a5a6175e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:45.735253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90c06b-7d1d-4e02-b350-cf4a5a6175e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:45.735847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90c06b-7d1d-4e02-b350-cf4a5a6175e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:45.741448 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90c06b-7d1d-4e02-b350-cf4a5a6175e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:45.741550 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90c06b-7d1d-4e02-b350-cf4a5a6175e3 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:45.745941 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de1502-e1c5-4da2-a348-5a30a1dcd1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:45.746777 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de1502-e1c5-4da2-a348-5a30a1dcd1f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:45.747522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de1502-e1c5-4da2-a348-5a30a1dcd1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:45.748076 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de1502-e1c5-4da2-a348-5a30a1dcd1f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:45.749403 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de1502-e1c5-4da2-a348-5a30a1dcd1f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:45.752063 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de1502-e1c5-4da2-a348-5a30a1dcd1f4 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:45.778055 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 925/1874] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:45 2022] POST /identity/v3/users => generated 285 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:45.778900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de1502-e1c5-4da2-a348-5a30a1dcd1f4 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:45.780558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-48de1502-e1c5-4da2-a348-5a30a1dcd1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:45.797567 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de1502-e1c5-4da2-a348-5a30a1dcd1f4 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:45.802179 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72108c20-1df5-43a8-970a-89ee14031fd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:45.802815 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72108c20-1df5-43a8-970a-89ee14031fd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:45.803103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72108c20-1df5-43a8-970a-89ee14031fd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:45.803393 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72108c20-1df5-43a8-970a-89ee14031fd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:45.819561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 950/1875] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:45 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:45.822630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1688a-2b9b-4d08-a18a-e2c319cd2ace None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:45.824022 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1688a-2b9b-4d08-a18a-e2c319cd2ace None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:45.824835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1688a-2b9b-4d08-a18a-e2c319cd2ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:45.830280 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72108c20-1df5-43a8-970a-89ee14031fd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:45.832539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72108c20-1df5-43a8-970a-89ee14031fd8 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:45.852815 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 926/1876] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:45.853846 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72108c20-1df5-43a8-970a-89ee14031fd8 service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:45.861922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-20c1688a-2b9b-4d08-a18a-e2c319cd2ace None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:45.865215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-20c1688a-2b9b-4d08-a18a-e2c319cd2ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:45.867101 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72108c20-1df5-43a8-970a-89ee14031fd8 service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:45.939518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143df5a6-c973-4dd5-b2e8-d42ba20f0152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:45.940194 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143df5a6-c973-4dd5-b2e8-d42ba20f0152 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:45.940194 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143df5a6-c973-4dd5-b2e8-d42ba20f0152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:45.940449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143df5a6-c973-4dd5-b2e8-d42ba20f0152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:45.942889 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143df5a6-c973-4dd5-b2e8-d42ba20f0152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:45.944496 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143df5a6-c973-4dd5-b2e8-d42ba20f0152 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:45.975512 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 927/1877] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:45.976271 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143df5a6-c973-4dd5-b2e8-d42ba20f0152 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:45.999575 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143df5a6-c973-4dd5-b2e8-d42ba20f0152 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:46.012059 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25069b99-9f33-4c1e-b055-08db46c979a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:46.012732 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25069b99-9f33-4c1e-b055-08db46c979a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:46.013018 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25069b99-9f33-4c1e-b055-08db46c979a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:46.013402 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25069b99-9f33-4c1e-b055-08db46c979a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:46.014080 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25069b99-9f33-4c1e-b055-08db46c979a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:46.016013 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25069b99-9f33-4c1e-b055-08db46c979a7 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:46.056642 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 951/1878] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:46.058102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1688a-2b9b-4d08-a18a-e2c319cd2ace None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:46.061216 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 928/1879] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:45 2022] POST /identity/v3/users => generated 291 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:46.062081 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25069b99-9f33-4c1e-b055-08db46c979a7 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:46.070508 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1688a-2b9b-4d08-a18a-e2c319cd2ace None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:46.076559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69c6e6-c987-4beb-953d-59ff71c3f750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:46.077384 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69c6e6-c987-4beb-953d-59ff71c3f750 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:46.077758 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69c6e6-c987-4beb-953d-59ff71c3f750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:46.078151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69c6e6-c987-4beb-953d-59ff71c3f750 admin admin] PATH_INFO: `/v3/projects/2a95ba9f075a4b5aa0422de7ec044632/users/37adc9497b8347b79e439e410fe68718/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:46.090115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25069b99-9f33-4c1e-b055-08db46c979a7 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:46.091524 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:46.103238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69c6e6-c987-4beb-953d-59ff71c3f750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a95ba9f075a4b5aa0422de7ec044632, user_id=37adc9497b8347b79e439e410fe68718, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:46.106552 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc69c6e6-c987-4beb-953d-59ff71c3f750 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:46.110599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bec2b5-83af-4749-85a8-105a9cb9e013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:46.111534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bec2b5-83af-4749-85a8-105a9cb9e013 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:46.112620 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bec2b5-83af-4749-85a8-105a9cb9e013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:46.113245 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bec2b5-83af-4749-85a8-105a9cb9e013 admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:46.115690 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bec2b5-83af-4749-85a8-105a9cb9e013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:46.118400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bec2b5-83af-4749-85a8-105a9cb9e013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:46.123916 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bec2b5-83af-4749-85a8-105a9cb9e013 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:46.126791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 952/1880] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:46 2022] PUT /identity/v3/projects/2a95ba9f075a4b5aa0422de7ec044632/users/37adc9497b8347b79e439e410fe68718/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:46.127872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69c6e6-c987-4beb-953d-59ff71c3f750 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:46.158635 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 929/1881] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:46.162414 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bec2b5-83af-4749-85a8-105a9cb9e013 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:46.185815 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bec2b5-83af-4749-85a8-105a9cb9e013 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:46.230551 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc69c6e6-c987-4beb-953d-59ff71c3f750 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:46.236776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840240c7-2322-4eb0-8c35-f58d0f4d322f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:46.237430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840240c7-2322-4eb0-8c35-f58d0f4d322f admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:46.237712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840240c7-2322-4eb0-8c35-f58d0f4d322f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:46.238679 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840240c7-2322-4eb0-8c35-f58d0f4d322f admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:46.239450 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840240c7-2322-4eb0-8c35-f58d0f4d322f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:46.241342 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840240c7-2322-4eb0-8c35-f58d0f4d322f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:46.260412 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 953/1882] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:46.260412 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840240c7-2322-4eb0-8c35-f58d0f4d322f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:46.279810 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840240c7-2322-4eb0-8c35-f58d0f4d322f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:46.286713 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf7ccf-f67c-47c6-8255-40f4ae40cb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:46.287519 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf7ccf-f67c-47c6-8255-40f4ae40cb53 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:46.288638 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf7ccf-f67c-47c6-8255-40f4ae40cb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:46.288638 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf7ccf-f67c-47c6-8255-40f4ae40cb53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:46.292724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf7ccf-f67c-47c6-8255-40f4ae40cb53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:46.292874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120f5bc-55e9-4ec5-9c34-849dbab1889d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:46.292984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf7ccf-f67c-47c6-8255-40f4ae40cb53 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:46.293061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120f5bc-55e9-4ec5-9c34-849dbab1889d admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:46.293061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120f5bc-55e9-4ec5-9c34-849dbab1889d admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:46.293061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120f5bc-55e9-4ec5-9c34-849dbab1889d admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:46.293893 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120f5bc-55e9-4ec5-9c34-849dbab1889d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:46.297848 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120f5bc-55e9-4ec5-9c34-849dbab1889d admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:46.332790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 930/1883] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:46.333910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120f5bc-55e9-4ec5-9c34-849dbab1889d admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:46.358001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120f5bc-55e9-4ec5-9c34-849dbab1889d admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:46.369966 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 954/1884] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:46 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:46.370933 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf7ccf-f67c-47c6-8255-40f4ae40cb53 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:46.384895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe6197-c0ab-48ce-ba74-cff50c9c0295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:46.385553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe6197-c0ab-48ce-ba74-cff50c9c0295 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:46.386499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe6197-c0ab-48ce-ba74-cff50c9c0295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:46.386499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe6197-c0ab-48ce-ba74-cff50c9c0295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:46.389261 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe6197-c0ab-48ce-ba74-cff50c9c0295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:46.396089 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe6197-c0ab-48ce-ba74-cff50c9c0295 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:46.420331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 931/1885] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:46.421579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe6197-c0ab-48ce-ba74-cff50c9c0295 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:46.448535 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe6197-c0ab-48ce-ba74-cff50c9c0295 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:46.456267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02ef53-2532-448b-af72-1e0442404020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:46.457747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf7ccf-f67c-47c6-8255-40f4ae40cb53 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:46.459145 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02ef53-2532-448b-af72-1e0442404020 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:46.459435 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02ef53-2532-448b-af72-1e0442404020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:46.459712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02ef53-2532-448b-af72-1e0442404020 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:46.460476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02ef53-2532-448b-af72-1e0442404020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:46.462784 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02ef53-2532-448b-af72-1e0442404020 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:46.464660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44a85c-6ac7-447c-82c6-3907d4c023e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:46.465537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44a85c-6ac7-447c-82c6-3907d4c023e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:46.466005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44a85c-6ac7-447c-82c6-3907d4c023e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:46.466467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44a85c-6ac7-447c-82c6-3907d4c023e6 admin admin] PATH_INFO: `/v3/projects/2a95ba9f075a4b5aa0422de7ec044632/users/37adc9497b8347b79e439e410fe68718/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:46.469300 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44a85c-6ac7-447c-82c6-3907d4c023e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a95ba9f075a4b5aa0422de7ec044632, user_id=37adc9497b8347b79e439e410fe68718, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:46.472627 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44a85c-6ac7-447c-82c6-3907d4c023e6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:46.496499 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 955/1886] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:46 2022] PUT /identity/v3/projects/2a95ba9f075a4b5aa0422de7ec044632/users/37adc9497b8347b79e439e410fe68718/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:46.496499 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44a85c-6ac7-447c-82c6-3907d4c023e6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:46.496499 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ea44a85c-6ac7-447c-82c6-3907d4c023e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:46.496847 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 932/1887] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:46 2022] POST /identity/v3/users => generated 292 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:46.496847 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02ef53-2532-448b-af72-1e0442404020 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:46.502245 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:46.510722 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02ef53-2532-448b-af72-1e0442404020 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:46.564638 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:46.575073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44a85c-6ac7-447c-82c6-3907d4c023e6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:46.580739 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe66ab-bd26-4b95-a283-15f4bcc7591d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:46.581592 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe66ab-bd26-4b95-a283-15f4bcc7591d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:46.582455 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe66ab-bd26-4b95-a283-15f4bcc7591d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:46.582799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe66ab-bd26-4b95-a283-15f4bcc7591d admin admin] PATH_INFO: `/v3/projects/5f1aed57aacd42418993d743b59c68cb` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:46.584055 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe66ab-bd26-4b95-a283-15f4bcc7591d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f1aed57aacd42418993d743b59c68cb)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:46.586205 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe66ab-bd26-4b95-a283-15f4bcc7591d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:46.617747 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65bfad-c253-4d4c-99dd-0eb31b1f4ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:46.618539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65bfad-c253-4d4c-99dd-0eb31b1f4ea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:46.618977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65bfad-c253-4d4c-99dd-0eb31b1f4ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:46.619193 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65bfad-c253-4d4c-99dd-0eb31b1f4ea3 admin admin] PATH_INFO: `/v3/projects/400924b74fdc417bab2a1e2b7cb18579/users/5eb703852bdb4feeba02443c742073df/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:46.637557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65bfad-c253-4d4c-99dd-0eb31b1f4ea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=400924b74fdc417bab2a1e2b7cb18579, user_id=5eb703852bdb4feeba02443c742073df, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:46.641492 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65bfad-c253-4d4c-99dd-0eb31b1f4ea3 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:46.649044 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-02fe66ab-bd26-4b95-a283-15f4bcc7591d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f1aed57aacd42418993d743b59c68cb', 'request_id': 'req-02fe66ab-bd26-4b95-a283-15f4bcc7591d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:46.655802 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-02fe66ab-bd26-4b95-a283-15f4bcc7591d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f1aed57aacd42418993d743b59c68cb', 'request_id': 'req-02fe66ab-bd26-4b95-a283-15f4bcc7591d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:46.656963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 933/1888] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:46 2022] PUT /identity/v3/projects/400924b74fdc417bab2a1e2b7cb18579/users/5eb703852bdb4feeba02443c742073df/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:46.657930 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65bfad-c253-4d4c-99dd-0eb31b1f4ea3 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:46.663795 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-02fe66ab-bd26-4b95-a283-15f4bcc7591d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f1aed57aacd42418993d743b59c68cb', 'request_id': 'req-02fe66ab-bd26-4b95-a283-15f4bcc7591d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:46.677699 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-02fe66ab-bd26-4b95-a283-15f4bcc7591d admin admin] The token cache is being invalidate because project 5f1aed57aacd42418993d743b59c68cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:46.677994 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-02fe66ab-bd26-4b95-a283-15f4bcc7591d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:46.678637 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-02fe66ab-bd26-4b95-a283-15f4bcc7591d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:46.680217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 956/1889] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:46 2022] DELETE /identity/v3/projects/5f1aed57aacd42418993d743b59c68cb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:46.681380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a93c67-a80b-4ed9-9d87-85048bf4fa44 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:46.681696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a93c67-a80b-4ed9-9d87-85048bf4fa44 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:46.681980 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a93c67-a80b-4ed9-9d87-85048bf4fa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:46.710562 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-60a93c67-a80b-4ed9-9d87-85048bf4fa44 None None] MFA Rules not processed for user `37adc9497b8347b79e439e410fe68718`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:46.711918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-60a93c67-a80b-4ed9-9d87-85048bf4fa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:46.730050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65bfad-c253-4d4c-99dd-0eb31b1f4ea3 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:46.735786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c81f9c-97ea-409d-8538-5866d9719b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:46.736590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c81f9c-97ea-409d-8538-5866d9719b9f admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:46.736873 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c81f9c-97ea-409d-8538-5866d9719b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:46.737178 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c81f9c-97ea-409d-8538-5866d9719b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:46.738406 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c81f9c-97ea-409d-8538-5866d9719b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:46.739997 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c81f9c-97ea-409d-8538-5866d9719b9f admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:46.750425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 934/1890] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:46.751246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c81f9c-97ea-409d-8538-5866d9719b9f admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:46.752995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-07c81f9c-97ea-409d-8538-5866d9719b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:46.767140 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c81f9c-97ea-409d-8538-5866d9719b9f admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:46.772209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55484bdb-45db-4b40-89b3-93e0cd7793fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:46.772913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55484bdb-45db-4b40-89b3-93e0cd7793fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:46.773206 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55484bdb-45db-4b40-89b3-93e0cd7793fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:46.773491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55484bdb-45db-4b40-89b3-93e0cd7793fd admin admin] PATH_INFO: `/v3/projects/3b6af4ad150f4e5f9a8d925244f5c502` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:46.774850 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55484bdb-45db-4b40-89b3-93e0cd7793fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b6af4ad150f4e5f9a8d925244f5c502)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:46.776861 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55484bdb-45db-4b40-89b3-93e0cd7793fd admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:46.791716 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 957/1891] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:46 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:46.792878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7189ee1-b1b8-4100-a518-e02acf4cabac None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:46.793163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7189ee1-b1b8-4100-a518-e02acf4cabac None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:46.793439 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7189ee1-b1b8-4100-a518-e02acf4cabac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:46.828065 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a7189ee1-b1b8-4100-a518-e02acf4cabac None None] MFA Rules not processed for user `5eb703852bdb4feeba02443c742073df`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:46.829636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a7189ee1-b1b8-4100-a518-e02acf4cabac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:46.842407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-55484bdb-45db-4b40-89b3-93e0cd7793fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b6af4ad150f4e5f9a8d925244f5c502', 'request_id': 'req-55484bdb-45db-4b40-89b3-93e0cd7793fd'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:46.849485 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-55484bdb-45db-4b40-89b3-93e0cd7793fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b6af4ad150f4e5f9a8d925244f5c502', 'request_id': 'req-55484bdb-45db-4b40-89b3-93e0cd7793fd'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:46.856501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-55484bdb-45db-4b40-89b3-93e0cd7793fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b6af4ad150f4e5f9a8d925244f5c502', 'request_id': 'req-55484bdb-45db-4b40-89b3-93e0cd7793fd'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:46.873823 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-55484bdb-45db-4b40-89b3-93e0cd7793fd admin admin] The token cache is being invalidate because project 3b6af4ad150f4e5f9a8d925244f5c502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:46.874237 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-55484bdb-45db-4b40-89b3-93e0cd7793fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:46.874952 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-55484bdb-45db-4b40-89b3-93e0cd7793fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:46.876814 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 935/1892] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:46 2022] DELETE /identity/v3/projects/3b6af4ad150f4e5f9a8d925244f5c502 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:46.877443 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55484bdb-45db-4b40-89b3-93e0cd7793fd admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:46.881892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-55484bdb-45db-4b40-89b3-93e0cd7793fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:46.888175 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:46.906252 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:46.910769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 958/1893] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:46.911515 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7189ee1-b1b8-4100-a518-e02acf4cabac None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:46.914054 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a7189ee1-b1b8-4100-a518-e02acf4cabac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:46.961830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55484bdb-45db-4b40-89b3-93e0cd7793fd admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:46.971151 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c414f9-8cf0-489b-828a-4d9b9f6d1038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:46.971810 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c414f9-8cf0-489b-828a-4d9b9f6d1038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:46.972092 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c414f9-8cf0-489b-828a-4d9b9f6d1038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:46.973032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c414f9-8cf0-489b-828a-4d9b9f6d1038 admin admin] PATH_INFO: `/v3/users/1160506537f84a77a88f5bc323025e3c` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:46.974624 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c414f9-8cf0-489b-828a-4d9b9f6d1038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1160506537f84a77a88f5bc323025e3c)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:46.977079 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c414f9-8cf0-489b-828a-4d9b9f6d1038 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:46.990494 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7189ee1-b1b8-4100-a518-e02acf4cabac None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:46.995312 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0010c57-0e04-497c-aeee-74b5287311be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:46.995937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0010c57-0e04-497c-aeee-74b5287311be admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:46.996220 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0010c57-0e04-497c-aeee-74b5287311be admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:46.996661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0010c57-0e04-497c-aeee-74b5287311be admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:46.997378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0010c57-0e04-497c-aeee-74b5287311be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:46.998981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0010c57-0e04-497c-aeee-74b5287311be admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:47.010544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 959/1894] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:47.011437 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0010c57-0e04-497c-aeee-74b5287311be admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:47.013388 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f0010c57-0e04-497c-aeee-74b5287311be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:47.026530 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f1c414f9-8cf0-489b-828a-4d9b9f6d1038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1160506537f84a77a88f5bc323025e3c'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:47.027310 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f1c414f9-8cf0-489b-828a-4d9b9f6d1038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1160506537f84a77a88f5bc323025e3c'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:47.040732 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f1c414f9-8cf0-489b-828a-4d9b9f6d1038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1160506537f84a77a88f5bc323025e3c'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:47.048402 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f1c414f9-8cf0-489b-828a-4d9b9f6d1038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1160506537f84a77a88f5bc323025e3c'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:47.049142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f1c414f9-8cf0-489b-828a-4d9b9f6d1038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1160506537f84a77a88f5bc323025e3c'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:47.062484 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 936/1895] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:46 2022] DELETE /identity/v3/users/1160506537f84a77a88f5bc323025e3c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:47.063299 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c414f9-8cf0-489b-828a-4d9b9f6d1038 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:47.064694 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f1c414f9-8cf0-489b-828a-4d9b9f6d1038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:47.077670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0010c57-0e04-497c-aeee-74b5287311be admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:47.137854 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c414f9-8cf0-489b-828a-4d9b9f6d1038 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:47.144285 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34170d32-2f56-4829-9ed5-f6111bb93e24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:47.145148 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34170d32-2f56-4829-9ed5-f6111bb93e24 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:47.145260 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9336fc3-ebbb-4690-924c-11913dad425b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:47.145528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34170d32-2f56-4829-9ed5-f6111bb93e24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:47.146092 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9336fc3-ebbb-4690-924c-11913dad425b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:47.146211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34170d32-2f56-4829-9ed5-f6111bb93e24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:47.146291 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9336fc3-ebbb-4690-924c-11913dad425b admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:47.146631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9336fc3-ebbb-4690-924c-11913dad425b admin admin] PATH_INFO: `/v3/users/ae76dcf4b8e7452a8fb04b3e23195f04` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:47.147804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-34170d32-2f56-4829-9ed5-f6111bb93e24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:47.147904 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9336fc3-ebbb-4690-924c-11913dad425b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae76dcf4b8e7452a8fb04b3e23195f04)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:47.149823 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9336fc3-ebbb-4690-924c-11913dad425b admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:47.185072 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:47.211185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a9336fc3-ebbb-4690-924c-11913dad425b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae76dcf4b8e7452a8fb04b3e23195f04'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:47.212099 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a9336fc3-ebbb-4690-924c-11913dad425b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae76dcf4b8e7452a8fb04b3e23195f04'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:47.229230 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a9336fc3-ebbb-4690-924c-11913dad425b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae76dcf4b8e7452a8fb04b3e23195f04'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:47.239626 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a9336fc3-ebbb-4690-924c-11913dad425b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae76dcf4b8e7452a8fb04b3e23195f04'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:47.241420 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a9336fc3-ebbb-4690-924c-11913dad425b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae76dcf4b8e7452a8fb04b3e23195f04'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:47.245405 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34170d32-2f56-4829-9ed5-f6111bb93e24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:47.246862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34170d32-2f56-4829-9ed5-f6111bb93e24 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:47.258602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 960/1896] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:47.259334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34170d32-2f56-4829-9ed5-f6111bb93e24 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:47.260584 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 937/1897] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:47 2022] DELETE /identity/v3/users/ae76dcf4b8e7452a8fb04b3e23195f04 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:47.261614 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9336fc3-ebbb-4690-924c-11913dad425b admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:47.263768 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a9336fc3-ebbb-4690-924c-11913dad425b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:47.263858 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-34170d32-2f56-4829-9ed5-f6111bb93e24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:47.273640 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:47.280824 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34170d32-2f56-4829-9ed5-f6111bb93e24 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:47.378242 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9336fc3-ebbb-4690-924c-11913dad425b admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:47.389043 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84307092-c2ac-4089-bd54-134b9682f789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:47.390964 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84307092-c2ac-4089-bd54-134b9682f789 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:47.392268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84307092-c2ac-4089-bd54-134b9682f789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:47.393181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84307092-c2ac-4089-bd54-134b9682f789 admin admin] PATH_INFO: `/v3/projects/a584d43fb0de43f89a700ad037088d6d/users/0de151f6b10e4e2b8c522cb578d4f1fc/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:47.416240 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59192ec8-96ec-4fa6-a11b-3fdc0e7502de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:47.417008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59192ec8-96ec-4fa6-a11b-3fdc0e7502de admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:47.417298 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59192ec8-96ec-4fa6-a11b-3fdc0e7502de admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:47.417636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59192ec8-96ec-4fa6-a11b-3fdc0e7502de admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:47.419424 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59192ec8-96ec-4fa6-a11b-3fdc0e7502de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:47.425028 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59192ec8-96ec-4fa6-a11b-3fdc0e7502de admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:47.432813 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84307092-c2ac-4089-bd54-134b9682f789 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a584d43fb0de43f89a700ad037088d6d, user_id=0de151f6b10e4e2b8c522cb578d4f1fc, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:47.435868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84307092-c2ac-4089-bd54-134b9682f789 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:47.484141 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 938/1898] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:47 2022] PUT /identity/v3/projects/a584d43fb0de43f89a700ad037088d6d/users/0de151f6b10e4e2b8c522cb578d4f1fc/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:47.486321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84307092-c2ac-4089-bd54-134b9682f789 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:47.490638 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-84307092-c2ac-4089-bd54-134b9682f789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:47.518023 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 961/1899] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:47 2022] POST /identity/v3/projects => generated 379 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:47.519080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59192ec8-96ec-4fa6-a11b-3fdc0e7502de admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:47.521552 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-59192ec8-96ec-4fa6-a11b-3fdc0e7502de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:47.598341 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84307092-c2ac-4089-bd54-134b9682f789 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:47.617524 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59192ec8-96ec-4fa6-a11b-3fdc0e7502de admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:47.625325 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba8782-511f-457c-89b4-0bcdbf15e693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:47.626310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba8782-511f-457c-89b4-0bcdbf15e693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:47.626624 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba8782-511f-457c-89b4-0bcdbf15e693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:47.626854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba8782-511f-457c-89b4-0bcdbf15e693 admin admin] PATH_INFO: `/v3/projects/1a9bb95b7aea4c87bb2d31942286f99b` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:47.629931 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba8782-511f-457c-89b4-0bcdbf15e693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a9bb95b7aea4c87bb2d31942286f99b)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:47.633540 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba8782-511f-457c-89b4-0bcdbf15e693 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:47.667044 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:47.703861 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851194f4-c12e-4dd0-a898-2dcb3a5cd148 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:47.704615 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851194f4-c12e-4dd0-a898-2dcb3a5cd148 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:47.704912 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851194f4-c12e-4dd0-a898-2dcb3a5cd148 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:47.705192 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851194f4-c12e-4dd0-a898-2dcb3a5cd148 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:47.707841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-851194f4-c12e-4dd0-a898-2dcb3a5cd148 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:47.714870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c6ba8782-511f-457c-89b4-0bcdbf15e693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9bb95b7aea4c87bb2d31942286f99b', 'request_id': 'req-c6ba8782-511f-457c-89b4-0bcdbf15e693'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:47.721533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c6ba8782-511f-457c-89b4-0bcdbf15e693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9bb95b7aea4c87bb2d31942286f99b', 'request_id': 'req-c6ba8782-511f-457c-89b4-0bcdbf15e693'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:47.728685 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c6ba8782-511f-457c-89b4-0bcdbf15e693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9bb95b7aea4c87bb2d31942286f99b', 'request_id': 'req-c6ba8782-511f-457c-89b4-0bcdbf15e693'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:47.742657 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c6ba8782-511f-457c-89b4-0bcdbf15e693 admin admin] The token cache is being invalidate because project 1a9bb95b7aea4c87bb2d31942286f99b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:47.743033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c6ba8782-511f-457c-89b4-0bcdbf15e693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:47.743684 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-c6ba8782-511f-457c-89b4-0bcdbf15e693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:47.745492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 962/1900] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:47 2022] DELETE /identity/v3/projects/1a9bb95b7aea4c87bb2d31942286f99b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:47.746569 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577bc68-6149-4131-bf70-105fc3646a6d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:47.746848 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577bc68-6149-4131-bf70-105fc3646a6d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:47.747126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577bc68-6149-4131-bf70-105fc3646a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:47.778136 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0577bc68-6149-4131-bf70-105fc3646a6d None None] MFA Rules not processed for user `0de151f6b10e4e2b8c522cb578d4f1fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:47.779374 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0577bc68-6149-4131-bf70-105fc3646a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:47.785152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:47.787583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851194f4-c12e-4dd0-a898-2dcb3a5cd148 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:47.790770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851194f4-c12e-4dd0-a898-2dcb3a5cd148 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:47.801858 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 939/1901] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:47.802963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851194f4-c12e-4dd0-a898-2dcb3a5cd148 service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:47.804490 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-851194f4-c12e-4dd0-a898-2dcb3a5cd148 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:47.822638 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851194f4-c12e-4dd0-a898-2dcb3a5cd148 service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:47.872603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 963/1902] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:47.874095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577bc68-6149-4131-bf70-105fc3646a6d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:47.875681 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0577bc68-6149-4131-bf70-105fc3646a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:47.908173 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21d24b-8613-4413-805c-6536a2ed2a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:47.908891 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21d24b-8613-4413-805c-6536a2ed2a17 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:47.909235 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21d24b-8613-4413-805c-6536a2ed2a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:47.909999 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21d24b-8613-4413-805c-6536a2ed2a17 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:47.911175 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21d24b-8613-4413-805c-6536a2ed2a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:47.913490 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee21d24b-8613-4413-805c-6536a2ed2a17 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:47.944585 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 940/1903] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:47 2022] POST /identity/v3/users => generated 296 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:47.945673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847fcaa-8d47-4af1-91ec-c28095691af0 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:47.945973 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847fcaa-8d47-4af1-91ec-c28095691af0 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:47.946259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847fcaa-8d47-4af1-91ec-c28095691af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:47.980043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577bc68-6149-4131-bf70-105fc3646a6d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:47.989217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0b42a-3b3b-42a4-a450-216e4cb7fc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:47.989817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0b42a-3b3b-42a4-a450-216e4cb7fc72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:47.990104 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0b42a-3b3b-42a4-a450-216e4cb7fc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:47.990580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0b42a-3b3b-42a4-a450-216e4cb7fc72 admin admin] PATH_INFO: `/v3/projects/3fc7a9efd0274cceb59b0757ddf603cb` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:47.992053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0b42a-3b3b-42a4-a450-216e4cb7fc72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fc7a9efd0274cceb59b0757ddf603cb)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:47.994648 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0b42a-3b3b-42a4-a450-216e4cb7fc72 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:47.995797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-2847fcaa-8d47-4af1-91ec-c28095691af0 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:47.997326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2847fcaa-8d47-4af1-91ec-c28095691af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:48.016508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 941/1904] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:48.016508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847fcaa-8d47-4af1-91ec-c28095691af0 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:48.016508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2847fcaa-8d47-4af1-91ec-c28095691af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:48.030293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847fcaa-8d47-4af1-91ec-c28095691af0 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:48.036941 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c4b77-9510-4748-a0fb-018155de5c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:48.037577 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c4b77-9510-4748-a0fb-018155de5c5a admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.037864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c4b77-9510-4748-a0fb-018155de5c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.038141 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c4b77-9510-4748-a0fb-018155de5c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.038854 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c4b77-9510-4748-a0fb-018155de5c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:48.040886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c4b77-9510-4748-a0fb-018155de5c5a admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:48.073866 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 942/1905] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:48 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:48.074861 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c4b77-9510-4748-a0fb-018155de5c5a admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:48.076574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-0b5c4b77-9510-4748-a0fb-018155de5c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:48.083972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f9b0b42a-3b3b-42a4-a450-216e4cb7fc72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fc7a9efd0274cceb59b0757ddf603cb', 'request_id': 'req-f9b0b42a-3b3b-42a4-a450-216e4cb7fc72'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:48.094341 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f9b0b42a-3b3b-42a4-a450-216e4cb7fc72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fc7a9efd0274cceb59b0757ddf603cb', 'request_id': 'req-f9b0b42a-3b3b-42a4-a450-216e4cb7fc72'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:48.103659 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f9b0b42a-3b3b-42a4-a450-216e4cb7fc72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fc7a9efd0274cceb59b0757ddf603cb', 'request_id': 'req-f9b0b42a-3b3b-42a4-a450-216e4cb7fc72'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:48.121727 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f9b0b42a-3b3b-42a4-a450-216e4cb7fc72 admin admin] The token cache is being invalidate because project 3fc7a9efd0274cceb59b0757ddf603cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:48.122106 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f9b0b42a-3b3b-42a4-a450-216e4cb7fc72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:48.122708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f9b0b42a-3b3b-42a4-a450-216e4cb7fc72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:48.124512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 964/1906] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:47 2022] DELETE /identity/v3/projects/3fc7a9efd0274cceb59b0757ddf603cb => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:48.125613 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24bf1f-59c2-4a7e-8191-72020728e73a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.125899 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24bf1f-59c2-4a7e-8191-72020728e73a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.126291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e24bf1f-59c2-4a7e-8191-72020728e73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.148626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6e24bf1f-59c2-4a7e-8191-72020728e73a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:48.149934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6e24bf1f-59c2-4a7e-8191-72020728e73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:48.150316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:48.155238 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c4b77-9510-4748-a0fb-018155de5c5a admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:48.161018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 965/1907] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:48.161802 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24bf1f-59c2-4a7e-8191-72020728e73a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:48.163178 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6e24bf1f-59c2-4a7e-8191-72020728e73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:48.165906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f2387-4216-47e6-9210-2ec4a4ff30f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:48.166543 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f2387-4216-47e6-9210-2ec4a4ff30f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.166969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f2387-4216-47e6-9210-2ec4a4ff30f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.167254 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f2387-4216-47e6-9210-2ec4a4ff30f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.167989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f2387-4216-47e6-9210-2ec4a4ff30f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:48.169685 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f2387-4216-47e6-9210-2ec4a4ff30f3 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:48.176561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e24bf1f-59c2-4a7e-8191-72020728e73a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:48.184354 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 943/1908] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:48.184526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa85626-5bf4-4f52-940b-9c552be3b5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:48.184526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa85626-5bf4-4f52-940b-9c552be3b5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.184707 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14d3b2-c3bc-4bab-ac92-d81dc864fffa None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.184786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa85626-5bf4-4f52-940b-9c552be3b5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.184859 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14d3b2-c3bc-4bab-ac92-d81dc864fffa None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.184925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa85626-5bf4-4f52-940b-9c552be3b5b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.185001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c14d3b2-c3bc-4bab-ac92-d81dc864fffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.185073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa85626-5bf4-4f52-940b-9c552be3b5b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:48.185620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa85626-5bf4-4f52-940b-9c552be3b5b5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:48.209117 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 966/1909] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:48 2022] POST /identity/v3/users => generated 297 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:48.209631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-5c14d3b2-c3bc-4bab-ac92-d81dc864fffa None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:48.209907 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa85626-5bf4-4f52-940b-9c552be3b5b5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:48.210819 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-5c14d3b2-c3bc-4bab-ac92-d81dc864fffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:48.218943 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 944/1910] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:48.219730 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14d3b2-c3bc-4bab-ac92-d81dc864fffa None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:48.220151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa85626-5bf4-4f52-940b-9c552be3b5b5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:48.221424 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-5c14d3b2-c3bc-4bab-ac92-d81dc864fffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:48.234662 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9637a78-a92b-4daa-b233-b8c49e943380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:48.235565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9637a78-a92b-4daa-b233-b8c49e943380 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.235868 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9637a78-a92b-4daa-b233-b8c49e943380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.236137 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9637a78-a92b-4daa-b233-b8c49e943380 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.236296 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c14d3b2-c3bc-4bab-ac92-d81dc864fffa None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:48.236934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9637a78-a92b-4daa-b233-b8c49e943380 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:48.237239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9637a78-a92b-4daa-b233-b8c49e943380 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:48.239714 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9637a78-a92b-4daa-b233-b8c49e943380 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:48.242042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42919ea-2db0-4c7d-b551-877a5675f734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:48.242727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42919ea-2db0-4c7d-b551-877a5675f734 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.243016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42919ea-2db0-4c7d-b551-877a5675f734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.243303 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42919ea-2db0-4c7d-b551-877a5675f734 admin admin] PATH_INFO: `/v3/projects/8705d257ba4b4fdfb360187dcdd7dee7/users/268ffdb269444c1aaef709b482910082/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.249371 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:48.253252 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 967/1911] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:48.254274 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9637a78-a92b-4daa-b233-b8c49e943380 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:48.259616 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42919ea-2db0-4c7d-b551-877a5675f734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8705d257ba4b4fdfb360187dcdd7dee7, user_id=268ffdb269444c1aaef709b482910082, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:48.262702 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42919ea-2db0-4c7d-b551-877a5675f734 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:48.266147 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9637a78-a92b-4daa-b233-b8c49e943380 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:48.272359 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e3d52-9c45-4756-97af-356848ebccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:48.272799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e3d52-9c45-4756-97af-356848ebccf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.273078 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e3d52-9c45-4756-97af-356848ebccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.273347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e3d52-9c45-4756-97af-356848ebccf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.274036 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e3d52-9c45-4756-97af-356848ebccf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:48.275595 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e3d52-9c45-4756-97af-356848ebccf8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:48.276473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 945/1912] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:48 2022] PUT /identity/v3/projects/8705d257ba4b4fdfb360187dcdd7dee7/users/268ffdb269444c1aaef709b482910082/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:48.277884 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb277c-0946-4dd6-ad5b-bdeef6efe571 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.278182 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb277c-0946-4dd6-ad5b-bdeef6efe571 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.278463 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb277c-0946-4dd6-ad5b-bdeef6efe571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.287735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 968/1913] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:48.288670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e3d52-9c45-4756-97af-356848ebccf8 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:48.300025 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e3d52-9c45-4756-97af-356848ebccf8 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:48.311705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-5fcb277c-0946-4dd6-ad5b-bdeef6efe571 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:48.313161 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-5fcb277c-0946-4dd6-ad5b-bdeef6efe571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:48.360858 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76071602-b1dd-499f-91b1-6cd18acbf489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:48.361486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76071602-b1dd-499f-91b1-6cd18acbf489 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.361890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76071602-b1dd-499f-91b1-6cd18acbf489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.362294 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76071602-b1dd-499f-91b1-6cd18acbf489 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.363555 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76071602-b1dd-499f-91b1-6cd18acbf489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:48.365514 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76071602-b1dd-499f-91b1-6cd18acbf489 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:48.373961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 946/1914] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:48.374805 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb277c-0946-4dd6-ad5b-bdeef6efe571 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:48.384984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb277c-0946-4dd6-ad5b-bdeef6efe571 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:48.389734 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03f49b-a325-4c02-8f47-ccda140f8d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:48.390346 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03f49b-a325-4c02-8f47-ccda140f8d97 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.390630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03f49b-a325-4c02-8f47-ccda140f8d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.390906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03f49b-a325-4c02-8f47-ccda140f8d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.391598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03f49b-a325-4c02-8f47-ccda140f8d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:48.393219 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03f49b-a325-4c02-8f47-ccda140f8d97 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:48.394315 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 969/1915] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:48 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:48.395190 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76071602-b1dd-499f-91b1-6cd18acbf489 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:48.406530 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 947/1916] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:48.407362 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03f49b-a325-4c02-8f47-ccda140f8d97 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:48.417274 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03f49b-a325-4c02-8f47-ccda140f8d97 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:48.461219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76071602-b1dd-499f-91b1-6cd18acbf489 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:48.465902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da06a2-9826-4e63-901c-0f4a8c5f061b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:48.466565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da06a2-9826-4e63-901c-0f4a8c5f061b admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.466848 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da06a2-9826-4e63-901c-0f4a8c5f061b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.467121 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da06a2-9826-4e63-901c-0f4a8c5f061b admin admin] PATH_INFO: `/v3/projects/1672ea049403414aa9b33b758c56bff7/users/9cae6e033fee42788df0b85b3f04311a/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.477122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bed62-dcac-413e-8425-9362c56d568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:48.477744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bed62-dcac-413e-8425-9362c56d568e admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.478029 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bed62-dcac-413e-8425-9362c56d568e admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.478307 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bed62-dcac-413e-8425-9362c56d568e admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.479016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bed62-dcac-413e-8425-9362c56d568e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:48.479343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bed62-dcac-413e-8425-9362c56d568e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:48.480992 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bed62-dcac-413e-8425-9362c56d568e admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:48.482369 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da06a2-9826-4e63-901c-0f4a8c5f061b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1672ea049403414aa9b33b758c56bff7, user_id=9cae6e033fee42788df0b85b3f04311a, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:48.485431 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da06a2-9826-4e63-901c-0f4a8c5f061b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:48.493984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 948/1917] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:48.497682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bed62-dcac-413e-8425-9362c56d568e admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:48.499688 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 970/1918] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:48 2022] PUT /identity/v3/projects/1672ea049403414aa9b33b758c56bff7/users/9cae6e033fee42788df0b85b3f04311a/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:48.500504 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da06a2-9826-4e63-901c-0f4a8c5f061b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:48.509355 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bed62-dcac-413e-8425-9362c56d568e admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:48.554320 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:48.568300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65413692-1fa9-497c-a78e-1f47af679b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:48.568963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65413692-1fa9-497c-a78e-1f47af679b01 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.569240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65413692-1fa9-497c-a78e-1f47af679b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.569357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:48.569506 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65413692-1fa9-497c-a78e-1f47af679b01 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.570181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65413692-1fa9-497c-a78e-1f47af679b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:48.572274 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65413692-1fa9-497c-a78e-1f47af679b01 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:48.573106 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da06a2-9826-4e63-901c-0f4a8c5f061b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:48.579237 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed46d5-a086-4dc9-8f6f-a373fbca7a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:48.579915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed46d5-a086-4dc9-8f6f-a373fbca7a02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.580206 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed46d5-a086-4dc9-8f6f-a373fbca7a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.580579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed46d5-a086-4dc9-8f6f-a373fbca7a02 admin admin] PATH_INFO: `/v3/projects/8705d257ba4b4fdfb360187dcdd7dee7/users/268ffdb269444c1aaef709b482910082/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.582798 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed46d5-a086-4dc9-8f6f-a373fbca7a02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8705d257ba4b4fdfb360187dcdd7dee7, user_id=268ffdb269444c1aaef709b482910082, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:48.585598 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed46d5-a086-4dc9-8f6f-a373fbca7a02 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:48.593276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 949/1919] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:48 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:48.594164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65413692-1fa9-497c-a78e-1f47af679b01 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:48.596505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 971/1920] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:48 2022] PUT /identity/v3/projects/8705d257ba4b4fdfb360187dcdd7dee7/users/268ffdb269444c1aaef709b482910082/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:48.604695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65413692-1fa9-497c-a78e-1f47af679b01 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:48.605285 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed46d5-a086-4dc9-8f6f-a373fbca7a02 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:48.661658 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10f55b-9854-487b-af7e-37da1c9728e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:48.662280 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10f55b-9854-487b-af7e-37da1c9728e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.662559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10f55b-9854-487b-af7e-37da1c9728e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.662836 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10f55b-9854-487b-af7e-37da1c9728e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.663580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10f55b-9854-487b-af7e-37da1c9728e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:48.665508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10f55b-9854-487b-af7e-37da1c9728e9 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:48.671341 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed46d5-a086-4dc9-8f6f-a373fbca7a02 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:48.682048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9f5b7-18db-4e16-9ce2-74ee23da22f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:48.682701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9f5b7-18db-4e16-9ce2-74ee23da22f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.682986 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9f5b7-18db-4e16-9ce2-74ee23da22f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.683265 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9f5b7-18db-4e16-9ce2-74ee23da22f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.683999 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9f5b7-18db-4e16-9ce2-74ee23da22f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:48.685768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af9f5b7-18db-4e16-9ce2-74ee23da22f6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:48.697295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 972/1921] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:48.698286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9f5b7-18db-4e16-9ce2-74ee23da22f6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:48.699477 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 950/1922] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:48 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:48.700741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e01a2-b9e3-45fc-9f85-0a930981b811 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.701026 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e01a2-b9e3-45fc-9f85-0a930981b811 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.701312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e01a2-b9e3-45fc-9f85-0a930981b811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.709804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af9f5b7-18db-4e16-9ce2-74ee23da22f6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:48.736225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-f70e01a2-b9e3-45fc-9f85-0a930981b811 None None] MFA Rules not processed for user `268ffdb269444c1aaef709b482910082`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:48.737792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f70e01a2-b9e3-45fc-9f85-0a930981b811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:48.775440 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fbfe3-1500-4df9-98c5-8878541be7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:48.776063 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fbfe3-1500-4df9-98c5-8878541be7ce admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.776341 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fbfe3-1500-4df9-98c5-8878541be7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.776782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fbfe3-1500-4df9-98c5-8878541be7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.777480 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fbfe3-1500-4df9-98c5-8878541be7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:48.779070 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fbfe3-1500-4df9-98c5-8878541be7ce admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:48.791182 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 973/1923] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:48.792151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fbfe3-1500-4df9-98c5-8878541be7ce admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:48.804521 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fbfe3-1500-4df9-98c5-8878541be7ce admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:48.810321 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37dbeb-7b7f-493c-ad8c-1e78ede8d393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:48.810951 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37dbeb-7b7f-493c-ad8c-1e78ede8d393 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.811242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37dbeb-7b7f-493c-ad8c-1e78ede8d393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.811522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37dbeb-7b7f-493c-ad8c-1e78ede8d393 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.812238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37dbeb-7b7f-493c-ad8c-1e78ede8d393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:48.814707 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37dbeb-7b7f-493c-ad8c-1e78ede8d393 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:48.823969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 951/1924] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:48.825194 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e01a2-b9e3-45fc-9f85-0a930981b811 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:48.841827 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 974/1925] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:48 2022] POST /identity/v3/users => generated 292 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:48.842637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e01a2-b9e3-45fc-9f85-0a930981b811 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:48.842890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37dbeb-7b7f-493c-ad8c-1e78ede8d393 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:48.848698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2450b09-12c4-478c-9f23-4e96372e4f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:48.849548 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2450b09-12c4-478c-9f23-4e96372e4f85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.850296 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2450b09-12c4-478c-9f23-4e96372e4f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.850296 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2450b09-12c4-478c-9f23-4e96372e4f85 admin admin] PATH_INFO: `/v3/projects/1672ea049403414aa9b33b758c56bff7/users/9cae6e033fee42788df0b85b3f04311a/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.852800 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2450b09-12c4-478c-9f23-4e96372e4f85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1672ea049403414aa9b33b758c56bff7, user_id=9cae6e033fee42788df0b85b3f04311a, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:48.854936 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37dbeb-7b7f-493c-ad8c-1e78ede8d393 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:48.855535 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2450b09-12c4-478c-9f23-4e96372e4f85 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:48.861777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d53aae-e31e-4d11-9476-f2b5f612ff75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:48.862401 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d53aae-e31e-4d11-9476-f2b5f612ff75 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.862680 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d53aae-e31e-4d11-9476-f2b5f612ff75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.863479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d53aae-e31e-4d11-9476-f2b5f612ff75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.864189 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d53aae-e31e-4d11-9476-f2b5f612ff75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:48.865804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d53aae-e31e-4d11-9476-f2b5f612ff75 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:48.868225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 952/1926] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:48 2022] PUT /identity/v3/projects/1672ea049403414aa9b33b758c56bff7/users/9cae6e033fee42788df0b85b3f04311a/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:48.869239 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2450b09-12c4-478c-9f23-4e96372e4f85 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:48.870830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f2450b09-12c4-478c-9f23-4e96372e4f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:48.882634 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 975/1927] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:48.883486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d53aae-e31e-4d11-9476-f2b5f612ff75 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:48.894467 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d53aae-e31e-4d11-9476-f2b5f612ff75 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:48.909951 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:48.936154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2450b09-12c4-478c-9f23-4e96372e4f85 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:48.940269 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6815869-d2be-4dd3-9374-4d2c395ae49c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:48.940688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6815869-d2be-4dd3-9374-4d2c395ae49c service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.941537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6815869-d2be-4dd3-9374-4d2c395ae49c service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.941905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6815869-d2be-4dd3-9374-4d2c395ae49c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.953420 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:48.962410 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb348ee-8085-42fa-b415-25f39d9a8182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:48.963206 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb348ee-8085-42fa-b415-25f39d9a8182 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.963290 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb348ee-8085-42fa-b415-25f39d9a8182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.963807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb348ee-8085-42fa-b415-25f39d9a8182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:48.964939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb348ee-8085-42fa-b415-25f39d9a8182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:48.966946 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb348ee-8085-42fa-b415-25f39d9a8182 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:48.978451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 976/1928] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:48 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:48.979425 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25007ae0-e99b-41bd-bc8f-8ad03748f7fb None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:48.979723 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25007ae0-e99b-41bd-bc8f-8ad03748f7fb None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:48.979999 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25007ae0-e99b-41bd-bc8f-8ad03748f7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:49.019757 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-25007ae0-e99b-41bd-bc8f-8ad03748f7fb None None] MFA Rules not processed for user `9cae6e033fee42788df0b85b3f04311a`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:49.021887 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-25007ae0-e99b-41bd-bc8f-8ad03748f7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:49.023092 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6815869-d2be-4dd3-9374-4d2c395ae49c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:49.025092 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6815869-d2be-4dd3-9374-4d2c395ae49c service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:49.045340 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 953/1929] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:49.047643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6815869-d2be-4dd3-9374-4d2c395ae49c service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:49.072078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6815869-d2be-4dd3-9374-4d2c395ae49c service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:49.084276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4a459-66b8-4d7d-b9c2-7c5234843c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:49.084996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4a459-66b8-4d7d-b9c2-7c5234843c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:49.085277 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4a459-66b8-4d7d-b9c2-7c5234843c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:49.085556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4a459-66b8-4d7d-b9c2-7c5234843c5a admin admin] PATH_INFO: `/v3/projects/2403407e426e48f6b15ed94d1830e009/users/3c8a6692f1ca4748ab1b3744dd8e531a/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:49.129980 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4a459-66b8-4d7d-b9c2-7c5234843c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2403407e426e48f6b15ed94d1830e009, user_id=3c8a6692f1ca4748ab1b3744dd8e531a, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:49.138913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4a459-66b8-4d7d-b9c2-7c5234843c5a admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:49.152009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 977/1930] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:49.152009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25007ae0-e99b-41bd-bc8f-8ad03748f7fb None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:49.163790 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25007ae0-e99b-41bd-bc8f-8ad03748f7fb None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:49.171569 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 954/1931] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:49 2022] PUT /identity/v3/projects/2403407e426e48f6b15ed94d1830e009/users/3c8a6692f1ca4748ab1b3744dd8e531a/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:49.185029 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d314d3-1768-475f-bdf0-8ba2c923cf4f None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:49.185304 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d314d3-1768-475f-bdf0-8ba2c923cf4f None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:49.185584 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d314d3-1768-475f-bdf0-8ba2c923cf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:49.249508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-31d314d3-1768-475f-bdf0-8ba2c923cf4f None None] MFA Rules not processed for user `3c8a6692f1ca4748ab1b3744dd8e531a`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:49.250646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-31d314d3-1768-475f-bdf0-8ba2c923cf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:49.350922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c126e43-3c58-4d2c-aebc-63b173b8c9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:49.352219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c126e43-3c58-4d2c-aebc-63b173b8c9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:49.358566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c126e43-3c58-4d2c-aebc-63b173b8c9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:49.358566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c126e43-3c58-4d2c-aebc-63b173b8c9f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:49.360199 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c126e43-3c58-4d2c-aebc-63b173b8c9f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:49.361972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c126e43-3c58-4d2c-aebc-63b173b8c9f8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:49.378222 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 978/1932] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:49.379728 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c126e43-3c58-4d2c-aebc-63b173b8c9f8 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:49.421384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 955/1933] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:49.422478 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d314d3-1768-475f-bdf0-8ba2c923cf4f None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:49.447506 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d314d3-1768-475f-bdf0-8ba2c923cf4f None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:49.455599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89629fcb-783c-4b4c-be12-0e18c4405092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:49.455816 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89629fcb-783c-4b4c-be12-0e18c4405092 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:49.456097 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89629fcb-783c-4b4c-be12-0e18c4405092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:49.456386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89629fcb-783c-4b4c-be12-0e18c4405092 admin admin] PATH_INFO: `/v3/projects/a964231320fc4638904583a5021ff906/users/b83c42386c7b4e01971493b00def2e03/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:49.465978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c126e43-3c58-4d2c-aebc-63b173b8c9f8 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:49.470807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ae8db-ff42-42ae-beb0-277d42d0680f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:49.471433 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ae8db-ff42-42ae-beb0-277d42d0680f service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:49.471714 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ae8db-ff42-42ae-beb0-277d42d0680f service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:49.471987 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ae8db-ff42-42ae-beb0-277d42d0680f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:49.484549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89629fcb-783c-4b4c-be12-0e18c4405092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a964231320fc4638904583a5021ff906, user_id=b83c42386c7b4e01971493b00def2e03, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:49.487708 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89629fcb-783c-4b4c-be12-0e18c4405092 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:49.507181 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:49.512870 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 956/1934] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:49 2022] PUT /identity/v3/projects/a964231320fc4638904583a5021ff906/users/b83c42386c7b4e01971493b00def2e03/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:49.513729 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89629fcb-783c-4b4c-be12-0e18c4405092 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:49.551646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:49.560711 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ae8db-ff42-42ae-beb0-277d42d0680f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:49.562229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ae8db-ff42-42ae-beb0-277d42d0680f service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:49.579831 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 979/1935] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:49.580973 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d67ce0-20ea-44ad-9200-789f35790d60 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:49.581249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d67ce0-20ea-44ad-9200-789f35790d60 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:49.582159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d67ce0-20ea-44ad-9200-789f35790d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:49.610075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89629fcb-783c-4b4c-be12-0e18c4405092 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:49.617050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99536de4-0c62-4b59-8dac-16a15fab4844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:49.617834 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99536de4-0c62-4b59-8dac-16a15fab4844 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:49.618116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99536de4-0c62-4b59-8dac-16a15fab4844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:49.618423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99536de4-0c62-4b59-8dac-16a15fab4844 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:49.619321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99536de4-0c62-4b59-8dac-16a15fab4844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:49.621907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99536de4-0c62-4b59-8dac-16a15fab4844 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:49.625447 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a0d67ce0-20ea-44ad-9200-789f35790d60 None None] MFA Rules not processed for user `b83c42386c7b4e01971493b00def2e03`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:49.626825 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a0d67ce0-20ea-44ad-9200-789f35790d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:49.662676 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 957/1936] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:49 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:49.665013 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99536de4-0c62-4b59-8dac-16a15fab4844 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:49.756437 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 980/1937] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:49.761727 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d67ce0-20ea-44ad-9200-789f35790d60 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:49.769095 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99536de4-0c62-4b59-8dac-16a15fab4844 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:49.774519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393b375-3949-4c2f-8c98-8be784cfe54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:49.775741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393b375-3949-4c2f-8c98-8be784cfe54a admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:49.776147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393b375-3949-4c2f-8c98-8be784cfe54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:49.776503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393b375-3949-4c2f-8c98-8be784cfe54a admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:49.777741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393b375-3949-4c2f-8c98-8be784cfe54a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:49.779708 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393b375-3949-4c2f-8c98-8be784cfe54a admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:49.797329 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d67ce0-20ea-44ad-9200-789f35790d60 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:49.804853 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f0a16-a4e1-4e77-bced-550ebb1a6d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:49.805750 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f0a16-a4e1-4e77-bced-550ebb1a6d58 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:49.806372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f0a16-a4e1-4e77-bced-550ebb1a6d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:49.806629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f0a16-a4e1-4e77-bced-550ebb1a6d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:49.807552 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f0a16-a4e1-4e77-bced-550ebb1a6d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:49.809513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f0a16-a4e1-4e77-bced-550ebb1a6d58 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:49.828568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 958/1938] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:49 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:11:49.830439 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393b375-3949-4c2f-8c98-8be784cfe54a admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:49.854500 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 981/1939] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:49 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:49.859431 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f0a16-a4e1-4e77-bced-550ebb1a6d58 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:49.865891 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393b375-3949-4c2f-8c98-8be784cfe54a admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:50.028160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f0a16-a4e1-4e77-bced-550ebb1a6d58 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:50.038780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2df6d-a8d6-4dc9-8eb4-482653d42f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:50.038780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2df6d-a8d6-4dc9-8eb4-482653d42f70 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:50.038780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2df6d-a8d6-4dc9-8eb4-482653d42f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:50.038780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2df6d-a8d6-4dc9-8eb4-482653d42f70 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:50.039076 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2df6d-a8d6-4dc9-8eb4-482653d42f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:50.040421 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2df6d-a8d6-4dc9-8eb4-482653d42f70 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:50.043566 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0dad1-96d0-4dd7-b667-b3d88d905330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:50.045439 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0dad1-96d0-4dd7-b667-b3d88d905330 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:50.045941 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0dad1-96d0-4dd7-b667-b3d88d905330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:50.046446 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e0dad1-96d0-4dd7-b667-b3d88d905330 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:50.048058 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0dad1-96d0-4dd7-b667-b3d88d905330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:50.051110 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e0dad1-96d0-4dd7-b667-b3d88d905330 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:50.066444 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 959/1940] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:50.067662 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0dad1-96d0-4dd7-b667-b3d88d905330 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:50.103302 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 982/1941] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:49 2022] POST /identity/v3/users => generated 299 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:50.104013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2df6d-a8d6-4dc9-8eb4-482653d42f70 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:50.131421 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2df6d-a8d6-4dc9-8eb4-482653d42f70 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:50.141811 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b34df1-86de-41af-979b-f5349806b228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:50.142676 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b34df1-86de-41af-979b-f5349806b228 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:50.143220 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b34df1-86de-41af-979b-f5349806b228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:50.143636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b34df1-86de-41af-979b-f5349806b228 admin admin] PATH_INFO: `/v3/projects/9ea274951909476aa07832b2452d003e/users/e2aefd840987498b930291840572d6e0/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:50.150128 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:50.188691 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b34df1-86de-41af-979b-f5349806b228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea274951909476aa07832b2452d003e, user_id=e2aefd840987498b930291840572d6e0, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:50.188691 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b34df1-86de-41af-979b-f5349806b228 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:50.192971 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:50.204868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e0dad1-96d0-4dd7-b667-b3d88d905330 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:50.209402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 983/1942] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:50 2022] PUT /identity/v3/projects/9ea274951909476aa07832b2452d003e/users/e2aefd840987498b930291840572d6e0/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:50.210349 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b34df1-86de-41af-979b-f5349806b228 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:50.281992 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced40ab2-2b49-449f-9a6a-479bbc2352dc tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268ffdb269444c1aaef709b482910082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8705d257ba4b4fdfb360187dcdd7dee7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:50.282838 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced40ab2-2b49-449f-9a6a-479bbc2352dc tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:50.283309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced40ab2-2b49-449f-9a6a-479bbc2352dc tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:50.283601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced40ab2-2b49-449f-9a6a-479bbc2352dc tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:50.284315 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced40ab2-2b49-449f-9a6a-479bbc2352dc tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:50.284875 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced40ab2-2b49-449f-9a6a-479bbc2352dc tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:50.287107 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced40ab2-2b49-449f-9a6a-479bbc2352dc tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:50.289909 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b34df1-86de-41af-979b-f5349806b228 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:50.294738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d343d8-c4ab-4444-be53-15552a95fae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:50.295436 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d343d8-c4ab-4444-be53-15552a95fae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:50.295634 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d343d8-c4ab-4444-be53-15552a95fae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:50.295907 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d343d8-c4ab-4444-be53-15552a95fae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:50.296639 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d343d8-c4ab-4444-be53-15552a95fae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:50.298304 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d343d8-c4ab-4444-be53-15552a95fae1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:50.300779 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 960/1943] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:50.301630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced40ab2-2b49-449f-9a6a-479bbc2352dc tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:50.303330 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ced40ab2-2b49-449f-9a6a-479bbc2352dc tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:50.327048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 984/1944] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:50.328013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d343d8-c4ab-4444-be53-15552a95fae1 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:50.346987 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d343d8-c4ab-4444-be53-15552a95fae1 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:50.359501 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c057f61-8a50-4713-a5fa-3fa88dec8cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:50.361222 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c057f61-8a50-4713-a5fa-3fa88dec8cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:50.361786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c057f61-8a50-4713-a5fa-3fa88dec8cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:50.362569 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c057f61-8a50-4713-a5fa-3fa88dec8cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:50.365222 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c057f61-8a50-4713-a5fa-3fa88dec8cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:50.369572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c057f61-8a50-4713-a5fa-3fa88dec8cb6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:50.390427 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 985/1945] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:50.391724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c057f61-8a50-4713-a5fa-3fa88dec8cb6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:50.410968 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c057f61-8a50-4713-a5fa-3fa88dec8cb6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:50.419830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcaea5e-b77b-43fb-af68-374c51dda723 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268ffdb269444c1aaef709b482910082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8705d257ba4b4fdfb360187dcdd7dee7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:50.420486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaea5e-b77b-43fb-af68-374c51dda723 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:50.420870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaea5e-b77b-43fb-af68-374c51dda723 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:50.421152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcaea5e-b77b-43fb-af68-374c51dda723 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:50.421917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcaea5e-b77b-43fb-af68-374c51dda723 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:50.424179 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcaea5e-b77b-43fb-af68-374c51dda723 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:50.430612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced40ab2-2b49-449f-9a6a-479bbc2352dc tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:50.440021 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6791a32-0036-4f12-9e53-24d997fb3321 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:50.442559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6791a32-0036-4f12-9e53-24d997fb3321 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:50.443164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6791a32-0036-4f12-9e53-24d997fb3321 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:50.443588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6791a32-0036-4f12-9e53-24d997fb3321 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:50.450779 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a6791a32-0036-4f12-9e53-24d997fb3321 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:50.516593 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 986/1946] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:50 2022] POST /identity/v3/projects => generated 352 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:50.517514 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcaea5e-b77b-43fb-af68-374c51dda723 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:50.566544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6791a32-0036-4f12-9e53-24d997fb3321 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:50.568682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6791a32-0036-4f12-9e53-24d997fb3321 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:50.579458 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 961/1947] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:50.580532 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6791a32-0036-4f12-9e53-24d997fb3321 service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:50.599066 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6791a32-0036-4f12-9e53-24d997fb3321 service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:50.634026 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcaea5e-b77b-43fb-af68-374c51dda723 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:50.648864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f04cb-7511-49cb-a8d8-e6636a1c1ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:50.649542 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f04cb-7511-49cb-a8d8-e6636a1c1ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:50.649841 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f04cb-7511-49cb-a8d8-e6636a1c1ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:50.650122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f04cb-7511-49cb-a8d8-e6636a1c1ee4 admin admin] PATH_INFO: `/v3/projects/5d611c143d8a4a8ea6ef9042cb6abe4c/users/548c6dbfc7564c2f93257caba282f912/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:50.650481 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:50.673432 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f04cb-7511-49cb-a8d8-e6636a1c1ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d611c143d8a4a8ea6ef9042cb6abe4c, user_id=548c6dbfc7564c2f93257caba282f912, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:50.678066 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f04cb-7511-49cb-a8d8-e6636a1c1ee4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:50.690328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d88e4-007a-4d31-b7b4-d5053eca0f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:50.691105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d88e4-007a-4d31-b7b4-d5053eca0f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:50.691384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d88e4-007a-4d31-b7b4-d5053eca0f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:50.691660 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d88e4-007a-4d31-b7b4-d5053eca0f83 admin admin] PATH_INFO: `/v3/projects/9ea274951909476aa07832b2452d003e/users/e2aefd840987498b930291840572d6e0/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:50.693688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d88e4-007a-4d31-b7b4-d5053eca0f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea274951909476aa07832b2452d003e, user_id=e2aefd840987498b930291840572d6e0, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:50.695078 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 987/1948] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:50 2022] PUT /identity/v3/projects/5d611c143d8a4a8ea6ef9042cb6abe4c/users/548c6dbfc7564c2f93257caba282f912/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:50.695712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f04cb-7511-49cb-a8d8-e6636a1c1ee4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:50.699447 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d88e4-007a-4d31-b7b4-d5053eca0f83 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:50.717046 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 962/1949] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:50 2022] PUT /identity/v3/projects/9ea274951909476aa07832b2452d003e/users/e2aefd840987498b930291840572d6e0/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:50.721510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d88e4-007a-4d31-b7b4-d5053eca0f83 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:50.761232 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:50.787163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f04cb-7511-49cb-a8d8-e6636a1c1ee4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:50.811693 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d88e4-007a-4d31-b7b4-d5053eca0f83 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:50.817716 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51be7cc-2cbe-412a-9cc3-f0692a489b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:50.818761 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51be7cc-2cbe-412a-9cc3-f0692a489b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:50.819209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51be7cc-2cbe-412a-9cc3-f0692a489b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:50.819499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51be7cc-2cbe-412a-9cc3-f0692a489b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:50.820251 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51be7cc-2cbe-412a-9cc3-f0692a489b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:50.822178 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51be7cc-2cbe-412a-9cc3-f0692a489b40 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:50.838982 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 963/1950] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:50.840665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0288de3-7e1f-42bc-bca8-053098f5951d None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:50.841159 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0288de3-7e1f-42bc-bca8-053098f5951d None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:50.842279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0288de3-7e1f-42bc-bca8-053098f5951d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:50.855735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04dae81-5f72-4dab-be70-87e5cbbd1442 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268ffdb269444c1aaef709b482910082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8705d257ba4b4fdfb360187dcdd7dee7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:50.856365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dae81-5f72-4dab-be70-87e5cbbd1442 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:50.856682 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dae81-5f72-4dab-be70-87e5cbbd1442 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:50.857004 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04dae81-5f72-4dab-be70-87e5cbbd1442 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:50.857655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04dae81-5f72-4dab-be70-87e5cbbd1442 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:50.858584 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04dae81-5f72-4dab-be70-87e5cbbd1442 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:50.860506 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04dae81-5f72-4dab-be70-87e5cbbd1442 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:50.875179 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 988/1951] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:50.875386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-d0288de3-7e1f-42bc-bca8-053098f5951d None None] MFA Rules not processed for user `e2aefd840987498b930291840572d6e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:50.876081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04dae81-5f72-4dab-be70-87e5cbbd1442 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:50.876555 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-d0288de3-7e1f-42bc-bca8-053098f5951d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:50.894915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04dae81-5f72-4dab-be70-87e5cbbd1442 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:50.902898 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a2046-f664-49d7-b331-e2380405f839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:50.903714 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a2046-f664-49d7-b331-e2380405f839 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:50.904501 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a2046-f664-49d7-b331-e2380405f839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:50.904873 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a2046-f664-49d7-b331-e2380405f839 admin admin] PATH_INFO: `/v3/projects/5d611c143d8a4a8ea6ef9042cb6abe4c/users/548c6dbfc7564c2f93257caba282f912/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:50.908489 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a2046-f664-49d7-b331-e2380405f839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d611c143d8a4a8ea6ef9042cb6abe4c, user_id=548c6dbfc7564c2f93257caba282f912, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:50.913362 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a2046-f664-49d7-b331-e2380405f839 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:50.928966 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 989/1952] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:50 2022] PUT /identity/v3/projects/5d611c143d8a4a8ea6ef9042cb6abe4c/users/548c6dbfc7564c2f93257caba282f912/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:50.931163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a2046-f664-49d7-b331-e2380405f839 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:50.970729 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 964/1953] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:50.971944 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f908195-eb0f-4dcd-9aba-b201e2c6e35a None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:50.972829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f908195-eb0f-4dcd-9aba-b201e2c6e35a None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:50.973738 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f908195-eb0f-4dcd-9aba-b201e2c6e35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:51.001603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a2046-f664-49d7-b331-e2380405f839 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:51.006697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0e273-056c-42cf-bff6-22db4382e9a0 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '268ffdb269444c1aaef709b482910082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8705d257ba4b4fdfb360187dcdd7dee7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:51.007462 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0e273-056c-42cf-bff6-22db4382e9a0 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:51.007752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0e273-056c-42cf-bff6-22db4382e9a0 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:51.008112 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0e273-056c-42cf-bff6-22db4382e9a0 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] PATH_INFO: `/v3/projects/30ad6329cfdf42f0864c115febf1a440` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:51.009687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0e273-056c-42cf-bff6-22db4382e9a0 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] RBAC: Authorizing `identity:delete_project(project_id=30ad6329cfdf42f0864c115febf1a440)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:51.010774 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-5f908195-eb0f-4dcd-9aba-b201e2c6e35a None None] MFA Rules not processed for user `548c6dbfc7564c2f93257caba282f912`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:51.011699 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0e273-056c-42cf-bff6-22db4382e9a0 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:51.012159 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-5f908195-eb0f-4dcd-9aba-b201e2c6e35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:51.058797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:51.077572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dae0e273-056c-42cf-bff6-22db4382e9a0 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ad6329cfdf42f0864c115febf1a440', 'request_id': 'req-dae0e273-056c-42cf-bff6-22db4382e9a0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:51.085491 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dae0e273-056c-42cf-bff6-22db4382e9a0 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ad6329cfdf42f0864c115febf1a440', 'request_id': 'req-dae0e273-056c-42cf-bff6-22db4382e9a0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:51.092418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dae0e273-056c-42cf-bff6-22db4382e9a0 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ad6329cfdf42f0864c115febf1a440', 'request_id': 'req-dae0e273-056c-42cf-bff6-22db4382e9a0'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:51.099311 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 965/1954] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:51.101565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f908195-eb0f-4dcd-9aba-b201e2c6e35a None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:51.113161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:51.117861 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dae0e273-056c-42cf-bff6-22db4382e9a0 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] The token cache is being invalidate because project 30ad6329cfdf42f0864c115febf1a440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:51.118167 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dae0e273-056c-42cf-bff6-22db4382e9a0 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:51.121337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dae0e273-056c-42cf-bff6-22db4382e9a0 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:51.126939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 990/1955] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:50 2022] DELETE /identity/v3/projects/30ad6329cfdf42f0864c115febf1a440 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:51.128279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0e273-056c-42cf-bff6-22db4382e9a0 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:51.130295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dae0e273-056c-42cf-bff6-22db4382e9a0 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:51.192481 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f908195-eb0f-4dcd-9aba-b201e2c6e35a None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:51.196090 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0e273-056c-42cf-bff6-22db4382e9a0 tempest-VolumeQuotaClassesTest-616096452 tempest-VolumeQuotaClassesTest-616096452-project-admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:51.199982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614ee5b-66af-4df0-bbfb-8a3732fe0e43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:51.200700 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614ee5b-66af-4df0-bbfb-8a3732fe0e43 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:51.200980 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614ee5b-66af-4df0-bbfb-8a3732fe0e43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:51.201447 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614ee5b-66af-4df0-bbfb-8a3732fe0e43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:51.203456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5614ee5b-66af-4df0-bbfb-8a3732fe0e43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:51.278151 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe109ad-5798-45ba-9473-4a435b419f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:51.278953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe109ad-5798-45ba-9473-4a435b419f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:51.279342 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe109ad-5798-45ba-9473-4a435b419f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:51.279722 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe109ad-5798-45ba-9473-4a435b419f0a admin admin] PATH_INFO: `/v3/users/0de151f6b10e4e2b8c522cb578d4f1fc` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:51.281256 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe109ad-5798-45ba-9473-4a435b419f0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de151f6b10e4e2b8c522cb578d4f1fc)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:51.283412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe109ad-5798-45ba-9473-4a435b419f0a admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:51.284475 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614ee5b-66af-4df0-bbfb-8a3732fe0e43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:51.287753 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614ee5b-66af-4df0-bbfb-8a3732fe0e43 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:51.299857 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 991/1956] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:51 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:51.302009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614ee5b-66af-4df0-bbfb-8a3732fe0e43 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:51.303335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5614ee5b-66af-4df0-bbfb-8a3732fe0e43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:51.318143 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614ee5b-66af-4df0-bbfb-8a3732fe0e43 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:51.323145 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abaefc-ad8a-400d-a598-b6b10123672b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:51.323833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abaefc-ad8a-400d-a598-b6b10123672b service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:51.324116 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abaefc-ad8a-400d-a598-b6b10123672b service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:51.324389 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abaefc-ad8a-400d-a598-b6b10123672b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:51.327526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b1abaefc-ad8a-400d-a598-b6b10123672b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:51.394673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-bfe109ad-5798-45ba-9473-4a435b419f0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de151f6b10e4e2b8c522cb578d4f1fc'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:51.395587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-bfe109ad-5798-45ba-9473-4a435b419f0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de151f6b10e4e2b8c522cb578d4f1fc'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:51.429448 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-bfe109ad-5798-45ba-9473-4a435b419f0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de151f6b10e4e2b8c522cb578d4f1fc'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:51.441537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abaefc-ad8a-400d-a598-b6b10123672b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:51.442048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-bfe109ad-5798-45ba-9473-4a435b419f0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de151f6b10e4e2b8c522cb578d4f1fc'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:51.442926 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-bfe109ad-5798-45ba-9473-4a435b419f0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de151f6b10e4e2b8c522cb578d4f1fc'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:51.443519 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abaefc-ad8a-400d-a598-b6b10123672b service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:51.452865 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:51.456013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 992/1957] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:51 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:51.461482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 966/1958] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:51 2022] DELETE /identity/v3/users/0de151f6b10e4e2b8c522cb578d4f1fc => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:51.465086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7af7f-d5de-4627-bb01-b4c2026b6466 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:51.465445 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7af7f-d5de-4627-bb01-b4c2026b6466 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:51.465854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7af7f-d5de-4627-bb01-b4c2026b6466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:51.491529 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9782888-ebd5-4718-adc4-78191df159eb None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:51.491891 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9782888-ebd5-4718-adc4-78191df159eb None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:51.492239 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9782888-ebd5-4718-adc4-78191df159eb None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:51.494079 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 967/1959] 10.222.0.85 () {54 vars in 921 bytes} [Tue Aug 2 10:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:11:51.495819 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2fb7af7f-d5de-4627-bb01-b4c2026b6466 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:51.497217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2fb7af7f-d5de-4627-bb01-b4c2026b6466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:51.510628 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538531b2-4ec2-462c-bcfe-d2c1f3db2dd6 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:51.510912 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538531b2-4ec2-462c-bcfe-d2c1f3db2dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:51.511188 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538531b2-4ec2-462c-bcfe-d2c1f3db2dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:51.548510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-538531b2-4ec2-462c-bcfe-d2c1f3db2dd6 None None] MFA Rules not processed for user `310867deefd34a598cfef2f3e4245ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:51.557787 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-538531b2-4ec2-462c-bcfe-d2c1f3db2dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:51.625131 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:51.677216 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 993/1960] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:51.679654 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7af7f-d5de-4627-bb01-b4c2026b6466 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:51.683642 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2fb7af7f-d5de-4627-bb01-b4c2026b6466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:51.723430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7af7f-d5de-4627-bb01-b4c2026b6466 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:51.734142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff322c-64ad-4d19-a714-5cb51f36304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:51.739387 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff322c-64ad-4d19-a714-5cb51f36304c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:51.739686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff322c-64ad-4d19-a714-5cb51f36304c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:51.740142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff322c-64ad-4d19-a714-5cb51f36304c admin admin] PATH_INFO: `/v3/users/b83c42386c7b4e01971493b00def2e03` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:51.743944 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff322c-64ad-4d19-a714-5cb51f36304c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b83c42386c7b4e01971493b00def2e03)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:51.749066 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff322c-64ad-4d19-a714-5cb51f36304c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:51.767623 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 968/1961] 10.222.0.85 () {58 vars in 1018 bytes} [Tue Aug 2 10:11:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:51.768580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538531b2-4ec2-462c-bcfe-d2c1f3db2dd6 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:51.771301 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-538531b2-4ec2-462c-bcfe-d2c1f3db2dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:51.877857 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8fff322c-64ad-4d19-a714-5cb51f36304c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b83c42386c7b4e01971493b00def2e03'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:51.879472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8fff322c-64ad-4d19-a714-5cb51f36304c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b83c42386c7b4e01971493b00def2e03'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:51.899998 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538531b2-4ec2-462c-bcfe-d2c1f3db2dd6 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:51.903620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8fff322c-64ad-4d19-a714-5cb51f36304c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b83c42386c7b4e01971493b00def2e03'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:51.911030 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a156b13-c26c-4f49-b800-52cd688a871b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:51.911775 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a156b13-c26c-4f49-b800-52cd688a871b service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:51.912939 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a156b13-c26c-4f49-b800-52cd688a871b service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:51.913298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a156b13-c26c-4f49-b800-52cd688a871b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:51.941061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a156b13-c26c-4f49-b800-52cd688a871b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:51.945333 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a156b13-c26c-4f49-b800-52cd688a871b service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:51.948828 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8fff322c-64ad-4d19-a714-5cb51f36304c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b83c42386c7b4e01971493b00def2e03'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:51.966789 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8fff322c-64ad-4d19-a714-5cb51f36304c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b83c42386c7b4e01971493b00def2e03'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:51.969687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 969/1962] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:51.971441 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a156b13-c26c-4f49-b800-52cd688a871b service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:51.976047 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-6a156b13-c26c-4f49-b800-52cd688a871b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:51.979477 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 994/1963] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:51 2022] DELETE /identity/v3/users/b83c42386c7b4e01971493b00def2e03 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:51.985823 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053abc6-46a2-4b34-af19-92624853cde3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:51.986260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053abc6-46a2-4b34-af19-92624853cde3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:51.986701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053abc6-46a2-4b34-af19-92624853cde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:52.018604 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a156b13-c26c-4f49-b800-52cd688a871b service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:52.029950 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4053abc6-46a2-4b34-af19-92624853cde3 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:52.031373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4053abc6-46a2-4b34-af19-92624853cde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:52.163173 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 995/1964] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:52.164221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053abc6-46a2-4b34-af19-92624853cde3 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:52.165680 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4053abc6-46a2-4b34-af19-92624853cde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:52.167693 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748248d5-9ab7-499e-b808-c4a5f4dc75bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:52.168756 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748248d5-9ab7-499e-b808-c4a5f4dc75bc service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:52.169097 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748248d5-9ab7-499e-b808-c4a5f4dc75bc service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:52.169385 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748248d5-9ab7-499e-b808-c4a5f4dc75bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:52.171511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-748248d5-9ab7-499e-b808-c4a5f4dc75bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:52.179960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053abc6-46a2-4b34-af19-92624853cde3 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:52.191190 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed353de-c6b8-4b58-b9e8-cd8abd646501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:52.192057 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed353de-c6b8-4b58-b9e8-cd8abd646501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:52.192332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed353de-c6b8-4b58-b9e8-cd8abd646501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:52.192646 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed353de-c6b8-4b58-b9e8-cd8abd646501 admin admin] PATH_INFO: `/v3/users/5eb703852bdb4feeba02443c742073df` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:52.193971 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed353de-c6b8-4b58-b9e8-cd8abd646501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eb703852bdb4feeba02443c742073df)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:52.195640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748248d5-9ab7-499e-b808-c4a5f4dc75bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:52.196210 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed353de-c6b8-4b58-b9e8-cd8abd646501 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:52.199943 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748248d5-9ab7-499e-b808-c4a5f4dc75bc service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:52.215920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 970/1965] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:52.217250 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748248d5-9ab7-499e-b808-c4a5f4dc75bc service nova] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:52.219040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-748248d5-9ab7-499e-b808-c4a5f4dc75bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:52.269775 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:52.349129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1ed353de-c6b8-4b58-b9e8-cd8abd646501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eb703852bdb4feeba02443c742073df'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:52.350038 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1ed353de-c6b8-4b58-b9e8-cd8abd646501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eb703852bdb4feeba02443c742073df'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:52.356862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:52.361545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1ed353de-c6b8-4b58-b9e8-cd8abd646501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eb703852bdb4feeba02443c742073df'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:52.390888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1ed353de-c6b8-4b58-b9e8-cd8abd646501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eb703852bdb4feeba02443c742073df'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:52.412665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748248d5-9ab7-499e-b808-c4a5f4dc75bc service nova] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:52.413026 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1ed353de-c6b8-4b58-b9e8-cd8abd646501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eb703852bdb4feeba02443c742073df'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:52.419504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151946d-2abc-4bb3-a528-ba4379639729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:52.420165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151946d-2abc-4bb3-a528-ba4379639729 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:52.420561 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151946d-2abc-4bb3-a528-ba4379639729 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:52.420966 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151946d-2abc-4bb3-a528-ba4379639729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:52.422978 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-5151946d-2abc-4bb3-a528-ba4379639729 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:52.458004 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 996/1966] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:52 2022] DELETE /identity/v3/users/5eb703852bdb4feeba02443c742073df => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:52.459221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151946d-2abc-4bb3-a528-ba4379639729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:52.465971 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b8cae-e71e-458d-9cea-f30e5ab5592b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:52.465971 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b8cae-e71e-458d-9cea-f30e5ab5592b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:52.465971 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b8cae-e71e-458d-9cea-f30e5ab5592b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:52.466412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151946d-2abc-4bb3-a528-ba4379639729 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:52.492318 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 971/1967] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:52.500254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-590b8cae-e71e-458d-9cea-f30e5ab5592b None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:52.501683 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-590b8cae-e71e-458d-9cea-f30e5ab5592b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:52.603542 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 997/1968] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:52.619666 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151946d-2abc-4bb3-a528-ba4379639729 service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:52.622362 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-5151946d-2abc-4bb3-a528-ba4379639729 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:52.641693 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151946d-2abc-4bb3-a528-ba4379639729 service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:52.713547 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b8cae-e71e-458d-9cea-f30e5ab5592b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:52.716733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-590b8cae-e71e-458d-9cea-f30e5ab5592b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:52.739091 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b8cae-e71e-458d-9cea-f30e5ab5592b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:52.746281 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a2bc1-4647-413f-bff2-3be98a30e0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:52.747269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a2bc1-4647-413f-bff2-3be98a30e0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:52.748002 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a2bc1-4647-413f-bff2-3be98a30e0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:52.748511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a2bc1-4647-413f-bff2-3be98a30e0b6 admin admin] PATH_INFO: `/v3/projects/a584d43fb0de43f89a700ad037088d6d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:52.750864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a2bc1-4647-413f-bff2-3be98a30e0b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a584d43fb0de43f89a700ad037088d6d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:52.754373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a2bc1-4647-413f-bff2-3be98a30e0b6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:52.760862 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8168b1-85d0-44b8-988d-bbbec08957df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:52.761491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8168b1-85d0-44b8-988d-bbbec08957df service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:52.761781 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8168b1-85d0-44b8-988d-bbbec08957df service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:52.762064 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8168b1-85d0-44b8-988d-bbbec08957df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:52.787508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8168b1-85d0-44b8-988d-bbbec08957df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:52.789346 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8168b1-85d0-44b8-988d-bbbec08957df service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:52.827249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 972/1969] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:52.868848 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4a6a2bc1-4647-413f-bff2-3be98a30e0b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a584d43fb0de43f89a700ad037088d6d', 'request_id': 'req-4a6a2bc1-4647-413f-bff2-3be98a30e0b6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:52.877798 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4a6a2bc1-4647-413f-bff2-3be98a30e0b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a584d43fb0de43f89a700ad037088d6d', 'request_id': 'req-4a6a2bc1-4647-413f-bff2-3be98a30e0b6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:52.895266 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4a6a2bc1-4647-413f-bff2-3be98a30e0b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a584d43fb0de43f89a700ad037088d6d', 'request_id': 'req-4a6a2bc1-4647-413f-bff2-3be98a30e0b6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:52.929779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4a6a2bc1-4647-413f-bff2-3be98a30e0b6 admin admin] The token cache is being invalidate because project a584d43fb0de43f89a700ad037088d6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:52.929779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4a6a2bc1-4647-413f-bff2-3be98a30e0b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:52.932600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4a6a2bc1-4647-413f-bff2-3be98a30e0b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:52.940544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 998/1970] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:52 2022] DELETE /identity/v3/projects/a584d43fb0de43f89a700ad037088d6d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:52.944153 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8168b1-85d0-44b8-988d-bbbec08957df service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:52.967264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8168b1-85d0-44b8-988d-bbbec08957df service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:53.029093 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a2bc1-4647-413f-bff2-3be98a30e0b6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:53.030859 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4a6a2bc1-4647-413f-bff2-3be98a30e0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:53.182465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7dcfe2-2cad-41ae-9581-02ecb9000941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:53.183139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dcfe2-2cad-41ae-9581-02ecb9000941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:53.183424 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dcfe2-2cad-41ae-9581-02ecb9000941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:53.183703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7dcfe2-2cad-41ae-9581-02ecb9000941 admin admin] PATH_INFO: `/v3/users/9cae6e033fee42788df0b85b3f04311a` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:53.187491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7dcfe2-2cad-41ae-9581-02ecb9000941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cae6e033fee42788df0b85b3f04311a)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:53.191683 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7dcfe2-2cad-41ae-9581-02ecb9000941 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:53.191815 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:53.217150 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a2bc1-4647-413f-bff2-3be98a30e0b6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:53.234365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9425b0-209f-4207-96a4-1086bbb7fd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:53.235878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9425b0-209f-4207-96a4-1086bbb7fd57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:53.236353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9425b0-209f-4207-96a4-1086bbb7fd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:53.236650 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9425b0-209f-4207-96a4-1086bbb7fd57 admin admin] PATH_INFO: `/v3/users/3c8a6692f1ca4748ab1b3744dd8e531a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:53.238589 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9425b0-209f-4207-96a4-1086bbb7fd57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c8a6692f1ca4748ab1b3744dd8e531a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:53.246264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9425b0-209f-4207-96a4-1086bbb7fd57 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:53.276086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-af7dcfe2-2cad-41ae-9581-02ecb9000941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cae6e033fee42788df0b85b3f04311a'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.277379 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-af7dcfe2-2cad-41ae-9581-02ecb9000941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cae6e033fee42788df0b85b3f04311a'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.326484 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-af7dcfe2-2cad-41ae-9581-02ecb9000941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cae6e033fee42788df0b85b3f04311a'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.328906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:53.341727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-af7dcfe2-2cad-41ae-9581-02ecb9000941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cae6e033fee42788df0b85b3f04311a'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.342443 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-af7dcfe2-2cad-41ae-9581-02ecb9000941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cae6e033fee42788df0b85b3f04311a'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.356047 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1a9425b0-209f-4207-96a4-1086bbb7fd57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c8a6692f1ca4748ab1b3744dd8e531a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.356753 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1a9425b0-209f-4207-96a4-1086bbb7fd57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c8a6692f1ca4748ab1b3744dd8e531a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.369021 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 973/1971] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:52 2022] DELETE /identity/v3/users/9cae6e033fee42788df0b85b3f04311a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:53.370034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7dcfe2-2cad-41ae-9581-02ecb9000941 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:53.374260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1a9425b0-209f-4207-96a4-1086bbb7fd57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c8a6692f1ca4748ab1b3744dd8e531a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.390779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1a9425b0-209f-4207-96a4-1086bbb7fd57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c8a6692f1ca4748ab1b3744dd8e531a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.392749 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-af7dcfe2-2cad-41ae-9581-02ecb9000941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:53.402272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1a9425b0-209f-4207-96a4-1086bbb7fd57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c8a6692f1ca4748ab1b3744dd8e531a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.412560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 999/1972] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:53 2022] DELETE /identity/v3/users/3c8a6692f1ca4748ab1b3744dd8e531a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:11:53.413591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9425b0-209f-4207-96a4-1086bbb7fd57 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:53.415272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1a9425b0-209f-4207-96a4-1086bbb7fd57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:53.526305 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7dcfe2-2cad-41ae-9581-02ecb9000941 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:53.542605 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9425b0-209f-4207-96a4-1086bbb7fd57 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:53.551172 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66e29a-2fe2-46f6-b48b-8f235a24b127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:53.552420 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66e29a-2fe2-46f6-b48b-8f235a24b127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:53.552630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66e29a-2fe2-46f6-b48b-8f235a24b127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:53.552970 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66e29a-2fe2-46f6-b48b-8f235a24b127 admin admin] PATH_INFO: `/v3/projects/a964231320fc4638904583a5021ff906` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:53.554874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66e29a-2fe2-46f6-b48b-8f235a24b127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a964231320fc4638904583a5021ff906)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:53.557866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66e29a-2fe2-46f6-b48b-8f235a24b127 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:53.593705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4790475-892c-4730-a339-f10f1dd92ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:53.594740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4790475-892c-4730-a339-f10f1dd92ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:53.595072 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4790475-892c-4730-a339-f10f1dd92ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:53.595505 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4790475-892c-4730-a339-f10f1dd92ac1 admin admin] PATH_INFO: `/v3/users/a433a3a56afd437db531dd8fda308c63` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:53.597674 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4790475-892c-4730-a339-f10f1dd92ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a433a3a56afd437db531dd8fda308c63)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:53.600495 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4790475-892c-4730-a339-f10f1dd92ac1 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:53.623155 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3d66e29a-2fe2-46f6-b48b-8f235a24b127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a964231320fc4638904583a5021ff906', 'request_id': 'req-3d66e29a-2fe2-46f6-b48b-8f235a24b127'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.631423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3d66e29a-2fe2-46f6-b48b-8f235a24b127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a964231320fc4638904583a5021ff906', 'request_id': 'req-3d66e29a-2fe2-46f6-b48b-8f235a24b127'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.638285 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3d66e29a-2fe2-46f6-b48b-8f235a24b127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a964231320fc4638904583a5021ff906', 'request_id': 'req-3d66e29a-2fe2-46f6-b48b-8f235a24b127'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.652428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3d66e29a-2fe2-46f6-b48b-8f235a24b127 admin admin] The token cache is being invalidate because project a964231320fc4638904583a5021ff906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:53.652793 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3d66e29a-2fe2-46f6-b48b-8f235a24b127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.653477 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3d66e29a-2fe2-46f6-b48b-8f235a24b127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.658588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1000/1973] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:53 2022] DELETE /identity/v3/projects/a964231320fc4638904583a5021ff906 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:53.658588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66e29a-2fe2-46f6-b48b-8f235a24b127 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:53.658588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3d66e29a-2fe2-46f6-b48b-8f235a24b127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:53.663312 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:53.669410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e4790475-892c-4730-a339-f10f1dd92ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a433a3a56afd437db531dd8fda308c63'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.670118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e4790475-892c-4730-a339-f10f1dd92ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a433a3a56afd437db531dd8fda308c63'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.689101 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e4790475-892c-4730-a339-f10f1dd92ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a433a3a56afd437db531dd8fda308c63'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.702086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e4790475-892c-4730-a339-f10f1dd92ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a433a3a56afd437db531dd8fda308c63'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.702908 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e4790475-892c-4730-a339-f10f1dd92ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a433a3a56afd437db531dd8fda308c63'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.723335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 974/1974] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:53 2022] DELETE /identity/v3/users/a433a3a56afd437db531dd8fda308c63 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:53.724780 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18eee0-1071-4a68-adf0-9090b450600e None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:53.725075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18eee0-1071-4a68-adf0-9090b450600e None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:53.725356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18eee0-1071-4a68-adf0-9090b450600e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:53.760146 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-ac18eee0-1071-4a68-adf0-9090b450600e None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:53.761456 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ac18eee0-1071-4a68-adf0-9090b450600e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:53.767317 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:53.774559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66e29a-2fe2-46f6-b48b-8f235a24b127 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:53.856603 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 975/1975] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:53.856603 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18eee0-1071-4a68-adf0-9090b450600e None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:53.867320 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ac18eee0-1071-4a68-adf0-9090b450600e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:53.882676 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18eee0-1071-4a68-adf0-9090b450600e None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:53.891248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c14e1-c4fd-4568-bf6a-4afe5a17e948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:53.892369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c14e1-c4fd-4568-bf6a-4afe5a17e948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:53.892687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c14e1-c4fd-4568-bf6a-4afe5a17e948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:53.892968 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c14e1-c4fd-4568-bf6a-4afe5a17e948 admin admin] PATH_INFO: `/v3/users/548c6dbfc7564c2f93257caba282f912` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:53.895085 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c14e1-c4fd-4568-bf6a-4afe5a17e948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=548c6dbfc7564c2f93257caba282f912)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:53.897162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c14e1-c4fd-4568-bf6a-4afe5a17e948 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:53.897784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fdfb8-f871-41c1-97d9-270258145519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:53.898785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fdfb8-f871-41c1-97d9-270258145519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:53.899081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fdfb8-f871-41c1-97d9-270258145519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:53.899361 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fdfb8-f871-41c1-97d9-270258145519 admin admin] PATH_INFO: `/v3/projects/400924b74fdc417bab2a1e2b7cb18579` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:53.900877 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fdfb8-f871-41c1-97d9-270258145519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=400924b74fdc417bab2a1e2b7cb18579)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:53.903256 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fdfb8-f871-41c1-97d9-270258145519 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:53.972423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bf3fdfb8-f871-41c1-97d9-270258145519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '400924b74fdc417bab2a1e2b7cb18579', 'request_id': 'req-bf3fdfb8-f871-41c1-97d9-270258145519'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.976446 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-002c14e1-c4fd-4568-bf6a-4afe5a17e948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548c6dbfc7564c2f93257caba282f912'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.977154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-002c14e1-c4fd-4568-bf6a-4afe5a17e948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548c6dbfc7564c2f93257caba282f912'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.979633 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bf3fdfb8-f871-41c1-97d9-270258145519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '400924b74fdc417bab2a1e2b7cb18579', 'request_id': 'req-bf3fdfb8-f871-41c1-97d9-270258145519'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.986391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bf3fdfb8-f871-41c1-97d9-270258145519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '400924b74fdc417bab2a1e2b7cb18579', 'request_id': 'req-bf3fdfb8-f871-41c1-97d9-270258145519'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.990980 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-002c14e1-c4fd-4568-bf6a-4afe5a17e948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548c6dbfc7564c2f93257caba282f912'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.998870 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-002c14e1-c4fd-4568-bf6a-4afe5a17e948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548c6dbfc7564c2f93257caba282f912'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:53.999805 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-002c14e1-c4fd-4568-bf6a-4afe5a17e948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548c6dbfc7564c2f93257caba282f912'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:54.001751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bf3fdfb8-f871-41c1-97d9-270258145519 admin admin] The token cache is being invalidate because project 400924b74fdc417bab2a1e2b7cb18579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:54.002046 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bf3fdfb8-f871-41c1-97d9-270258145519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:54.003848 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bf3fdfb8-f871-41c1-97d9-270258145519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:54.005606 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1001/1976] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:53 2022] DELETE /identity/v3/projects/400924b74fdc417bab2a1e2b7cb18579 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:54.006953 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d58c9-c7ac-442e-b48d-a3770c1b1a5a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:54.007241 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d58c9-c7ac-442e-b48d-a3770c1b1a5a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:54.008054 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d58c9-c7ac-442e-b48d-a3770c1b1a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:54.017114 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 976/1977] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:53 2022] DELETE /identity/v3/users/548c6dbfc7564c2f93257caba282f912 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:54.017958 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c14e1-c4fd-4568-bf6a-4afe5a17e948 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:54.019913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-002c14e1-c4fd-4568-bf6a-4afe5a17e948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:54.031069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5c3d58c9-c7ac-442e-b48d-a3770c1b1a5a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:54.032922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5c3d58c9-c7ac-442e-b48d-a3770c1b1a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:54.080605 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:54.105733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c14e1-c4fd-4568-bf6a-4afe5a17e948 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:54.110995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d283734-10b4-4ba5-adff-7e8ada68ffa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:54.111654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d283734-10b4-4ba5-adff-7e8ada68ffa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:54.111936 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d283734-10b4-4ba5-adff-7e8ada68ffa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:54.112617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d283734-10b4-4ba5-adff-7e8ada68ffa6 admin admin] PATH_INFO: `/v3/projects/1672ea049403414aa9b33b758c56bff7` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:54.115031 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d283734-10b4-4ba5-adff-7e8ada68ffa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1672ea049403414aa9b33b758c56bff7)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:54.117051 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d283734-10b4-4ba5-adff-7e8ada68ffa6 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:54.118172 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1002/1978] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:54.119486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d58c9-c7ac-442e-b48d-a3770c1b1a5a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:54.127553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5c3d58c9-c7ac-442e-b48d-a3770c1b1a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:54.152045 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:54.185904 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-6d283734-10b4-4ba5-adff-7e8ada68ffa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1672ea049403414aa9b33b758c56bff7', 'request_id': 'req-6d283734-10b4-4ba5-adff-7e8ada68ffa6'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:54.194342 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-6d283734-10b4-4ba5-adff-7e8ada68ffa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1672ea049403414aa9b33b758c56bff7', 'request_id': 'req-6d283734-10b4-4ba5-adff-7e8ada68ffa6'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:54.201293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-6d283734-10b4-4ba5-adff-7e8ada68ffa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1672ea049403414aa9b33b758c56bff7', 'request_id': 'req-6d283734-10b4-4ba5-adff-7e8ada68ffa6'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:54.201674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d58c9-c7ac-442e-b48d-a3770c1b1a5a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:54.217302 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-6d283734-10b4-4ba5-adff-7e8ada68ffa6 admin admin] The token cache is being invalidate because project 1672ea049403414aa9b33b758c56bff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:54.217586 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-6d283734-10b4-4ba5-adff-7e8ada68ffa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:54.218260 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-6d283734-10b4-4ba5-adff-7e8ada68ffa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:54.223148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 977/1979] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:54 2022] DELETE /identity/v3/projects/1672ea049403414aa9b33b758c56bff7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:54.223148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d283734-10b4-4ba5-adff-7e8ada68ffa6 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:54.223148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-6d283734-10b4-4ba5-adff-7e8ada68ffa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:54.261996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724e968-284d-43f8-80cb-00fe96cd3032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:54.262889 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724e968-284d-43f8-80cb-00fe96cd3032 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:54.263042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724e968-284d-43f8-80cb-00fe96cd3032 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:54.263391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724e968-284d-43f8-80cb-00fe96cd3032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:54.265372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4724e968-284d-43f8-80cb-00fe96cd3032 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:54.312289 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d283734-10b4-4ba5-adff-7e8ada68ffa6 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:54.320157 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914ae7a-3d44-4ef4-a6f8-c4682dc31dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:54.320867 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914ae7a-3d44-4ef4-a6f8-c4682dc31dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:54.321153 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914ae7a-3d44-4ef4-a6f8-c4682dc31dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:54.321432 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914ae7a-3d44-4ef4-a6f8-c4682dc31dab admin admin] PATH_INFO: `/v3/users/268ffdb269444c1aaef709b482910082` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:54.323220 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914ae7a-3d44-4ef4-a6f8-c4682dc31dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=268ffdb269444c1aaef709b482910082)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:54.326847 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914ae7a-3d44-4ef4-a6f8-c4682dc31dab admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:54.346300 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724e968-284d-43f8-80cb-00fe96cd3032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:54.347834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724e968-284d-43f8-80cb-00fe96cd3032 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:54.365609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1003/1980] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:54.366557 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724e968-284d-43f8-80cb-00fe96cd3032 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:54.368177 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4724e968-284d-43f8-80cb-00fe96cd3032 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:54.394666 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724e968-284d-43f8-80cb-00fe96cd3032 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:54.403889 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c070d-1f9b-4b1c-bcca-10466e7b8197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:54.406103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c070d-1f9b-4b1c-bcca-10466e7b8197 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:54.406597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c070d-1f9b-4b1c-bcca-10466e7b8197 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:54.409275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c070d-1f9b-4b1c-bcca-10466e7b8197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:54.418255 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-153c070d-1f9b-4b1c-bcca-10466e7b8197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:54.431293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3914ae7a-3d44-4ef4-a6f8-c4682dc31dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '268ffdb269444c1aaef709b482910082'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:54.432349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3914ae7a-3d44-4ef4-a6f8-c4682dc31dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '268ffdb269444c1aaef709b482910082'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:54.434752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c070d-1f9b-4b1c-bcca-10466e7b8197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:54.444313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c070d-1f9b-4b1c-bcca-10466e7b8197 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:54.454880 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3914ae7a-3d44-4ef4-a6f8-c4682dc31dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '268ffdb269444c1aaef709b482910082'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:54.461049 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1004/1981] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:54.463008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78918891-cd86-402c-ba51-9651ad282df7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:54.463599 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78918891-cd86-402c-ba51-9651ad282df7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:54.464807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78918891-cd86-402c-ba51-9651ad282df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:54.470224 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3914ae7a-3d44-4ef4-a6f8-c4682dc31dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '268ffdb269444c1aaef709b482910082'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:54.472161 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3914ae7a-3d44-4ef4-a6f8-c4682dc31dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '268ffdb269444c1aaef709b482910082'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:54.493081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-78918891-cd86-402c-ba51-9651ad282df7 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:54.495508 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-78918891-cd86-402c-ba51-9651ad282df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:54.496797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 978/1982] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:54 2022] DELETE /identity/v3/users/268ffdb269444c1aaef709b482910082 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:54.499673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914ae7a-3d44-4ef4-a6f8-c4682dc31dab admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:54.502419 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-3914ae7a-3d44-4ef4-a6f8-c4682dc31dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:54.570145 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:54.574749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:54.633741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914ae7a-3d44-4ef4-a6f8-c4682dc31dab admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:54.640958 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f428a-90d1-4de0-8c6b-d87129a120d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:54.641742 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f428a-90d1-4de0-8c6b-d87129a120d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:54.642146 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f428a-90d1-4de0-8c6b-d87129a120d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:54.642501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f428a-90d1-4de0-8c6b-d87129a120d4 admin admin] PATH_INFO: `/v3/projects/5d611c143d8a4a8ea6ef9042cb6abe4c` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:54.644673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f428a-90d1-4de0-8c6b-d87129a120d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d611c143d8a4a8ea6ef9042cb6abe4c)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:54.648030 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f428a-90d1-4de0-8c6b-d87129a120d4 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:54.664880 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1005/1983] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:54.673445 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa30d36-0d81-4763-9e0e-489c3ddd0ec9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:54.673989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa30d36-0d81-4763-9e0e-489c3ddd0ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:54.674476 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa30d36-0d81-4763-9e0e-489c3ddd0ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:54.704526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-baa30d36-0d81-4763-9e0e-489c3ddd0ec9 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:54.706047 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-baa30d36-0d81-4763-9e0e-489c3ddd0ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:54.719577 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1006/1984] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:54.721048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa30d36-0d81-4763-9e0e-489c3ddd0ec9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:54.733938 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa30d36-0d81-4763-9e0e-489c3ddd0ec9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:54.744790 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d2d4c-1bde-4ad8-9758-bf0731bc47b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:54.747630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d2d4c-1bde-4ad8-9758-bf0731bc47b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:54.747913 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d2d4c-1bde-4ad8-9758-bf0731bc47b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:54.748281 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d2d4c-1bde-4ad8-9758-bf0731bc47b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:54.749118 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d2d4c-1bde-4ad8-9758-bf0731bc47b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:54.749349 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d2d4c-1bde-4ad8-9758-bf0731bc47b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:54.750984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d2d4c-1bde-4ad8-9758-bf0731bc47b5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:54.768274 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1007/1985] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:54.773325 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d2d4c-1bde-4ad8-9758-bf0731bc47b5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:54.777411 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-872f428a-90d1-4de0-8c6b-d87129a120d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d611c143d8a4a8ea6ef9042cb6abe4c', 'request_id': 'req-872f428a-90d1-4de0-8c6b-d87129a120d4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:54.785063 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-872f428a-90d1-4de0-8c6b-d87129a120d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d611c143d8a4a8ea6ef9042cb6abe4c', 'request_id': 'req-872f428a-90d1-4de0-8c6b-d87129a120d4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:54.789895 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d2d4c-1bde-4ad8-9758-bf0731bc47b5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:54.795198 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-872f428a-90d1-4de0-8c6b-d87129a120d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d611c143d8a4a8ea6ef9042cb6abe4c', 'request_id': 'req-872f428a-90d1-4de0-8c6b-d87129a120d4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:54.822766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-872f428a-90d1-4de0-8c6b-d87129a120d4 admin admin] The token cache is being invalidate because project 5d611c143d8a4a8ea6ef9042cb6abe4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:54.823063 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-872f428a-90d1-4de0-8c6b-d87129a120d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:54.826144 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-872f428a-90d1-4de0-8c6b-d87129a120d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:54.830640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 979/1986] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:54 2022] DELETE /identity/v3/projects/5d611c143d8a4a8ea6ef9042cb6abe4c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:54.836415 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f935c-f4a7-40da-9d30-fff4c4da5ced None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:54.836747 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f935c-f4a7-40da-9d30-fff4c4da5ced None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:54.837029 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f935c-f4a7-40da-9d30-fff4c4da5ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:54.882361 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db009f-ac7d-4253-aa5c-1ec3527317bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:54.883384 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db009f-ac7d-4253-aa5c-1ec3527317bf admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:54.883976 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db009f-ac7d-4253-aa5c-1ec3527317bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:54.884414 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db009f-ac7d-4253-aa5c-1ec3527317bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:54.884697 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-974f935c-f4a7-40da-9d30-fff4c4da5ced None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:54.885321 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db009f-ac7d-4253-aa5c-1ec3527317bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:54.886968 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-974f935c-f4a7-40da-9d30-fff4c4da5ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:54.887905 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db009f-ac7d-4253-aa5c-1ec3527317bf admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:54.900151 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 980/1987] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:11:54.910757 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894fbd0-d4a6-4946-ac90-cc5843d281c7 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:54.911110 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894fbd0-d4a6-4946-ac90-cc5843d281c7 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:54.911494 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894fbd0-d4a6-4946-ac90-cc5843d281c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:54.940290 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1008/1988] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:54 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:54.944791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db009f-ac7d-4253-aa5c-1ec3527317bf admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:54.947180 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-83db009f-ac7d-4253-aa5c-1ec3527317bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:54.970172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-f894fbd0-d4a6-4946-ac90-cc5843d281c7 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:54.976358 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f894fbd0-d4a6-4946-ac90-cc5843d281c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:55.098715 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db009f-ac7d-4253-aa5c-1ec3527317bf admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:55.107304 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa5d61-037c-4cc3-bc72-34448223738f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:55.108111 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa5d61-037c-4cc3-bc72-34448223738f admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:55.108578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa5d61-037c-4cc3-bc72-34448223738f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:55.108955 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa5d61-037c-4cc3-bc72-34448223738f admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:55.110741 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa5d61-037c-4cc3-bc72-34448223738f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:55.113646 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa5d61-037c-4cc3-bc72-34448223738f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:55.139816 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 981/1989] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:11:55.141537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894fbd0-d4a6-4946-ac90-cc5843d281c7 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:55.143463 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f894fbd0-d4a6-4946-ac90-cc5843d281c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:55.150565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1009/1990] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:54 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:55.152354 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa5d61-037c-4cc3-bc72-34448223738f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:55.160889 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894fbd0-d4a6-4946-ac90-cc5843d281c7 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:55.169069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa5d61-037c-4cc3-bc72-34448223738f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:55.169224 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4f9b7-e072-4dd5-842b-60f48ff400b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:55.169404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4f9b7-e072-4dd5-842b-60f48ff400b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:55.169600 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4f9b7-e072-4dd5-842b-60f48ff400b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:55.170039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4f9b7-e072-4dd5-842b-60f48ff400b9 admin admin] PATH_INFO: `/v3/projects/2403407e426e48f6b15ed94d1830e009` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:55.171499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4f9b7-e072-4dd5-842b-60f48ff400b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2403407e426e48f6b15ed94d1830e009)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:55.174139 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c30cf2-30cf-42b3-94f0-fa041de8c4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:55.174964 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4f9b7-e072-4dd5-842b-60f48ff400b9 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:55.175107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c30cf2-30cf-42b3-94f0-fa041de8c4db admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:55.176077 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c30cf2-30cf-42b3-94f0-fa041de8c4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:55.176701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c30cf2-30cf-42b3-94f0-fa041de8c4db admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:55.177697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c30cf2-30cf-42b3-94f0-fa041de8c4db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:55.178097 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c30cf2-30cf-42b3-94f0-fa041de8c4db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:55.179907 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c30cf2-30cf-42b3-94f0-fa041de8c4db admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:55.195438 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1010/1991] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:55.195571 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c30cf2-30cf-42b3-94f0-fa041de8c4db admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:55.217472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c30cf2-30cf-42b3-94f0-fa041de8c4db admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:55.224317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492938e-ac66-4a4a-a1d2-f5f724bce001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:55.224854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492938e-ac66-4a4a-a1d2-f5f724bce001 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:55.225143 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492938e-ac66-4a4a-a1d2-f5f724bce001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:55.225419 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492938e-ac66-4a4a-a1d2-f5f724bce001 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:55.226123 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492938e-ac66-4a4a-a1d2-f5f724bce001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:55.227910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492938e-ac66-4a4a-a1d2-f5f724bce001 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:55.245926 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-b3f4f9b7-e072-4dd5-842b-60f48ff400b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2403407e426e48f6b15ed94d1830e009', 'request_id': 'req-b3f4f9b7-e072-4dd5-842b-60f48ff400b9'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.247687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:55.262295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1011/1992] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:55.263246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492938e-ac66-4a4a-a1d2-f5f724bce001 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:55.270765 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-b3f4f9b7-e072-4dd5-842b-60f48ff400b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2403407e426e48f6b15ed94d1830e009', 'request_id': 'req-b3f4f9b7-e072-4dd5-842b-60f48ff400b9'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.274072 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:55.279046 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-b3f4f9b7-e072-4dd5-842b-60f48ff400b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2403407e426e48f6b15ed94d1830e009', 'request_id': 'req-b3f4f9b7-e072-4dd5-842b-60f48ff400b9'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.282972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492938e-ac66-4a4a-a1d2-f5f724bce001 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:55.303295 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-b3f4f9b7-e072-4dd5-842b-60f48ff400b9 admin admin] The token cache is being invalidate because project 2403407e426e48f6b15ed94d1830e009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:55.303733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-b3f4f9b7-e072-4dd5-842b-60f48ff400b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.306232 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-b3f4f9b7-e072-4dd5-842b-60f48ff400b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.310730 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 982/1993] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:55 2022] DELETE /identity/v3/projects/2403407e426e48f6b15ed94d1830e009 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:55.310730 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4f9b7-e072-4dd5-842b-60f48ff400b9 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:55.313377 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b3f4f9b7-e072-4dd5-842b-60f48ff400b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:55.380396 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debc58b-c71a-42cb-85ef-cb76094692b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:55.381200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debc58b-c71a-42cb-85ef-cb76094692b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:55.381550 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debc58b-c71a-42cb-85ef-cb76094692b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:55.381954 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debc58b-c71a-42cb-85ef-cb76094692b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:55.382703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debc58b-c71a-42cb-85ef-cb76094692b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:55.384746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9debc58b-c71a-42cb-85ef-cb76094692b8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:55.401435 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4f9b7-e072-4dd5-842b-60f48ff400b9 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:55.407806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b9a23-68f9-40bf-9590-8c4c45e5df70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:55.408539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b9a23-68f9-40bf-9590-8c4c45e5df70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:55.408826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b9a23-68f9-40bf-9590-8c4c45e5df70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:55.409102 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b9a23-68f9-40bf-9590-8c4c45e5df70 admin admin] PATH_INFO: `/v3/projects/a2b12c098f024af7a4e92d09647df160` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:55.411028 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b9a23-68f9-40bf-9590-8c4c45e5df70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2b12c098f024af7a4e92d09647df160)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:55.413118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b9a23-68f9-40bf-9590-8c4c45e5df70 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:55.419215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1012/1994] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:55 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:55.420562 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debc58b-c71a-42cb-85ef-cb76094692b8 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:55.423255 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9debc58b-c71a-42cb-85ef-cb76094692b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:55.501999 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-625b9a23-68f9-40bf-9590-8c4c45e5df70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2b12c098f024af7a4e92d09647df160', 'request_id': 'req-625b9a23-68f9-40bf-9590-8c4c45e5df70'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.512257 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-625b9a23-68f9-40bf-9590-8c4c45e5df70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2b12c098f024af7a4e92d09647df160', 'request_id': 'req-625b9a23-68f9-40bf-9590-8c4c45e5df70'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.517915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debc58b-c71a-42cb-85ef-cb76094692b8 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:55.524749 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-625b9a23-68f9-40bf-9590-8c4c45e5df70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2b12c098f024af7a4e92d09647df160', 'request_id': 'req-625b9a23-68f9-40bf-9590-8c4c45e5df70'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.543753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-625b9a23-68f9-40bf-9590-8c4c45e5df70 admin admin] The token cache is being invalidate because project a2b12c098f024af7a4e92d09647df160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:55.544216 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-625b9a23-68f9-40bf-9590-8c4c45e5df70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.544954 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-625b9a23-68f9-40bf-9590-8c4c45e5df70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.546671 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 983/1995] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:55 2022] DELETE /identity/v3/projects/a2b12c098f024af7a4e92d09647df160 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:55.547482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b9a23-68f9-40bf-9590-8c4c45e5df70 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:55.549578 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-625b9a23-68f9-40bf-9590-8c4c45e5df70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:55.604241 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b13d1-6b07-4735-8b00-6d459ddf8284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:55.605057 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b13d1-6b07-4735-8b00-6d459ddf8284 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:55.605346 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b13d1-6b07-4735-8b00-6d459ddf8284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:55.605622 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b13d1-6b07-4735-8b00-6d459ddf8284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:55.606329 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b13d1-6b07-4735-8b00-6d459ddf8284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:55.608013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b13d1-6b07-4735-8b00-6d459ddf8284 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:55.621724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1013/1996] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:55.622765 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b13d1-6b07-4735-8b00-6d459ddf8284 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:55.624519 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ee9b13d1-6b07-4735-8b00-6d459ddf8284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:55.631412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b9a23-68f9-40bf-9590-8c4c45e5df70 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:55.638844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b13d1-6b07-4735-8b00-6d459ddf8284 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:55.643601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c34b8b-acac-44d8-90b4-5bc43e7f85e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:55.644860 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c34b8b-acac-44d8-90b4-5bc43e7f85e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:55.645110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c34b8b-acac-44d8-90b4-5bc43e7f85e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:55.645472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c34b8b-acac-44d8-90b4-5bc43e7f85e3 admin admin] PATH_INFO: `/v3/projects/8705d257ba4b4fdfb360187dcdd7dee7` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:55.646888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c34b8b-acac-44d8-90b4-5bc43e7f85e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8705d257ba4b4fdfb360187dcdd7dee7)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:55.649178 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c34b8b-acac-44d8-90b4-5bc43e7f85e3 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:55.651525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff483fb1-80c3-41cd-8ddb-bdc22cec4fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:55.653113 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483fb1-80c3-41cd-8ddb-bdc22cec4fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:55.653688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483fb1-80c3-41cd-8ddb-bdc22cec4fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:55.654337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff483fb1-80c3-41cd-8ddb-bdc22cec4fd4 admin admin] PATH_INFO: `/v3/users/e2aefd840987498b930291840572d6e0` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:55.655827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff483fb1-80c3-41cd-8ddb-bdc22cec4fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2aefd840987498b930291840572d6e0)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:55.662678 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff483fb1-80c3-41cd-8ddb-bdc22cec4fd4 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:55.677432 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:55.696746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:55.718303 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-89c34b8b-acac-44d8-90b4-5bc43e7f85e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8705d257ba4b4fdfb360187dcdd7dee7', 'request_id': 'req-89c34b8b-acac-44d8-90b4-5bc43e7f85e3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.720799 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-ff483fb1-80c3-41cd-8ddb-bdc22cec4fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2aefd840987498b930291840572d6e0'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.721492 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-ff483fb1-80c3-41cd-8ddb-bdc22cec4fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2aefd840987498b930291840572d6e0'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.726218 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-89c34b8b-acac-44d8-90b4-5bc43e7f85e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8705d257ba4b4fdfb360187dcdd7dee7', 'request_id': 'req-89c34b8b-acac-44d8-90b4-5bc43e7f85e3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.732206 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-89c34b8b-acac-44d8-90b4-5bc43e7f85e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8705d257ba4b4fdfb360187dcdd7dee7', 'request_id': 'req-89c34b8b-acac-44d8-90b4-5bc43e7f85e3'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.735897 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-ff483fb1-80c3-41cd-8ddb-bdc22cec4fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2aefd840987498b930291840572d6e0'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.744285 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-ff483fb1-80c3-41cd-8ddb-bdc22cec4fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2aefd840987498b930291840572d6e0'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.745039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-ff483fb1-80c3-41cd-8ddb-bdc22cec4fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2aefd840987498b930291840572d6e0'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.745514 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-89c34b8b-acac-44d8-90b4-5bc43e7f85e3 admin admin] The token cache is being invalidate because project 8705d257ba4b4fdfb360187dcdd7dee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:55.745805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-89c34b8b-acac-44d8-90b4-5bc43e7f85e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.746449 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-89c34b8b-acac-44d8-90b4-5bc43e7f85e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.748050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1014/1997] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:55 2022] DELETE /identity/v3/projects/8705d257ba4b4fdfb360187dcdd7dee7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:55.748845 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c34b8b-acac-44d8-90b4-5bc43e7f85e3 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:55.750308 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-89c34b8b-acac-44d8-90b4-5bc43e7f85e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:55.759490 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 984/1998] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:55 2022] DELETE /identity/v3/users/e2aefd840987498b930291840572d6e0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:55.760417 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff483fb1-80c3-41cd-8ddb-bdc22cec4fd4 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:55.762472 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ff483fb1-80c3-41cd-8ddb-bdc22cec4fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:55.841276 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c34b8b-acac-44d8-90b4-5bc43e7f85e3 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:55.858873 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff483fb1-80c3-41cd-8ddb-bdc22cec4fd4 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:55.865136 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877de80-cb76-4b14-935c-b12a097ff710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:55.865828 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877de80-cb76-4b14-935c-b12a097ff710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:55.866096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877de80-cb76-4b14-935c-b12a097ff710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:55.866360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877de80-cb76-4b14-935c-b12a097ff710 admin admin] PATH_INFO: `/v3/users/80e249ec67644d47bdff9f146e972ad4` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:55.868277 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877de80-cb76-4b14-935c-b12a097ff710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80e249ec67644d47bdff9f146e972ad4)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:55.870260 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877de80-cb76-4b14-935c-b12a097ff710 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:55.928271 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-7877de80-cb76-4b14-935c-b12a097ff710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80e249ec67644d47bdff9f146e972ad4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.929276 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40f428-b7f7-49a3-a1d3-e25cb17c575a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:55.929718 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-7877de80-cb76-4b14-935c-b12a097ff710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80e249ec67644d47bdff9f146e972ad4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.929918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40f428-b7f7-49a3-a1d3-e25cb17c575a admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:55.930208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40f428-b7f7-49a3-a1d3-e25cb17c575a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:55.930488 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40f428-b7f7-49a3-a1d3-e25cb17c575a admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:55.931501 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40f428-b7f7-49a3-a1d3-e25cb17c575a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:55.933275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40f428-b7f7-49a3-a1d3-e25cb17c575a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:55.946081 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-7877de80-cb76-4b14-935c-b12a097ff710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80e249ec67644d47bdff9f146e972ad4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.959620 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-7877de80-cb76-4b14-935c-b12a097ff710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80e249ec67644d47bdff9f146e972ad4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.960716 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-7877de80-cb76-4b14-935c-b12a097ff710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80e249ec67644d47bdff9f146e972ad4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:55.961654 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1015/1999] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:55 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:55.966341 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40f428-b7f7-49a3-a1d3-e25cb17c575a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:55.968681 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-de40f428-b7f7-49a3-a1d3-e25cb17c575a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:55.977601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 985/2000] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:55 2022] DELETE /identity/v3/users/80e249ec67644d47bdff9f146e972ad4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:55.978790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da8ddc-bd45-4e48-a935-893cb38e550e None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:55.979121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da8ddc-bd45-4e48-a935-893cb38e550e None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:55.979441 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da8ddc-bd45-4e48-a935-893cb38e550e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:55.985416 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40f428-b7f7-49a3-a1d3-e25cb17c575a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:55.999134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:56.007174 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-51da8ddc-bd45-4e48-a935-893cb38e550e None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:56.009118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-51da8ddc-bd45-4e48-a935-893cb38e550e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:56.060797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:56.089281 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6adde-6965-4c3e-a481-b956056ac11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:56.090021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6adde-6965-4c3e-a481-b956056ac11d admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:56.090307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6adde-6965-4c3e-a481-b956056ac11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:56.090580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6adde-6965-4c3e-a481-b956056ac11d admin admin] PATH_INFO: `/v3/projects/698968b5cefe492ebc27941a82301499/users/59d6ef9e10c343b2a91474f5955fceb6/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:56.110613 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6adde-6965-4c3e-a481-b956056ac11d admin admin] RBAC: Authorizing `identity:create_grant(project_id=698968b5cefe492ebc27941a82301499, user_id=59d6ef9e10c343b2a91474f5955fceb6, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:56.114356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb6adde-6965-4c3e-a481-b956056ac11d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:56.126774 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 986/2001] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:56.127925 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da8ddc-bd45-4e48-a935-893cb38e550e None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:56.130676 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-51da8ddc-bd45-4e48-a935-893cb38e550e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:56.135872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1016/2002] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:55 2022] PUT /identity/v3/projects/698968b5cefe492ebc27941a82301499/users/59d6ef9e10c343b2a91474f5955fceb6/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:56.136970 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6adde-6965-4c3e-a481-b956056ac11d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:56.138821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6eb6adde-6965-4c3e-a481-b956056ac11d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:56.148827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da8ddc-bd45-4e48-a935-893cb38e550e None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:56.222859 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3eb371-b8de-4a33-bdf3-aecaa7ad4793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:56.223719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eb371-b8de-4a33-bdf3-aecaa7ad4793 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:56.224520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eb371-b8de-4a33-bdf3-aecaa7ad4793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:56.224520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3eb371-b8de-4a33-bdf3-aecaa7ad4793 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:56.225153 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3eb371-b8de-4a33-bdf3-aecaa7ad4793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:56.226907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3eb371-b8de-4a33-bdf3-aecaa7ad4793 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:56.227028 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6adde-6965-4c3e-a481-b956056ac11d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:56.235821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f69db8-942b-4cda-8c62-a37aeb4156a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:56.237540 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f69db8-942b-4cda-8c62-a37aeb4156a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:56.239053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f69db8-942b-4cda-8c62-a37aeb4156a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:56.239436 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f69db8-942b-4cda-8c62-a37aeb4156a1 admin admin] PATH_INFO: `/v3/projects/9ea274951909476aa07832b2452d003e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:56.240560 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 987/2003] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:56.242699 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a12d62-e84a-4491-bb87-629d16804c70 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:56.243163 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a12d62-e84a-4491-bb87-629d16804c70 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:56.243683 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a12d62-e84a-4491-bb87-629d16804c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:56.245575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f69db8-942b-4cda-8c62-a37aeb4156a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ea274951909476aa07832b2452d003e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:56.247905 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f69db8-942b-4cda-8c62-a37aeb4156a1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:56.269324 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-91a12d62-e84a-4491-bb87-629d16804c70 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:56.270630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-91a12d62-e84a-4491-bb87-629d16804c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:56.283621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 988/2004] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:56.283621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ed256-732d-48cb-ad7f-58793584b8d6 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:56.283621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ed256-732d-48cb-ad7f-58793584b8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:56.283621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ed256-732d-48cb-ad7f-58793584b8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:56.305409 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-231ed256-732d-48cb-ad7f-58793584b8d6 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:56.306987 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-231ed256-732d-48cb-ad7f-58793584b8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:56.322741 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f3f69db8-942b-4cda-8c62-a37aeb4156a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ea274951909476aa07832b2452d003e', 'request_id': 'req-f3f69db8-942b-4cda-8c62-a37aeb4156a1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:56.329893 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f3f69db8-942b-4cda-8c62-a37aeb4156a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ea274951909476aa07832b2452d003e', 'request_id': 'req-f3f69db8-942b-4cda-8c62-a37aeb4156a1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:56.338435 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f3f69db8-942b-4cda-8c62-a37aeb4156a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ea274951909476aa07832b2452d003e', 'request_id': 'req-f3f69db8-942b-4cda-8c62-a37aeb4156a1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:56.355488 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f3f69db8-942b-4cda-8c62-a37aeb4156a1 admin admin] The token cache is being invalidate because project 9ea274951909476aa07832b2452d003e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:56.355829 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f3f69db8-942b-4cda-8c62-a37aeb4156a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:56.356966 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f3f69db8-942b-4cda-8c62-a37aeb4156a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:56.359408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1017/2005] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:56 2022] DELETE /identity/v3/projects/9ea274951909476aa07832b2452d003e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:56.364209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f69db8-942b-4cda-8c62-a37aeb4156a1 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:56.366471 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f3f69db8-942b-4cda-8c62-a37aeb4156a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:56.382059 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 989/2006] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:56.383040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ed256-732d-48cb-ad7f-58793584b8d6 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:56.398056 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-231ed256-732d-48cb-ad7f-58793584b8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:56.435128 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ed256-732d-48cb-ad7f-58793584b8d6 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:56.442354 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fb8c9-d35d-42dc-a3aa-61fc5d556935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:56.443045 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fb8c9-d35d-42dc-a3aa-61fc5d556935 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:56.443330 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fb8c9-d35d-42dc-a3aa-61fc5d556935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:56.443608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fb8c9-d35d-42dc-a3aa-61fc5d556935 admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:56.444314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fb8c9-d35d-42dc-a3aa-61fc5d556935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:56.445164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fb8c9-d35d-42dc-a3aa-61fc5d556935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:56.447541 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6fb8c9-d35d-42dc-a3aa-61fc5d556935 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:56.455287 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f69db8-942b-4cda-8c62-a37aeb4156a1 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:56.462075 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4df707-7200-4180-a1f0-1bd534609589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:56.462804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4df707-7200-4180-a1f0-1bd534609589 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:56.463114 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4df707-7200-4180-a1f0-1bd534609589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:56.463447 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4df707-7200-4180-a1f0-1bd534609589 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:56.464336 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4df707-7200-4180-a1f0-1bd534609589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:56.466156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4df707-7200-4180-a1f0-1bd534609589 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:56.478363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 990/2007] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:56.478363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87367ada-e0eb-4330-893b-d81652dc5caf None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:56.478363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87367ada-e0eb-4330-893b-d81652dc5caf None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:56.478363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87367ada-e0eb-4330-893b-d81652dc5caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:56.482078 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1018/2008] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:56.482078 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4df707-7200-4180-a1f0-1bd534609589 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:56.483385 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4a4df707-7200-4180-a1f0-1bd534609589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:56.494109 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:56.507030 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-87367ada-e0eb-4330-893b-d81652dc5caf None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:56.509084 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-87367ada-e0eb-4330-893b-d81652dc5caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:56.531967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 991/2009] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:56.539634 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87367ada-e0eb-4330-893b-d81652dc5caf None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:56.557069 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87367ada-e0eb-4330-893b-d81652dc5caf None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:56.568036 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4399f-6641-4b55-8de9-03b7769d42f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:56.568732 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4399f-6641-4b55-8de9-03b7769d42f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:56.569015 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4399f-6641-4b55-8de9-03b7769d42f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:56.569291 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4399f-6641-4b55-8de9-03b7769d42f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:56.569968 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4399f-6641-4b55-8de9-03b7769d42f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:56.572359 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4399f-6641-4b55-8de9-03b7769d42f1 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:56.578365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4df707-7200-4180-a1f0-1bd534609589 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:56.584848 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba360d4-f181-45b4-b557-6eba6ce910f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:56.586065 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba360d4-f181-45b4-b557-6eba6ce910f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:56.586416 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba360d4-f181-45b4-b557-6eba6ce910f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:56.586854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba360d4-f181-45b4-b557-6eba6ce910f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:56.612257 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba360d4-f181-45b4-b557-6eba6ce910f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:56.614452 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba360d4-f181-45b4-b557-6eba6ce910f3 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:56.622764 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:56.643560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1019/2010] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:56.644673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba360d4-f181-45b4-b557-6eba6ce910f3 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:56.648833 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 992/2011] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:56 2022] POST /identity/v3/projects => generated 409 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:56.650561 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e9ed6-49f0-4d6b-bcd4-02d71907fd34 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:56.651086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e9ed6-49f0-4d6b-bcd4-02d71907fd34 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:56.651410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e9ed6-49f0-4d6b-bcd4-02d71907fd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:56.654635 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba360d4-f181-45b4-b557-6eba6ce910f3 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:56.678651 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-ca5e9ed6-49f0-4d6b-bcd4-02d71907fd34 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:56.682168 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ca5e9ed6-49f0-4d6b-bcd4-02d71907fd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:56.727566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b467f-3fab-4088-83ab-f98d67ae6aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:56.727566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b467f-3fab-4088-83ab-f98d67ae6aa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:56.727566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b467f-3fab-4088-83ab-f98d67ae6aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:56.727566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b467f-3fab-4088-83ab-f98d67ae6aa5 admin admin] PATH_INFO: `/v3/projects/365d8546119d4cdd96d522058b6ad166/users/8e97ceb88cd841d0acef85dfe1be1dd9/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:56.752550 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b467f-3fab-4088-83ab-f98d67ae6aa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=365d8546119d4cdd96d522058b6ad166, user_id=8e97ceb88cd841d0acef85dfe1be1dd9, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:56.756402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b467f-3fab-4088-83ab-f98d67ae6aa5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:56.786398 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1020/2012] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:56 2022] PUT /identity/v3/projects/365d8546119d4cdd96d522058b6ad166/users/8e97ceb88cd841d0acef85dfe1be1dd9/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:56.786398 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b467f-3fab-4088-83ab-f98d67ae6aa5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:56.788498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-897b467f-3fab-4088-83ab-f98d67ae6aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:56.796937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 993/2013] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:56.802846 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e9ed6-49f0-4d6b-bcd4-02d71907fd34 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:56.816615 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e9ed6-49f0-4d6b-bcd4-02d71907fd34 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:56.884749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b467f-3fab-4088-83ab-f98d67ae6aa5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:56.890295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bd083-4f91-43b1-a56e-a98afdc4830f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:56.891167 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bd083-4f91-43b1-a56e-a98afdc4830f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:56.891652 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bd083-4f91-43b1-a56e-a98afdc4830f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:56.892107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9bd083-4f91-43b1-a56e-a98afdc4830f admin admin] PATH_INFO: `/v3/projects/67941877a04046319b68b6887da30560` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:56.893521 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9bd083-4f91-43b1-a56e-a98afdc4830f admin admin] RBAC: Authorizing `identity:delete_project(project_id=67941877a04046319b68b6887da30560)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:56.897635 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9bd083-4f91-43b1-a56e-a98afdc4830f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:56.910771 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637dbc3-c02b-4364-99ac-a6f8c451b5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:56.911513 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637dbc3-c02b-4364-99ac-a6f8c451b5da admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:56.912348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637dbc3-c02b-4364-99ac-a6f8c451b5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:56.912687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637dbc3-c02b-4364-99ac-a6f8c451b5da admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:56.913621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637dbc3-c02b-4364-99ac-a6f8c451b5da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:56.916312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637dbc3-c02b-4364-99ac-a6f8c451b5da admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:56.944230 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 994/2014] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:56 2022] POST /identity/v3/users => generated 305 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:56.946025 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a99516-f2e1-49da-b5b4-55621ca949f2 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:56.946025 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a99516-f2e1-49da-b5b4-55621ca949f2 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:56.946287 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a99516-f2e1-49da-b5b4-55621ca949f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:56.954923 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:56.985602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3e9bd083-4f91-43b1-a56e-a98afdc4830f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67941877a04046319b68b6887da30560', 'request_id': 'req-3e9bd083-4f91-43b1-a56e-a98afdc4830f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:56.998178 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3e9bd083-4f91-43b1-a56e-a98afdc4830f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67941877a04046319b68b6887da30560', 'request_id': 'req-3e9bd083-4f91-43b1-a56e-a98afdc4830f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:56.998523 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-83a99516-f2e1-49da-b5b4-55621ca949f2 None None] MFA Rules not processed for user `8e97ceb88cd841d0acef85dfe1be1dd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:57.000489 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-83a99516-f2e1-49da-b5b4-55621ca949f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:57.014698 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3e9bd083-4f91-43b1-a56e-a98afdc4830f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67941877a04046319b68b6887da30560', 'request_id': 'req-3e9bd083-4f91-43b1-a56e-a98afdc4830f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:57.039182 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3e9bd083-4f91-43b1-a56e-a98afdc4830f admin admin] The token cache is being invalidate because project 67941877a04046319b68b6887da30560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:11:57.039791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3e9bd083-4f91-43b1-a56e-a98afdc4830f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:57.040862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-3e9bd083-4f91-43b1-a56e-a98afdc4830f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:57.043133 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1021/2015] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:11:56 2022] DELETE /identity/v3/projects/67941877a04046319b68b6887da30560 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:57.044152 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bd083-4f91-43b1-a56e-a98afdc4830f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:57.045988 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3e9bd083-4f91-43b1-a56e-a98afdc4830f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:57.113589 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 995/2016] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:57.114749 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a99516-f2e1-49da-b5b4-55621ca949f2 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:57.116231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-83a99516-f2e1-49da-b5b4-55621ca949f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:57.149929 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:57.163424 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9bd083-4f91-43b1-a56e-a98afdc4830f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:57.169237 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb017d98-4ac0-4d99-9804-f5f931230135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:57.170383 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb017d98-4ac0-4d99-9804-f5f931230135 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:57.170680 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb017d98-4ac0-4d99-9804-f5f931230135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:57.170959 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb017d98-4ac0-4d99-9804-f5f931230135 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:57.172071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb017d98-4ac0-4d99-9804-f5f931230135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:57.172330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb017d98-4ac0-4d99-9804-f5f931230135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:57.177800 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb017d98-4ac0-4d99-9804-f5f931230135 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:57.208096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1022/2017] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:57.209870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532a733-8118-4604-9c86-86c63233a08a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:57.210192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532a733-8118-4604-9c86-86c63233a08a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:57.210454 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532a733-8118-4604-9c86-86c63233a08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:57.263236 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a99516-f2e1-49da-b5b4-55621ca949f2 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:57.264527 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5532a733-8118-4604-9c86-86c63233a08a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:57.268076 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5532a733-8118-4604-9c86-86c63233a08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:57.274519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373de60-3069-42f7-9286-ff32defa3e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:57.275227 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373de60-3069-42f7-9286-ff32defa3e7f admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:57.275530 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373de60-3069-42f7-9286-ff32defa3e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:57.275859 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373de60-3069-42f7-9286-ff32defa3e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:57.276785 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373de60-3069-42f7-9286-ff32defa3e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:57.278783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3373de60-3069-42f7-9286-ff32defa3e7f admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:57.295523 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1023/2018] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:57.295523 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532a733-8118-4604-9c86-86c63233a08a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:57.295523 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5532a733-8118-4604-9c86-86c63233a08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:57.311800 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 996/2019] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:57.311800 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373de60-3069-42f7-9286-ff32defa3e7f admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:57.320663 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532a733-8118-4604-9c86-86c63233a08a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:57.322675 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373de60-3069-42f7-9286-ff32defa3e7f admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:57.328404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e175050-0257-4494-ae58-f47651c86ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:57.329116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e175050-0257-4494-ae58-f47651c86ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:57.329437 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e175050-0257-4494-ae58-f47651c86ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:57.329742 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e175050-0257-4494-ae58-f47651c86ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:57.330401 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbac72b-ef1e-442d-99a5-9f443c469553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:57.330894 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e175050-0257-4494-ae58-f47651c86ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:57.332380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbac72b-ef1e-442d-99a5-9f443c469553 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:57.332736 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e175050-0257-4494-ae58-f47651c86ef6 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:57.337282 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbac72b-ef1e-442d-99a5-9f443c469553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:57.337726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbac72b-ef1e-442d-99a5-9f443c469553 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:57.338643 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbac72b-ef1e-442d-99a5-9f443c469553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:57.340992 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbac72b-ef1e-442d-99a5-9f443c469553 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:57.376715 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1024/2020] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:57 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:57.378046 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217adc6e-32e8-40f5-be51-d41064ab6913 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:57.378559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217adc6e-32e8-40f5-be51-d41064ab6913 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:57.378835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217adc6e-32e8-40f5-be51-d41064ab6913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:57.382511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 997/2021] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:57 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:57.383455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e175050-0257-4494-ae58-f47651c86ef6 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:57.402874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-217adc6e-32e8-40f5-be51-d41064ab6913 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:57.405008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-217adc6e-32e8-40f5-be51-d41064ab6913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:57.462159 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e175050-0257-4494-ae58-f47651c86ef6 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:57.468000 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4ab94-6071-4c94-9843-c37b2f511e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:57.468665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4ab94-6071-4c94-9843-c37b2f511e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:57.468952 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4ab94-6071-4c94-9843-c37b2f511e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:57.469231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4ab94-6071-4c94-9843-c37b2f511e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:57.469939 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4ab94-6071-4c94-9843-c37b2f511e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:57.471549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4ab94-6071-4c94-9843-c37b2f511e1e admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:57.487319 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 998/2022] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:57.487319 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4ab94-6071-4c94-9843-c37b2f511e1e admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:57.488747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1025/2023] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:57.489312 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217adc6e-32e8-40f5-be51-d41064ab6913 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:57.500111 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217adc6e-32e8-40f5-be51-d41064ab6913 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:57.506516 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60892d3-cf99-4788-83a3-4b84deaf0ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:57.507197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60892d3-cf99-4788-83a3-4b84deaf0ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:57.507487 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60892d3-cf99-4788-83a3-4b84deaf0ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:57.507765 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60892d3-cf99-4788-83a3-4b84deaf0ef8 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:57.508130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4ab94-6071-4c94-9843-c37b2f511e1e admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:57.508448 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60892d3-cf99-4788-83a3-4b84deaf0ef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:57.510903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60892d3-cf99-4788-83a3-4b84deaf0ef8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:57.514437 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac52cbf-be50-467c-b86c-e7f6ce1a74e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:57.515089 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac52cbf-be50-467c-b86c-e7f6ce1a74e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:57.515377 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac52cbf-be50-467c-b86c-e7f6ce1a74e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:57.515654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac52cbf-be50-467c-b86c-e7f6ce1a74e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:57.516473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac52cbf-be50-467c-b86c-e7f6ce1a74e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:57.518971 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac52cbf-be50-467c-b86c-e7f6ce1a74e8 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:57.540180 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1026/2024] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:57 2022] POST /identity/v3/users => generated 286 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:57.540180 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60892d3-cf99-4788-83a3-4b84deaf0ef8 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:57.551503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 999/2025] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:57 2022] POST /identity/v3/users => generated 293 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:57.551503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac52cbf-be50-467c-b86c-e7f6ce1a74e8 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:57.551974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60892d3-cf99-4788-83a3-4b84deaf0ef8 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:57.558213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b759ff-2546-413d-8e4a-0475298cffa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:57.559636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b759ff-2546-413d-8e4a-0475298cffa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:57.560269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b759ff-2546-413d-8e4a-0475298cffa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:57.560871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b759ff-2546-413d-8e4a-0475298cffa5 admin admin] PATH_INFO: `/v3/projects/83b8b428262745b09198fab5af974e4f/users/4c7d90448a494d2eaeb2b7912dc000c5/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:57.562078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac52cbf-be50-467c-b86c-e7f6ce1a74e8 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:57.565025 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:57.568799 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd1b89-7da7-43c0-be8c-b28e82c88359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:57.569487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd1b89-7da7-43c0-be8c-b28e82c88359 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:57.569771 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd1b89-7da7-43c0-be8c-b28e82c88359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:57.570048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd1b89-7da7-43c0-be8c-b28e82c88359 admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:57.570749 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd1b89-7da7-43c0-be8c-b28e82c88359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:11:57.571091 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd1b89-7da7-43c0-be8c-b28e82c88359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:57.572867 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd1b89-7da7-43c0-be8c-b28e82c88359 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:57.586182 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b759ff-2546-413d-8e4a-0475298cffa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b8b428262745b09198fab5af974e4f, user_id=4c7d90448a494d2eaeb2b7912dc000c5, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:57.587669 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1000/2026] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:11:57.588557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd1b89-7da7-43c0-be8c-b28e82c88359 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:57.591455 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b759ff-2546-413d-8e4a-0475298cffa5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:57.600446 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd1b89-7da7-43c0-be8c-b28e82c88359 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:57.609366 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1027/2027] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:57 2022] PUT /identity/v3/projects/83b8b428262745b09198fab5af974e4f/users/4c7d90448a494d2eaeb2b7912dc000c5/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:57.610517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b759ff-2546-413d-8e4a-0475298cffa5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:57.664424 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:57.674413 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4abbfa-5ffd-4b9f-a5b9-ad3090ce241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:57.677076 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4abbfa-5ffd-4b9f-a5b9-ad3090ce241c admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:57.678075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4abbfa-5ffd-4b9f-a5b9-ad3090ce241c admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:57.678075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4abbfa-5ffd-4b9f-a5b9-ad3090ce241c admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:57.678546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4abbfa-5ffd-4b9f-a5b9-ad3090ce241c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:57.680366 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4abbfa-5ffd-4b9f-a5b9-ad3090ce241c admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:57.693133 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1001/2028] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:57.695119 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4abbfa-5ffd-4b9f-a5b9-ad3090ce241c admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:57.706778 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4abbfa-5ffd-4b9f-a5b9-ad3090ce241c admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:57.711570 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25f43b-b3e0-44bc-a5e4-48921f93f7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:57.712253 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25f43b-b3e0-44bc-a5e4-48921f93f7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:57.712500 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25f43b-b3e0-44bc-a5e4-48921f93f7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:57.712789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25f43b-b3e0-44bc-a5e4-48921f93f7e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:57.713464 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25f43b-b3e0-44bc-a5e4-48921f93f7e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:57.715379 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25f43b-b3e0-44bc-a5e4-48921f93f7e6 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:57.718167 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b759ff-2546-413d-8e4a-0475298cffa5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:57.728101 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e809008-c9b0-484b-b321-ce4d58382789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:57.729500 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e809008-c9b0-484b-b321-ce4d58382789 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:57.729920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e809008-c9b0-484b-b321-ce4d58382789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:57.730474 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e809008-c9b0-484b-b321-ce4d58382789 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:57.731320 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e809008-c9b0-484b-b321-ce4d58382789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:57.735726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e809008-c9b0-484b-b321-ce4d58382789 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:57.756784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1028/2029] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:57.759059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52280c-1232-416d-b9d8-11703e893c34 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:57.759721 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1002/2030] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:57 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:57.760019 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52280c-1232-416d-b9d8-11703e893c34 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:57.760774 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52280c-1232-416d-b9d8-11703e893c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:57.761642 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25f43b-b3e0-44bc-a5e4-48921f93f7e6 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:57.801916 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4f52280c-1232-416d-b9d8-11703e893c34 None None] MFA Rules not processed for user `4c7d90448a494d2eaeb2b7912dc000c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:57.803253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4f52280c-1232-416d-b9d8-11703e893c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:57.846917 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25f43b-b3e0-44bc-a5e4-48921f93f7e6 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:57.853613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f648ed-f512-4417-8376-a4f34649ffe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:57.854253 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f648ed-f512-4417-8376-a4f34649ffe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:57.854541 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f648ed-f512-4417-8376-a4f34649ffe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:57.854824 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f648ed-f512-4417-8376-a4f34649ffe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:57.855598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f648ed-f512-4417-8376-a4f34649ffe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:57.857271 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f648ed-f512-4417-8376-a4f34649ffe6 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:57.884431 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1003/2031] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:57.884431 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f648ed-f512-4417-8376-a4f34649ffe6 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:57.910759 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f648ed-f512-4417-8376-a4f34649ffe6 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:57.922029 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1029/2032] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:57 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:57.924798 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52280c-1232-416d-b9d8-11703e893c34 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:57.927045 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4bbb2-4327-45bc-a011-2e5af3cf8c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:57.928248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4bbb2-4327-45bc-a011-2e5af3cf8c61 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:57.928248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4bbb2-4327-45bc-a011-2e5af3cf8c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:57.928491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4bbb2-4327-45bc-a011-2e5af3cf8c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:57.929766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4bbb2-4327-45bc-a011-2e5af3cf8c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:57.931932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4bbb2-4327-45bc-a011-2e5af3cf8c61 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:57.936417 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52280c-1232-416d-b9d8-11703e893c34 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:57.946933 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1004/2033] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:57.947100 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acfc88-2b5f-428f-a360-1f9eb7d5bc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:57.947627 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4bbb2-4327-45bc-a011-2e5af3cf8c61 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:57.947730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acfc88-2b5f-428f-a360-1f9eb7d5bc22 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:57.947730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acfc88-2b5f-428f-a360-1f9eb7d5bc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:57.947730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acfc88-2b5f-428f-a360-1f9eb7d5bc22 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:57.947730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acfc88-2b5f-428f-a360-1f9eb7d5bc22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:57.949787 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acfc88-2b5f-428f-a360-1f9eb7d5bc22 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:57.958788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4bbb2-4327-45bc-a011-2e5af3cf8c61 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:57.967526 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4cd48-7038-4a3a-9a92-6fb12de5ed8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:57.968280 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4cd48-7038-4a3a-9a92-6fb12de5ed8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:57.968651 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4cd48-7038-4a3a-9a92-6fb12de5ed8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:57.969039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4cd48-7038-4a3a-9a92-6fb12de5ed8b admin admin] PATH_INFO: `/v3/projects/8ae0c84621de426caf10319651b906cb/users/a2145d16c20c4d54b4845a3db92a3e95/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:57.987448 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1030/2034] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:57 2022] POST /identity/v3/users => generated 289 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:57.989154 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acfc88-2b5f-428f-a360-1f9eb7d5bc22 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:57.992419 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4cd48-7038-4a3a-9a92-6fb12de5ed8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae0c84621de426caf10319651b906cb, user_id=a2145d16c20c4d54b4845a3db92a3e95, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:57.995423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4cd48-7038-4a3a-9a92-6fb12de5ed8b admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:58.005045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acfc88-2b5f-428f-a360-1f9eb7d5bc22 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:58.014044 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74507b78-8d1a-4941-b047-0ecc4b34141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:58.015007 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74507b78-8d1a-4941-b047-0ecc4b34141e admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:58.015007 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74507b78-8d1a-4941-b047-0ecc4b34141e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:58.015293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74507b78-8d1a-4941-b047-0ecc4b34141e admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:58.016032 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74507b78-8d1a-4941-b047-0ecc4b34141e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:58.018311 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74507b78-8d1a-4941-b047-0ecc4b34141e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:58.029930 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1005/2035] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:57 2022] PUT /identity/v3/projects/8ae0c84621de426caf10319651b906cb/users/a2145d16c20c4d54b4845a3db92a3e95/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:58.031234 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4cd48-7038-4a3a-9a92-6fb12de5ed8b admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:58.099027 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1031/2036] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:57 2022] POST /identity/v3/projects => generated 407 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:58.103147 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74507b78-8d1a-4941-b047-0ecc4b34141e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:58.138133 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4cd48-7038-4a3a-9a92-6fb12de5ed8b admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:58.168427 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:58.198179 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:58.218257 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74507b78-8d1a-4941-b047-0ecc4b34141e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:58.235425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb08d99-5e54-4563-b75c-8aadd6c6c0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:58.235690 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3edad-f11c-4b3f-ac2e-95320ecb8b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:58.236184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3edad-f11c-4b3f-ac2e-95320ecb8b75 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:58.236491 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3edad-f11c-4b3f-ac2e-95320ecb8b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:58.236769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3edad-f11c-4b3f-ac2e-95320ecb8b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:58.237359 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb08d99-5e54-4563-b75c-8aadd6c6c0c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:58.237473 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3edad-f11c-4b3f-ac2e-95320ecb8b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:58.238086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb08d99-5e54-4563-b75c-8aadd6c6c0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:58.238640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb08d99-5e54-4563-b75c-8aadd6c6c0c8 admin admin] PATH_INFO: `/v3/projects/49cd60ecd73e449a92ef54a6810a42ef/users/668dbda43b9d470fb542f6d88ee17720/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:58.239677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3edad-f11c-4b3f-ac2e-95320ecb8b75 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:58.262174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1032/2037] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:58.263790 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd0d64-664e-4e85-86ac-7d11809f0d06 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:58.263965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd0d64-664e-4e85-86ac-7d11809f0d06 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:58.264246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd0d64-664e-4e85-86ac-7d11809f0d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:58.271077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb08d99-5e54-4563-b75c-8aadd6c6c0c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49cd60ecd73e449a92ef54a6810a42ef, user_id=668dbda43b9d470fb542f6d88ee17720, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:58.279587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb08d99-5e54-4563-b75c-8aadd6c6c0c8 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:58.328233 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-49bd0d64-664e-4e85-86ac-7d11809f0d06 None None] MFA Rules not processed for user `a2145d16c20c4d54b4845a3db92a3e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:58.330770 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-49bd0d64-664e-4e85-86ac-7d11809f0d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:58.334923 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1006/2038] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:58 2022] PUT /identity/v3/projects/49cd60ecd73e449a92ef54a6810a42ef/users/668dbda43b9d470fb542f6d88ee17720/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:58.339673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb08d99-5e54-4563-b75c-8aadd6c6c0c8 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:58.472347 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb08d99-5e54-4563-b75c-8aadd6c6c0c8 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:58.484123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3c8b1-12be-46b7-ac72-d4228abec511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:58.485576 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c8b1-12be-46b7-ac72-d4228abec511 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:58.486066 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c8b1-12be-46b7-ac72-d4228abec511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:58.486533 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c8b1-12be-46b7-ac72-d4228abec511 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:58.487373 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3c8b1-12be-46b7-ac72-d4228abec511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:58.493776 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3c8b1-12be-46b7-ac72-d4228abec511 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:58.542567 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1007/2039] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:58 2022] POST /identity/v3/users => generated 310 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:58.557534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3c8b1-12be-46b7-ac72-d4228abec511 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:58.558259 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1033/2040] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:58.560122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb3236-952f-4ac7-96e2-f2ebf7ce76bf None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:58.560411 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb3236-952f-4ac7-96e2-f2ebf7ce76bf None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:58.560714 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb3236-952f-4ac7-96e2-f2ebf7ce76bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:58.579837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3c8b1-12be-46b7-ac72-d4228abec511 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:58.601176 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe52453-2186-4f54-a685-2369da9279c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:58.604772 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe52453-2186-4f54-a685-2369da9279c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:58.605558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe52453-2186-4f54-a685-2369da9279c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:58.606235 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe52453-2186-4f54-a685-2369da9279c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:58.608114 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe52453-2186-4f54-a685-2369da9279c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:58.611837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe52453-2186-4f54-a685-2369da9279c1 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:58.665877 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1008/2041] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:58.666223 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-50cb3236-952f-4ac7-96e2-f2ebf7ce76bf None None] MFA Rules not processed for user `668dbda43b9d470fb542f6d88ee17720`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:58.666223 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-50cb3236-952f-4ac7-96e2-f2ebf7ce76bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:58.667723 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7a2d3-e423-4708-b8c0-d9a34025d65f None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:58.673907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7a2d3-e423-4708-b8c0-d9a34025d65f None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:58.673907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7a2d3-e423-4708-b8c0-d9a34025d65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:58.741232 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-cdf7a2d3-e423-4708-b8c0-d9a34025d65f None None] MFA Rules not processed for user `59d6ef9e10c343b2a91474f5955fceb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:58.743144 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-cdf7a2d3-e423-4708-b8c0-d9a34025d65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:58.835518 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1034/2042] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:58.837127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb3236-952f-4ac7-96e2-f2ebf7ce76bf None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:58.865145 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb3236-952f-4ac7-96e2-f2ebf7ce76bf None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:58.870403 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1009/2043] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:58.872850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cdf7d-29a8-4c97-b170-77e020b3bbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:58.873653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cdf7d-29a8-4c97-b170-77e020b3bbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:58.874026 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cdf7d-29a8-4c97-b170-77e020b3bbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:58.874233 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7a2d3-e423-4708-b8c0-d9a34025d65f None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:58.874798 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cdf7d-29a8-4c97-b170-77e020b3bbd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:58.875776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cdf7d-29a8-4c97-b170-77e020b3bbd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:58.877164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-cdf7a2d3-e423-4708-b8c0-d9a34025d65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:58.877797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cdf7d-29a8-4c97-b170-77e020b3bbd4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:58.893060 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1035/2044] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:58.896699 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cdf7d-29a8-4c97-b170-77e020b3bbd4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:58.918996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cdf7d-29a8-4c97-b170-77e020b3bbd4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:58.934207 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77787a-4464-467d-a48a-bb014053d1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:58.935071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77787a-4464-467d-a48a-bb014053d1d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:58.935450 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77787a-4464-467d-a48a-bb014053d1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:58.935822 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77787a-4464-467d-a48a-bb014053d1d2 admin admin] PATH_INFO: `/v3/projects/763c5b78630548458f3864b373581e59/users/8f4eede40d15421eb431278cd0c7e2fc/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:58.943827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:58.954799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77787a-4464-467d-a48a-bb014053d1d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=763c5b78630548458f3864b373581e59, user_id=8f4eede40d15421eb431278cd0c7e2fc, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:58.958837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77787a-4464-467d-a48a-bb014053d1d2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:58.996052 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1036/2045] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:58 2022] PUT /identity/v3/projects/763c5b78630548458f3864b373581e59/users/8f4eede40d15421eb431278cd0c7e2fc/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:58.997311 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77787a-4464-467d-a48a-bb014053d1d2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:58.998788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7a2d3-e423-4708-b8c0-d9a34025d65f None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:59.020438 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:59.062768 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a241b-5ac3-4a71-b49d-19c4021f2dd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:59.063404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a241b-5ac3-4a71-b49d-19c4021f2dd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:59.063689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a241b-5ac3-4a71-b49d-19c4021f2dd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:59.063968 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a241b-5ac3-4a71-b49d-19c4021f2dd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:59.142624 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77787a-4464-467d-a48a-bb014053d1d2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:59.146276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a241b-5ac3-4a71-b49d-19c4021f2dd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:59.148021 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a241b-5ac3-4a71-b49d-19c4021f2dd3 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:59.148304 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a1a1d-3bf1-48e1-930e-ad4705afde8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:59.149175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a1a1d-3bf1-48e1-930e-ad4705afde8f admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:59.149875 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a1a1d-3bf1-48e1-930e-ad4705afde8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:59.150404 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a1a1d-3bf1-48e1-930e-ad4705afde8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:59.151285 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a1a1d-3bf1-48e1-930e-ad4705afde8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:59.154412 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a1a1d-3bf1-48e1-930e-ad4705afde8f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:59.162847 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1010/2046] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:11:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:11:59.171328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a241b-5ac3-4a71-b49d-19c4021f2dd3 service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:59.180429 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-8d0a241b-5ac3-4a71-b49d-19c4021f2dd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:59.198216 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a241b-5ac3-4a71-b49d-19c4021f2dd3 service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:59.204213 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a1817-79ef-4b5d-a0a0-f3e5458f3125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:59.204910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a1817-79ef-4b5d-a0a0-f3e5458f3125 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:59.205200 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a1817-79ef-4b5d-a0a0-f3e5458f3125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:59.205585 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a1817-79ef-4b5d-a0a0-f3e5458f3125 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:59.206168 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1037/2047] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:58 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:59.206428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a1817-79ef-4b5d-a0a0-f3e5458f3125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:59.207476 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a1a1d-3bf1-48e1-930e-ad4705afde8f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:59.208637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a1817-79ef-4b5d-a0a0-f3e5458f3125 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:59.256989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1011/2048] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:59 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:59.258323 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac2f46-3b37-4790-9320-fa9c7786e7c1 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:59.258617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac2f46-3b37-4790-9320-fa9c7786e7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:59.258897 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac2f46-3b37-4790-9320-fa9c7786e7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:59.290623 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-a5ac2f46-3b37-4790-9320-fa9c7786e7c1 None None] MFA Rules not processed for user `8f4eede40d15421eb431278cd0c7e2fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:59.292171 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a5ac2f46-3b37-4790-9320-fa9c7786e7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:59.308729 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a1a1d-3bf1-48e1-930e-ad4705afde8f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:59.387771 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1012/2049] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:11:59.389856 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac2f46-3b37-4790-9320-fa9c7786e7c1 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:59.405620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c82fe-c8bd-4f53-afd3-4ce01bd52fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:59.406383 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c82fe-c8bd-4f53-afd3-4ce01bd52fce admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:59.406738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c82fe-c8bd-4f53-afd3-4ce01bd52fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:59.407109 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c82fe-c8bd-4f53-afd3-4ce01bd52fce admin admin] PATH_INFO: `/v3/projects/b94f5a7a06d54c17afb3ef6dacad91dc/users/051f10cc22bd45d6aedfc1008dc5fbe6/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:59.409304 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:59.427505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c82fe-c8bd-4f53-afd3-4ce01bd52fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b94f5a7a06d54c17afb3ef6dacad91dc, user_id=051f10cc22bd45d6aedfc1008dc5fbe6, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:59.430779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c82fe-c8bd-4f53-afd3-4ce01bd52fce admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:59.450967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1038/2050] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:11:59 2022] PUT /identity/v3/projects/b94f5a7a06d54c17afb3ef6dacad91dc/users/051f10cc22bd45d6aedfc1008dc5fbe6/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:59.452540 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c82fe-c8bd-4f53-afd3-4ce01bd52fce admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:59.491074 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac2f46-3b37-4790-9320-fa9c7786e7c1 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:59.499760 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:59.563233 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7a5a0-9a5d-4796-9db0-76a5fb359824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:59.563709 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7a5a0-9a5d-4796-9db0-76a5fb359824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:59.564006 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7a5a0-9a5d-4796-9db0-76a5fb359824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:59.564286 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7a5a0-9a5d-4796-9db0-76a5fb359824 admin admin] PATH_INFO: `/v3/users/a2145d16c20c4d54b4845a3db92a3e95` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:59.565548 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7a5a0-9a5d-4796-9db0-76a5fb359824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2145d16c20c4d54b4845a3db92a3e95)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:59.568641 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7a5a0-9a5d-4796-9db0-76a5fb359824 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:59.570264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c82fe-c8bd-4f53-afd3-4ce01bd52fce admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:59.583911 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ea1a1-9f03-498a-8e6d-deb851cf1832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:59.585037 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ea1a1-9f03-498a-8e6d-deb851cf1832 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:59.585527 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ea1a1-9f03-498a-8e6d-deb851cf1832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:59.586005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ea1a1-9f03-498a-8e6d-deb851cf1832 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:59.587466 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ea1a1-9f03-498a-8e6d-deb851cf1832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:59.591028 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ea1a1-9f03-498a-8e6d-deb851cf1832 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:59.627697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1039/2051] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:59 2022] POST /identity/v3/users => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:59.627697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ea1a1-9f03-498a-8e6d-deb851cf1832 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:59.638723 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ea1a1-9f03-498a-8e6d-deb851cf1832 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:59.643542 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844d996-d762-455f-844e-de01a17b90ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:59.644361 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844d996-d762-455f-844e-de01a17b90ff admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:59.644676 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844d996-d762-455f-844e-de01a17b90ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:59.645188 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844d996-d762-455f-844e-de01a17b90ff admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:59.645867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844d996-d762-455f-844e-de01a17b90ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:59.647782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844d996-d762-455f-844e-de01a17b90ff admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:59.654361 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fcf7a5a0-9a5d-4796-9db0-76a5fb359824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2145d16c20c4d54b4845a3db92a3e95'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:59.655098 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fcf7a5a0-9a5d-4796-9db0-76a5fb359824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2145d16c20c4d54b4845a3db92a3e95'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:59.679754 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1040/2052] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:59 2022] POST /identity/v3/users => generated 293 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:59.679754 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844d996-d762-455f-844e-de01a17b90ff admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:59.681896 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fcf7a5a0-9a5d-4796-9db0-76a5fb359824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2145d16c20c4d54b4845a3db92a3e95'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:59.694312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fcf7a5a0-9a5d-4796-9db0-76a5fb359824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2145d16c20c4d54b4845a3db92a3e95'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:59.694732 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844d996-d762-455f-844e-de01a17b90ff admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:59.695243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fcf7a5a0-9a5d-4796-9db0-76a5fb359824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2145d16c20c4d54b4845a3db92a3e95'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:11:59.704390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f85579-4598-4455-9b58-25232315ff1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:59.705420 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f85579-4598-4455-9b58-25232315ff1f admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:59.705953 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f85579-4598-4455-9b58-25232315ff1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:59.707993 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f85579-4598-4455-9b58-25232315ff1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:59.709099 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f85579-4598-4455-9b58-25232315ff1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:59.714279 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f85579-4598-4455-9b58-25232315ff1f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:59.715469 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1013/2053] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:11:59 2022] DELETE /identity/v3/users/a2145d16c20c4d54b4845a3db92a3e95 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:11:59.716560 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7a5a0-9a5d-4796-9db0-76a5fb359824 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:59.718053 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-fcf7a5a0-9a5d-4796-9db0-76a5fb359824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:59.765974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1041/2054] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:11:59 2022] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:11:59.767105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f85579-4598-4455-9b58-25232315ff1f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:59.771539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-65f85579-4598-4455-9b58-25232315ff1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:59.777383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:11:59.822756 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7a5a0-9a5d-4796-9db0-76a5fb359824 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:59.874654 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f85579-4598-4455-9b58-25232315ff1f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:59.881285 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a1c85-0241-44f7-b903-3cd02011ddd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:59.881918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a1c85-0241-44f7-b903-3cd02011ddd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:59.882198 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a1c85-0241-44f7-b903-3cd02011ddd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:59.882476 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a1c85-0241-44f7-b903-3cd02011ddd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:59.883178 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a1c85-0241-44f7-b903-3cd02011ddd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:59.885072 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a1c85-0241-44f7-b903-3cd02011ddd5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:59.899882 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1042/2055] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:59.900855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a1c85-0241-44f7-b903-3cd02011ddd5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:59.902988 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-239a1c85-0241-44f7-b903-3cd02011ddd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:59.919272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a1c85-0241-44f7-b903-3cd02011ddd5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:59.924807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8165d4-87d2-41ed-bd45-c81196529a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:59.926104 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8165d4-87d2-41ed-bd45-c81196529a31 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:59.927081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8165d4-87d2-41ed-bd45-c81196529a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:59.927431 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8165d4-87d2-41ed-bd45-c81196529a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:59.928339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8165d4-87d2-41ed-bd45-c81196529a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:59.930365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8165d4-87d2-41ed-bd45-c81196529a31 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:59.946626 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21576c57-9aa8-404c-802a-31bcf363d60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:59.946842 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1043/2056] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:59.947708 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21576c57-9aa8-404c-802a-31bcf363d60a admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:59.949070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21576c57-9aa8-404c-802a-31bcf363d60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:59.949570 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21576c57-9aa8-404c-802a-31bcf363d60a admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:59.950786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21576c57-9aa8-404c-802a-31bcf363d60a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:59.953016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21576c57-9aa8-404c-802a-31bcf363d60a admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:11:59.960553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8bf28-68b9-46ab-bf35-4129c44d9b59 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:59.960897 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8bf28-68b9-46ab-bf35-4129c44d9b59 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:59.961181 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8bf28-68b9-46ab-bf35-4129c44d9b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:59.966029 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1014/2057] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:11:59.966991 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21576c57-9aa8-404c-802a-31bcf363d60a admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:11:59.968936 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-21576c57-9aa8-404c-802a-31bcf363d60a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:59.984700 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-19f8bf28-68b9-46ab-bf35-4129c44d9b59 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:11:59.986031 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21576c57-9aa8-404c-802a-31bcf363d60a admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:11:59.992449 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-19f8bf28-68b9-46ab-bf35-4129c44d9b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:11:59.993681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c550c0-9429-4eb0-b350-07ac6ef55614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:11:59.994488 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c550c0-9429-4eb0-b350-07ac6ef55614 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:11:59.994957 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c550c0-9429-4eb0-b350-07ac6ef55614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:11:59.995365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c550c0-9429-4eb0-b350-07ac6ef55614 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:11:59.996223 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c550c0-9429-4eb0-b350-07ac6ef55614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:11:59.998480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c550c0-9429-4eb0-b350-07ac6ef55614 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:00.005002 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1044/2058] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:00.005002 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8bf28-68b9-46ab-bf35-4129c44d9b59 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:00.013367 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8bf28-68b9-46ab-bf35-4129c44d9b59 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:00.019100 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a22974-9664-4eac-bacb-cdc04fbde944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:00.021377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a22974-9664-4eac-bacb-cdc04fbde944 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:00.021751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a22974-9664-4eac-bacb-cdc04fbde944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:00.022039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a22974-9664-4eac-bacb-cdc04fbde944 admin admin] PATH_INFO: `/v3/projects/c79291eabab24f9faf49d57db7c83d16/users/74a81b95ab434656b4fbaa8b8384a82e/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:00.030621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1015/2059] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:11:59 2022] POST /identity/v3/users => generated 295 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:00.032364 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c550c0-9429-4eb0-b350-07ac6ef55614 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:00.047659 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c550c0-9429-4eb0-b350-07ac6ef55614 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:00.048879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a22974-9664-4eac-bacb-cdc04fbde944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c79291eabab24f9faf49d57db7c83d16, user_id=74a81b95ab434656b4fbaa8b8384a82e, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:00.052524 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a22974-9664-4eac-bacb-cdc04fbde944 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:00.053852 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac79e2-0aa3-42da-9b8e-b6cd33f23ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:00.054753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac79e2-0aa3-42da-9b8e-b6cd33f23ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:00.055173 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac79e2-0aa3-42da-9b8e-b6cd33f23ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:00.055589 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac79e2-0aa3-42da-9b8e-b6cd33f23ce9 admin admin] PATH_INFO: `/v3/projects/5cf0c046f84140718df2e7fcf6f54096/users/cf0ca1c2287940a7bd69c977a87b2aea/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:00.077228 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1045/2060] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:00 2022] PUT /identity/v3/projects/c79291eabab24f9faf49d57db7c83d16/users/74a81b95ab434656b4fbaa8b8384a82e/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:00.077228 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a22974-9664-4eac-bacb-cdc04fbde944 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:00.082759 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac79e2-0aa3-42da-9b8e-b6cd33f23ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cf0c046f84140718df2e7fcf6f54096, user_id=cf0ca1c2287940a7bd69c977a87b2aea, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:00.086901 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac79e2-0aa3-42da-9b8e-b6cd33f23ce9 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:00.113903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1016/2061] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:00 2022] PUT /identity/v3/projects/5cf0c046f84140718df2e7fcf6f54096/users/cf0ca1c2287940a7bd69c977a87b2aea/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:00.115186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac79e2-0aa3-42da-9b8e-b6cd33f23ce9 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:00.117109 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-eaac79e2-0aa3-42da-9b8e-b6cd33f23ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:00.117559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:00.164882 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a22974-9664-4eac-bacb-cdc04fbde944 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:00.204173 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac79e2-0aa3-42da-9b8e-b6cd33f23ce9 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:00.209094 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1697b35-57ab-4e9c-a631-1e7585929217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:00.209734 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1697b35-57ab-4e9c-a631-1e7585929217 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:00.210014 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1697b35-57ab-4e9c-a631-1e7585929217 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:00.210288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1697b35-57ab-4e9c-a631-1e7585929217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:00.295661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f1f14-8338-4ff5-864e-81bd4c9e1b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:00.296781 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f1f14-8338-4ff5-864e-81bd4c9e1b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:00.297304 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f1f14-8338-4ff5-864e-81bd4c9e1b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:00.297651 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f1f14-8338-4ff5-864e-81bd4c9e1b03 admin admin] PATH_INFO: `/v3/projects/b94f5a7a06d54c17afb3ef6dacad91dc/users/051f10cc22bd45d6aedfc1008dc5fbe6/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:00.307393 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f1f14-8338-4ff5-864e-81bd4c9e1b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b94f5a7a06d54c17afb3ef6dacad91dc, user_id=051f10cc22bd45d6aedfc1008dc5fbe6, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:00.308945 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:00.311701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3f1f14-8338-4ff5-864e-81bd4c9e1b03 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:00.336667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1046/2062] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:00 2022] PUT /identity/v3/projects/b94f5a7a06d54c17afb3ef6dacad91dc/users/051f10cc22bd45d6aedfc1008dc5fbe6/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:00.336667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f1f14-8338-4ff5-864e-81bd4c9e1b03 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:00.340583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1697b35-57ab-4e9c-a631-1e7585929217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:00.342179 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1697b35-57ab-4e9c-a631-1e7585929217 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:00.353070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1017/2063] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:00.353996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1697b35-57ab-4e9c-a631-1e7585929217 service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:00.369334 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1697b35-57ab-4e9c-a631-1e7585929217 service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:00.436627 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f1f14-8338-4ff5-864e-81bd4c9e1b03 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:00.442588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e84dd1-5d4d-4498-8594-21d53a4f2d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:00.443317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e84dd1-5d4d-4498-8594-21d53a4f2d1e admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:00.444004 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e84dd1-5d4d-4498-8594-21d53a4f2d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:00.444365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e84dd1-5d4d-4498-8594-21d53a4f2d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:00.445282 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e84dd1-5d4d-4498-8594-21d53a4f2d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:00.447630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e84dd1-5d4d-4498-8594-21d53a4f2d1e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:00.478498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1047/2064] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:00.478498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e84dd1-5d4d-4498-8594-21d53a4f2d1e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:00.492290 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e84dd1-5d4d-4498-8594-21d53a4f2d1e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:00.511283 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef7168-6fd0-4445-983b-cb4cd14ab402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:00.511967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef7168-6fd0-4445-983b-cb4cd14ab402 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:00.512210 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef7168-6fd0-4445-983b-cb4cd14ab402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:00.513927 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef7168-6fd0-4445-983b-cb4cd14ab402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:00.514701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef7168-6fd0-4445-983b-cb4cd14ab402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:00.516352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424c500-7bce-4717-933c-fce23285806d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:00.521578 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424c500-7bce-4717-933c-fce23285806d admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:00.521879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef7168-6fd0-4445-983b-cb4cd14ab402 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:00.522424 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424c500-7bce-4717-933c-fce23285806d admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:00.523898 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424c500-7bce-4717-933c-fce23285806d admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:00.524940 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424c500-7bce-4717-933c-fce23285806d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:00.529874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424c500-7bce-4717-933c-fce23285806d admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:00.538490 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1048/2065] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:00.540319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83569bb-6d25-47b0-9ed4-1e2f1aeb2d99 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:00.540707 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83569bb-6d25-47b0-9ed4-1e2f1aeb2d99 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:00.541062 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83569bb-6d25-47b0-9ed4-1e2f1aeb2d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:00.542847 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1018/2066] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:00.544382 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424c500-7bce-4717-933c-fce23285806d admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:00.556623 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424c500-7bce-4717-933c-fce23285806d admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:00.562848 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b89b50-11b0-4d1d-b90d-d2e5dbd517c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:00.563602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b89b50-11b0-4d1d-b90d-d2e5dbd517c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:00.563956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b89b50-11b0-4d1d-b90d-d2e5dbd517c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:00.564328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b89b50-11b0-4d1d-b90d-d2e5dbd517c5 admin admin] PATH_INFO: `/v3/projects/a1aa6c949517493f920e82006bcc600e/users/51878d0479c84b5da4010cef414eb53f/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:00.581215 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b89b50-11b0-4d1d-b90d-d2e5dbd517c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1aa6c949517493f920e82006bcc600e, user_id=51878d0479c84b5da4010cef414eb53f, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:00.584218 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b89b50-11b0-4d1d-b90d-d2e5dbd517c5 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:00.591859 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d83569bb-6d25-47b0-9ed4-1e2f1aeb2d99 None None] MFA Rules not processed for user `051f10cc22bd45d6aedfc1008dc5fbe6`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:00.593231 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d83569bb-6d25-47b0-9ed4-1e2f1aeb2d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:00.604161 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1019/2067] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:00 2022] PUT /identity/v3/projects/a1aa6c949517493f920e82006bcc600e/users/51878d0479c84b5da4010cef414eb53f/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:00.608212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b89b50-11b0-4d1d-b90d-d2e5dbd517c5 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:00.657107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:00.690463 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1049/2068] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:00 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:00.691088 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83569bb-6d25-47b0-9ed4-1e2f1aeb2d99 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:00.698812 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b89b50-11b0-4d1d-b90d-d2e5dbd517c5 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:00.704191 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04490236-7383-400d-b120-bcc7986359c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:00.705178 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490236-7383-400d-b120-bcc7986359c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:00.705471 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490236-7383-400d-b120-bcc7986359c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:00.705752 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490236-7383-400d-b120-bcc7986359c8 admin admin] PATH_INFO: `/v3/projects/5cf0c046f84140718df2e7fcf6f54096/users/cf0ca1c2287940a7bd69c977a87b2aea/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:00.708511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04490236-7383-400d-b120-bcc7986359c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cf0c046f84140718df2e7fcf6f54096, user_id=cf0ca1c2287940a7bd69c977a87b2aea, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:00.710790 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83569bb-6d25-47b0-9ed4-1e2f1aeb2d99 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:00.711256 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04490236-7383-400d-b120-bcc7986359c8 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:00.716790 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ec577-96c9-4405-bc34-d8c47c1b2924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:00.717483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ec577-96c9-4405-bc34-d8c47c1b2924 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:00.717759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ec577-96c9-4405-bc34-d8c47c1b2924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:00.718033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ec577-96c9-4405-bc34-d8c47c1b2924 admin admin] PATH_INFO: `/v3/projects/c79291eabab24f9faf49d57db7c83d16/users/74a81b95ab434656b4fbaa8b8384a82e/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:00.720090 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ec577-96c9-4405-bc34-d8c47c1b2924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c79291eabab24f9faf49d57db7c83d16, user_id=74a81b95ab434656b4fbaa8b8384a82e, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:00.723710 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ec577-96c9-4405-bc34-d8c47c1b2924 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:00.728921 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1020/2069] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:00 2022] PUT /identity/v3/projects/5cf0c046f84140718df2e7fcf6f54096/users/cf0ca1c2287940a7bd69c977a87b2aea/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:00.730054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04490236-7383-400d-b120-bcc7986359c8 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:00.748814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1050/2070] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:00 2022] PUT /identity/v3/projects/c79291eabab24f9faf49d57db7c83d16/users/74a81b95ab434656b4fbaa8b8384a82e/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:00.750800 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ec577-96c9-4405-bc34-d8c47c1b2924 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:00.754827 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ad6ec577-96c9-4405-bc34-d8c47c1b2924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:00.821403 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:00.838220 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ec577-96c9-4405-bc34-d8c47c1b2924 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:00.838761 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04490236-7383-400d-b120-bcc7986359c8 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:00.842517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ff549-517f-489b-b3cd-a30b5f8ad6ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:00.843228 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ff549-517f-489b-b3cd-a30b5f8ad6ea service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:00.843590 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ff549-517f-489b-b3cd-a30b5f8ad6ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:00.844101 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ff549-517f-489b-b3cd-a30b5f8ad6ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:00.905611 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83f597-5476-4a99-bc9e-f5d98432c9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:00.907636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83f597-5476-4a99-bc9e-f5d98432c9ec admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:00.908268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83f597-5476-4a99-bc9e-f5d98432c9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:00.909231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83f597-5476-4a99-bc9e-f5d98432c9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:00.910755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83f597-5476-4a99-bc9e-f5d98432c9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:00.912978 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83f597-5476-4a99-bc9e-f5d98432c9ec admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:00.921993 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ff549-517f-489b-b3cd-a30b5f8ad6ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:00.923600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ff549-517f-489b-b3cd-a30b5f8ad6ea service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:00.928638 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1021/2071] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:00.930654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3cb00-19e2-420f-9b2a-e6e03b12f85c None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:00.931180 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3cb00-19e2-420f-9b2a-e6e03b12f85c None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:00.931678 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3cb00-19e2-420f-9b2a-e6e03b12f85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:00.949942 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1051/2072] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:00 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:00.952116 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ff549-517f-489b-b3cd-a30b5f8ad6ea service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:00.953873 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6b2ff549-517f-489b-b3cd-a30b5f8ad6ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:00.963427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-c7c3cb00-19e2-420f-9b2a-e6e03b12f85c None None] MFA Rules not processed for user `74a81b95ab434656b4fbaa8b8384a82e`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:00.965328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-c7c3cb00-19e2-420f-9b2a-e6e03b12f85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:00.977473 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ff549-517f-489b-b3cd-a30b5f8ad6ea service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:00.983449 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19f779-5f52-408a-a3da-5ff923598188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:00.984526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19f779-5f52-408a-a3da-5ff923598188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:00.985271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19f779-5f52-408a-a3da-5ff923598188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:00.985799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19f779-5f52-408a-a3da-5ff923598188 admin admin] PATH_INFO: `/v3/projects/8ae0c84621de426caf10319651b906cb` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:00.989394 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19f779-5f52-408a-a3da-5ff923598188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae0c84621de426caf10319651b906cb)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:00.992729 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19f779-5f52-408a-a3da-5ff923598188 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:01.079340 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1022/2073] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:01.079340 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3cb00-19e2-420f-9b2a-e6e03b12f85c None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:01.094424 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3cb00-19e2-420f-9b2a-e6e03b12f85c None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:01.095572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2e19f779-5f52-408a-a3da-5ff923598188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae0c84621de426caf10319651b906cb', 'request_id': 'req-2e19f779-5f52-408a-a3da-5ff923598188'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:01.111339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2e19f779-5f52-408a-a3da-5ff923598188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae0c84621de426caf10319651b906cb', 'request_id': 'req-2e19f779-5f52-408a-a3da-5ff923598188'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:01.125571 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2e19f779-5f52-408a-a3da-5ff923598188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae0c84621de426caf10319651b906cb', 'request_id': 'req-2e19f779-5f52-408a-a3da-5ff923598188'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:01.154882 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:01.160724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2e19f779-5f52-408a-a3da-5ff923598188 admin admin] The token cache is being invalidate because project 8ae0c84621de426caf10319651b906cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:01.161642 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2e19f779-5f52-408a-a3da-5ff923598188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:01.174496 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2e19f779-5f52-408a-a3da-5ff923598188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:01.182489 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1052/2074] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:00 2022] DELETE /identity/v3/projects/8ae0c84621de426caf10319651b906cb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:01.182489 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19f779-5f52-408a-a3da-5ff923598188 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:01.185455 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2e19f779-5f52-408a-a3da-5ff923598188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:01.220349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04b410-1712-42ad-976b-bba772e8ea4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:01.223732 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04b410-1712-42ad-976b-bba772e8ea4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:01.225468 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04b410-1712-42ad-976b-bba772e8ea4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:01.225803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04b410-1712-42ad-976b-bba772e8ea4e admin admin] PATH_INFO: `/v3/projects/a1aa6c949517493f920e82006bcc600e/users/51878d0479c84b5da4010cef414eb53f/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:01.232091 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04b410-1712-42ad-976b-bba772e8ea4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1aa6c949517493f920e82006bcc600e, user_id=51878d0479c84b5da4010cef414eb53f, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:01.240446 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04b410-1712-42ad-976b-bba772e8ea4e admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:01.262278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1023/2075] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:01 2022] PUT /identity/v3/projects/a1aa6c949517493f920e82006bcc600e/users/51878d0479c84b5da4010cef414eb53f/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:01.263682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b0b3c-d6f0-4d62-b94a-bbcfb2141c2a None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:01.263971 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b0b3c-d6f0-4d62-b94a-bbcfb2141c2a None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:01.264246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b0b3c-d6f0-4d62-b94a-bbcfb2141c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:01.294973 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19f779-5f52-408a-a3da-5ff923598188 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:01.302698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-211b0b3c-d6f0-4d62-b94a-bbcfb2141c2a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:01.304619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-211b0b3c-d6f0-4d62-b94a-bbcfb2141c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:01.322980 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:01.376688 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523cea6-6059-4232-9367-e35ff99969b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:01.377580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523cea6-6059-4232-9367-e35ff99969b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:01.379071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523cea6-6059-4232-9367-e35ff99969b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:01.379737 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523cea6-6059-4232-9367-e35ff99969b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:01.383792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5523cea6-6059-4232-9367-e35ff99969b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:01.395552 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1024/2076] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:01.396814 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e97e93-548f-474c-8b0b-d9e972a3d206 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:01.397103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e97e93-548f-474c-8b0b-d9e972a3d206 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:01.397377 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e97e93-548f-474c-8b0b-d9e972a3d206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:01.430504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-99e97e93-548f-474c-8b0b-d9e972a3d206 None None] MFA Rules not processed for user `51878d0479c84b5da4010cef414eb53f`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:01.432840 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-99e97e93-548f-474c-8b0b-d9e972a3d206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:01.494641 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523cea6-6059-4232-9367-e35ff99969b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:01.496183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523cea6-6059-4232-9367-e35ff99969b5 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:01.510006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1053/2077] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:01.511673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09221838-1780-4c02-ba03-7148df11454f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:01.512036 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09221838-1780-4c02-ba03-7148df11454f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:01.512390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09221838-1780-4c02-ba03-7148df11454f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:01.549331 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-09221838-1780-4c02-ba03-7148df11454f None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:01.555201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-09221838-1780-4c02-ba03-7148df11454f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:01.565351 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1054/2079] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:01.566379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09221838-1780-4c02-ba03-7148df11454f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:01.569813 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1025/2079] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:01.570456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-09221838-1780-4c02-ba03-7148df11454f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:01.570962 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e97e93-548f-474c-8b0b-d9e972a3d206 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:01.586109 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09221838-1780-4c02-ba03-7148df11454f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:01.588431 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e97e93-548f-474c-8b0b-d9e972a3d206 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:01.590278 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c997271-daae-4c62-8c8f-1a7eccbe7f16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:01.590793 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c997271-daae-4c62-8c8f-1a7eccbe7f16 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:01.591077 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c997271-daae-4c62-8c8f-1a7eccbe7f16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:01.591352 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c997271-daae-4c62-8c8f-1a7eccbe7f16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:01.594957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1c997271-daae-4c62-8c8f-1a7eccbe7f16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:01.596448 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027c67c-ffa9-48ab-9189-4656b10d689d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:01.597866 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027c67c-ffa9-48ab-9189-4656b10d689d admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:01.598147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027c67c-ffa9-48ab-9189-4656b10d689d admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:01.598432 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027c67c-ffa9-48ab-9189-4656b10d689d admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:01.600183 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027c67c-ffa9-48ab-9189-4656b10d689d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:12:01.600535 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027c67c-ffa9-48ab-9189-4656b10d689d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:01.604184 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027c67c-ffa9-48ab-9189-4656b10d689d admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:01.631447 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1026/2080] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:12:01.635835 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027c67c-ffa9-48ab-9189-4656b10d689d admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:01.650669 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027c67c-ffa9-48ab-9189-4656b10d689d admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:01.661278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f75df-8541-41a9-a6b1-14061c4f59bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:01.662005 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f75df-8541-41a9-a6b1-14061c4f59bc admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:01.662358 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f75df-8541-41a9-a6b1-14061c4f59bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:01.662659 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f75df-8541-41a9-a6b1-14061c4f59bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:01.663324 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f75df-8541-41a9-a6b1-14061c4f59bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:01.666434 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f75df-8541-41a9-a6b1-14061c4f59bc admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:01.697888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c997271-daae-4c62-8c8f-1a7eccbe7f16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:01.700171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c997271-daae-4c62-8c8f-1a7eccbe7f16 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:01.707385 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1027/2081] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:01 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:01.709143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbe81e-4381-4b96-ba9c-b31d1e68b794 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:01.709606 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbe81e-4381-4b96-ba9c-b31d1e68b794 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:01.710075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbe81e-4381-4b96-ba9c-b31d1e68b794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:01.719233 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1055/2082] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:01 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:01.719233 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c997271-daae-4c62-8c8f-1a7eccbe7f16 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:01.726296 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:01.734052 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c997271-daae-4c62-8c8f-1a7eccbe7f16 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:01.761845 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-76dbe81e-4381-4b96-ba9c-b31d1e68b794 None None] MFA Rules not processed for user `cf0ca1c2287940a7bd69c977a87b2aea`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:01.763083 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-76dbe81e-4381-4b96-ba9c-b31d1e68b794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:01.838278 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a1011-67c7-4b22-ba15-edfcc48130b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:01.838926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a1011-67c7-4b22-ba15-edfcc48130b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:01.839327 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a1011-67c7-4b22-ba15-edfcc48130b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:01.839608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a1011-67c7-4b22-ba15-edfcc48130b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:01.840431 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a1011-67c7-4b22-ba15-edfcc48130b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:01.843103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a1011-67c7-4b22-ba15-edfcc48130b3 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:01.882091 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1056/2083] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:01 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:01.886220 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a1011-67c7-4b22-ba15-edfcc48130b3 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:01.904868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:01.905763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a1011-67c7-4b22-ba15-edfcc48130b3 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:01.918593 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55cbc4-7139-43d5-85d1-3ab47d0370f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:01.919233 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55cbc4-7139-43d5-85d1-3ab47d0370f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:01.919602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55cbc4-7139-43d5-85d1-3ab47d0370f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:01.920353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55cbc4-7139-43d5-85d1-3ab47d0370f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:01.920708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55cbc4-7139-43d5-85d1-3ab47d0370f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:01.922690 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55cbc4-7139-43d5-85d1-3ab47d0370f4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:01.932372 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1028/2084] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:01.948486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1057/2085] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:01.948857 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbe81e-4381-4b96-ba9c-b31d1e68b794 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:01.948938 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7859a1e-1cdb-4567-8764-df5d527470e5 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:01.948938 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7859a1e-1cdb-4567-8764-df5d527470e5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:01.948938 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7859a1e-1cdb-4567-8764-df5d527470e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:01.968597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbe81e-4381-4b96-ba9c-b31d1e68b794 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:01.979207 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e7859a1e-1cdb-4567-8764-df5d527470e5 None None] MFA Rules not processed for user `59d6ef9e10c343b2a91474f5955fceb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:01.980919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e7859a1e-1cdb-4567-8764-df5d527470e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:01.981547 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac737a5b-e62c-49b9-887a-b1fc14628060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:01.982227 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac737a5b-e62c-49b9-887a-b1fc14628060 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:01.982510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac737a5b-e62c-49b9-887a-b1fc14628060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:01.982782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac737a5b-e62c-49b9-887a-b1fc14628060 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:01.983538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac737a5b-e62c-49b9-887a-b1fc14628060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:01.986840 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac737a5b-e62c-49b9-887a-b1fc14628060 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:02.006003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1029/2086] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:02.006990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac737a5b-e62c-49b9-887a-b1fc14628060 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:02.031319 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac737a5b-e62c-49b9-887a-b1fc14628060 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:02.038278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0145d41-a820-42d2-8d5d-d8188541258f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:02.039171 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0145d41-a820-42d2-8d5d-d8188541258f admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:02.039484 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0145d41-a820-42d2-8d5d-d8188541258f admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:02.039842 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0145d41-a820-42d2-8d5d-d8188541258f admin admin] PATH_INFO: `/v3/projects/9d23b3125132460394934cd2e50bd1d9/users/50bd676edd224c30b699e25fbce51a50/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:02.057982 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0145d41-a820-42d2-8d5d-d8188541258f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d23b3125132460394934cd2e50bd1d9, user_id=50bd676edd224c30b699e25fbce51a50, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:02.061784 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0145d41-a820-42d2-8d5d-d8188541258f admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:02.085187 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1030/2087] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:02 2022] PUT /identity/v3/projects/9d23b3125132460394934cd2e50bd1d9/users/50bd676edd224c30b699e25fbce51a50/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:02.095829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7a2e1-ad7b-4555-bbf0-175ba76fe4c0 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:02.095829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7a2e1-ad7b-4555-bbf0-175ba76fe4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:02.095829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7a2e1-ad7b-4555-bbf0-175ba76fe4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:02.100708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1058/2088] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:02.118086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7859a1e-1cdb-4567-8764-df5d527470e5 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:02.125128 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e7859a1e-1cdb-4567-8764-df5d527470e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:02.145801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-63c7a2e1-ad7b-4555-bbf0-175ba76fe4c0 None None] MFA Rules not processed for user `50bd676edd224c30b699e25fbce51a50`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:02.147030 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-63c7a2e1-ad7b-4555-bbf0-175ba76fe4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:02.266874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1031/2089] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:12:02.267900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7a2e1-ad7b-4555-bbf0-175ba76fe4c0 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:02.315083 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7859a1e-1cdb-4567-8764-df5d527470e5 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:02.353932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7a2e1-ad7b-4555-bbf0-175ba76fe4c0 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:02.359779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:02.361242 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5767203-699f-4935-9f0d-88a5b7ba8504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:02.361945 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5767203-699f-4935-9f0d-88a5b7ba8504 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:02.362400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5767203-699f-4935-9f0d-88a5b7ba8504 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:02.363682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5767203-699f-4935-9f0d-88a5b7ba8504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:02.366253 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f5767203-699f-4935-9f0d-88a5b7ba8504 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:02.422608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb73ad7-932d-49ce-acd8-604cb74f638c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:02.423873 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb73ad7-932d-49ce-acd8-604cb74f638c service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:02.424738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb73ad7-932d-49ce-acd8-604cb74f638c service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:02.426138 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb73ad7-932d-49ce-acd8-604cb74f638c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:02.428521 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3bb73ad7-932d-49ce-acd8-604cb74f638c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:02.453452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5767203-699f-4935-9f0d-88a5b7ba8504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:02.456353 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5767203-699f-4935-9f0d-88a5b7ba8504 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:02.460722 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:02.470842 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1032/2090] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:02.471649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5767203-699f-4935-9f0d-88a5b7ba8504 service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:02.504568 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb73ad7-932d-49ce-acd8-604cb74f638c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:02.508793 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb73ad7-932d-49ce-acd8-604cb74f638c service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:02.527054 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1059/2091] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:02.579752 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5767203-699f-4935-9f0d-88a5b7ba8504 service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:02.583880 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a0382-7ae7-4dc1-a440-afc1a7a75af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:02.585212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a0382-7ae7-4dc1-a440-afc1a7a75af8 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:02.585472 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a0382-7ae7-4dc1-a440-afc1a7a75af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:02.585754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a0382-7ae7-4dc1-a440-afc1a7a75af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:02.586445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a0382-7ae7-4dc1-a440-afc1a7a75af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:02.588436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a0382-7ae7-4dc1-a440-afc1a7a75af8 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:02.634744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1033/2092] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:02 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:02.635451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb73ad7-932d-49ce-acd8-604cb74f638c service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:02.653912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb73ad7-932d-49ce-acd8-604cb74f638c service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:02.732057 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21209a-d436-4726-9537-cb397190fb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:02.734813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21209a-d436-4726-9537-cb397190fb17 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:02.735567 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21209a-d436-4726-9537-cb397190fb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:02.735721 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21209a-d436-4726-9537-cb397190fb17 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:02.737037 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21209a-d436-4726-9537-cb397190fb17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:02.739755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21209a-d436-4726-9537-cb397190fb17 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:02.798473 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1060/2093] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:02 2022] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:12:02.799652 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a0382-7ae7-4dc1-a440-afc1a7a75af8 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:02.819871 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a0382-7ae7-4dc1-a440-afc1a7a75af8 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:02.838344 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580fedc-18b8-437d-97a1-afc04e446fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:02.839312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580fedc-18b8-437d-97a1-afc04e446fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:02.839541 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580fedc-18b8-437d-97a1-afc04e446fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:02.839817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580fedc-18b8-437d-97a1-afc04e446fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:02.840718 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580fedc-18b8-437d-97a1-afc04e446fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:02.842510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580fedc-18b8-437d-97a1-afc04e446fd2 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:02.868808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1034/2094] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:12:02.869418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21209a-d436-4726-9537-cb397190fb17 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:02.883541 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21209a-d436-4726-9537-cb397190fb17 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:02.897432 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa72e3-1fd8-415d-b9ed-1d16dd9f6084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:02.898336 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa72e3-1fd8-415d-b9ed-1d16dd9f6084 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:02.898769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa72e3-1fd8-415d-b9ed-1d16dd9f6084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:02.899228 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa72e3-1fd8-415d-b9ed-1d16dd9f6084 admin admin] PATH_INFO: `/v3/projects/4518e6fd847749f7b155cdcff55b458d/users/a7e499764b9e48a4a8e06040949417cf/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:02.938229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa72e3-1fd8-415d-b9ed-1d16dd9f6084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4518e6fd847749f7b155cdcff55b458d, user_id=a7e499764b9e48a4a8e06040949417cf, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:02.944648 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa72e3-1fd8-415d-b9ed-1d16dd9f6084 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:02.976612 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1061/2095] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:02 2022] PUT /identity/v3/projects/4518e6fd847749f7b155cdcff55b458d/users/a7e499764b9e48a4a8e06040949417cf/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:02.980880 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580fedc-18b8-437d-97a1-afc04e446fd2 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:02.995930 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580fedc-18b8-437d-97a1-afc04e446fd2 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:03.099716 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32285aaa-95d9-42cb-8df6-9324ad102013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:03.100762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32285aaa-95d9-42cb-8df6-9324ad102013 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:03.101070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32285aaa-95d9-42cb-8df6-9324ad102013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:03.101386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32285aaa-95d9-42cb-8df6-9324ad102013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:03.102168 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32285aaa-95d9-42cb-8df6-9324ad102013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:03.104008 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32285aaa-95d9-42cb-8df6-9324ad102013 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:03.118328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1035/2096] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:03.122492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa72e3-1fd8-415d-b9ed-1d16dd9f6084 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:03.133913 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa72e3-1fd8-415d-b9ed-1d16dd9f6084 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:03.139664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb8cda-3bdd-454b-83cf-2f9beaae6349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:03.140411 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb8cda-3bdd-454b-83cf-2f9beaae6349 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:03.140827 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb8cda-3bdd-454b-83cf-2f9beaae6349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:03.141170 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb8cda-3bdd-454b-83cf-2f9beaae6349 admin admin] PATH_INFO: `/v3/projects/4518e6fd847749f7b155cdcff55b458d/users/a7e499764b9e48a4a8e06040949417cf/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:03.155629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb8cda-3bdd-454b-83cf-2f9beaae6349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4518e6fd847749f7b155cdcff55b458d, user_id=a7e499764b9e48a4a8e06040949417cf, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:03.160956 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb8cda-3bdd-454b-83cf-2f9beaae6349 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:03.183171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1062/2097] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:03 2022] PUT /identity/v3/projects/4518e6fd847749f7b155cdcff55b458d/users/a7e499764b9e48a4a8e06040949417cf/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:03.194322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef4c2e-6c0f-4666-8657-594205049f06 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:03.194613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef4c2e-6c0f-4666-8657-594205049f06 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:03.194895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef4c2e-6c0f-4666-8657-594205049f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:03.238784 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-16ef4c2e-6c0f-4666-8657-594205049f06 None None] MFA Rules not processed for user `a7e499764b9e48a4a8e06040949417cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:03.240014 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-16ef4c2e-6c0f-4666-8657-594205049f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:03.387195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:03.437024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1036/2098] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:03.450251 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb8cda-3bdd-454b-83cf-2f9beaae6349 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:03.472609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:03.524280 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb8cda-3bdd-454b-83cf-2f9beaae6349 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:03.528102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721269d-94f1-4a3d-9a8b-784f4265f40d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:03.528946 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721269d-94f1-4a3d-9a8b-784f4265f40d service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:03.529205 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721269d-94f1-4a3d-9a8b-784f4265f40d service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:03.529693 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721269d-94f1-4a3d-9a8b-784f4265f40d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:03.609154 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721269d-94f1-4a3d-9a8b-784f4265f40d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:03.611222 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721269d-94f1-4a3d-9a8b-784f4265f40d service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:03.622649 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1063/2099] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:03.769950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef4c2e-6c0f-4666-8657-594205049f06 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:03.782797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef4c2e-6c0f-4666-8657-594205049f06 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:03.787753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7dd06-a1b8-47ee-ae64-cb1f49197cb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:03.788382 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7dd06-a1b8-47ee-ae64-cb1f49197cb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:03.788716 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7dd06-a1b8-47ee-ae64-cb1f49197cb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:03.788994 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7dd06-a1b8-47ee-ae64-cb1f49197cb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:03.791757 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-eaf7dd06-a1b8-47ee-ae64-cb1f49197cb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:03.885255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7dd06-a1b8-47ee-ae64-cb1f49197cb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:03.887794 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7dd06-a1b8-47ee-ae64-cb1f49197cb8 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:03.898027 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1037/2100] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:04.068859 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721269d-94f1-4a3d-9a8b-784f4265f40d service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:04.078367 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721269d-94f1-4a3d-9a8b-784f4265f40d service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:04.082647 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4f9f9-555d-4717-8a85-f0d705bf4fac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:04.083311 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4f9f9-555d-4717-8a85-f0d705bf4fac service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:04.083722 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4f9f9-555d-4717-8a85-f0d705bf4fac service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:04.083867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4f9f9-555d-4717-8a85-f0d705bf4fac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:04.150656 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4f9f9-555d-4717-8a85-f0d705bf4fac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:04.151993 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4f9f9-555d-4717-8a85-f0d705bf4fac service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:04.163114 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1064/2101] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:04.620791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7dd06-a1b8-47ee-ae64-cb1f49197cb8 service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:04.631134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7dd06-a1b8-47ee-ae64-cb1f49197cb8 service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:04.635410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82014727-6ca3-4fd6-89d9-ec64868dcf02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:04.636260 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82014727-6ca3-4fd6-89d9-ec64868dcf02 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:04.636502 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82014727-6ca3-4fd6-89d9-ec64868dcf02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:04.637034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82014727-6ca3-4fd6-89d9-ec64868dcf02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:04.639137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-82014727-6ca3-4fd6-89d9-ec64868dcf02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:04.720593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82014727-6ca3-4fd6-89d9-ec64868dcf02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:04.722113 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82014727-6ca3-4fd6-89d9-ec64868dcf02 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:04.732673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1038/2102] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:04.806383 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4f9f9-555d-4717-8a85-f0d705bf4fac service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:04.808146 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-53c4f9f9-555d-4717-8a85-f0d705bf4fac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:04.889483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4f9f9-555d-4717-8a85-f0d705bf4fac service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:04.895235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a7f00-1cb7-40b9-a159-c9c697f7b369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:04.896002 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a7f00-1cb7-40b9-a159-c9c697f7b369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:04.897065 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a7f00-1cb7-40b9-a159-c9c697f7b369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:04.897495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a7f00-1cb7-40b9-a159-c9c697f7b369 admin admin] PATH_INFO: `/v3/users/300e88af89f24205adcb68ea4fef32cd` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:04.899038 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a7f00-1cb7-40b9-a159-c9c697f7b369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=300e88af89f24205adcb68ea4fef32cd)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:04.901115 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a7f00-1cb7-40b9-a159-c9c697f7b369 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:04.905775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:04.983750 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e78a7f00-1cb7-40b9-a159-c9c697f7b369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '300e88af89f24205adcb68ea4fef32cd'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:04.984076 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e78a7f00-1cb7-40b9-a159-c9c697f7b369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '300e88af89f24205adcb68ea4fef32cd'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:04.994826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e78a7f00-1cb7-40b9-a159-c9c697f7b369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '300e88af89f24205adcb68ea4fef32cd'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:05.022896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e78a7f00-1cb7-40b9-a159-c9c697f7b369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '300e88af89f24205adcb68ea4fef32cd'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:05.043990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e78a7f00-1cb7-40b9-a159-c9c697f7b369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '300e88af89f24205adcb68ea4fef32cd'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:05.054005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1065/2103] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:04 2022] DELETE /identity/v3/users/300e88af89f24205adcb68ea4fef32cd => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:05.058503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7245f77-8a3f-465d-bd27-a8c9d9a18ca8 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:05.058793 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7245f77-8a3f-465d-bd27-a8c9d9a18ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:05.059077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7245f77-8a3f-465d-bd27-a8c9d9a18ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:05.083997 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-b7245f77-8a3f-465d-bd27-a8c9d9a18ca8 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:05.085279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b7245f77-8a3f-465d-bd27-a8c9d9a18ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:05.197575 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1039/2104] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:05.216425 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a7f00-1cb7-40b9-a159-c9c697f7b369 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:05.218571 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e78a7f00-1cb7-40b9-a159-c9c697f7b369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:05.369163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a7f00-1cb7-40b9-a159-c9c697f7b369 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:05.374208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35868e-4ec1-4dde-8178-f473128da4bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:05.374719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35868e-4ec1-4dde-8178-f473128da4bc service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:05.374995 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35868e-4ec1-4dde-8178-f473128da4bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:05.375272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35868e-4ec1-4dde-8178-f473128da4bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:05.408607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35868e-4ec1-4dde-8178-f473128da4bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:05.410265 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35868e-4ec1-4dde-8178-f473128da4bc service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:05.433208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1066/2105] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:06.194292 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7245f77-8a3f-465d-bd27-a8c9d9a18ca8 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:06.196859 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b7245f77-8a3f-465d-bd27-a8c9d9a18ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:06.227342 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7245f77-8a3f-465d-bd27-a8c9d9a18ca8 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:06.235358 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cc6b7-fec9-482f-af2e-e8e2dde6788d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:06.236119 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cc6b7-fec9-482f-af2e-e8e2dde6788d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:06.236391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cc6b7-fec9-482f-af2e-e8e2dde6788d admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:06.236694 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cc6b7-fec9-482f-af2e-e8e2dde6788d admin admin] PATH_INFO: `/v3/projects/f96e2e42bc944b568ceb1d430c855c75` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:06.239689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cc6b7-fec9-482f-af2e-e8e2dde6788d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f96e2e42bc944b568ceb1d430c855c75)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:06.242058 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cc6b7-fec9-482f-af2e-e8e2dde6788d admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:06.287929 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:06.345775 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-030cc6b7-fec9-482f-af2e-e8e2dde6788d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f96e2e42bc944b568ceb1d430c855c75', 'request_id': 'req-030cc6b7-fec9-482f-af2e-e8e2dde6788d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:06.355037 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-030cc6b7-fec9-482f-af2e-e8e2dde6788d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f96e2e42bc944b568ceb1d430c855c75', 'request_id': 'req-030cc6b7-fec9-482f-af2e-e8e2dde6788d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:06.363449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-030cc6b7-fec9-482f-af2e-e8e2dde6788d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f96e2e42bc944b568ceb1d430c855c75', 'request_id': 'req-030cc6b7-fec9-482f-af2e-e8e2dde6788d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:06.385691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-030cc6b7-fec9-482f-af2e-e8e2dde6788d admin admin] The token cache is being invalidate because project f96e2e42bc944b568ceb1d430c855c75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:06.387322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-030cc6b7-fec9-482f-af2e-e8e2dde6788d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:06.388849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-030cc6b7-fec9-482f-af2e-e8e2dde6788d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:06.396690 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1040/2106] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:06 2022] DELETE /identity/v3/projects/f96e2e42bc944b568ceb1d430c855c75 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:06.399716 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35868e-4ec1-4dde-8178-f473128da4bc service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:06.412883 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35868e-4ec1-4dde-8178-f473128da4bc service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:06.461790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cc6b7-fec9-482f-af2e-e8e2dde6788d admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:06.463468 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-030cc6b7-fec9-482f-af2e-e8e2dde6788d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:06.523040 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37f6740-5d08-4c51-b552-99fb24fedc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:06.523837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f6740-5d08-4c51-b552-99fb24fedc89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:06.524219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f6740-5d08-4c51-b552-99fb24fedc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:06.524644 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37f6740-5d08-4c51-b552-99fb24fedc89 admin admin] PATH_INFO: `/v3/users/37adc9497b8347b79e439e410fe68718` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:06.525949 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f6740-5d08-4c51-b552-99fb24fedc89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37adc9497b8347b79e439e410fe68718)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:06.528013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37f6740-5d08-4c51-b552-99fb24fedc89 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:06.575839 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cc6b7-fec9-482f-af2e-e8e2dde6788d admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:06.578329 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:06.586696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb1923-2957-4662-b452-8ad993dd3af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:06.587299 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb1923-2957-4662-b452-8ad993dd3af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:06.587740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb1923-2957-4662-b452-8ad993dd3af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:06.588028 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb1923-2957-4662-b452-8ad993dd3af8 admin admin] PATH_INFO: `/v3/users/50bd676edd224c30b699e25fbce51a50` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:06.590646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb1923-2957-4662-b452-8ad993dd3af8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50bd676edd224c30b699e25fbce51a50)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:06.593282 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb1923-2957-4662-b452-8ad993dd3af8 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:06.621042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b37f6740-5d08-4c51-b552-99fb24fedc89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37adc9497b8347b79e439e410fe68718'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:06.621801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b37f6740-5d08-4c51-b552-99fb24fedc89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37adc9497b8347b79e439e410fe68718'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:06.633921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b37f6740-5d08-4c51-b552-99fb24fedc89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37adc9497b8347b79e439e410fe68718'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:06.648756 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b37f6740-5d08-4c51-b552-99fb24fedc89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37adc9497b8347b79e439e410fe68718'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:06.651070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-60fb1923-2957-4662-b452-8ad993dd3af8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50bd676edd224c30b699e25fbce51a50'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:06.652099 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-60fb1923-2957-4662-b452-8ad993dd3af8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50bd676edd224c30b699e25fbce51a50'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:06.657068 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b37f6740-5d08-4c51-b552-99fb24fedc89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37adc9497b8347b79e439e410fe68718'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:06.665385 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1067/2107] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:06 2022] DELETE /identity/v3/users/37adc9497b8347b79e439e410fe68718 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:06.673355 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-60fb1923-2957-4662-b452-8ad993dd3af8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50bd676edd224c30b699e25fbce51a50'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:06.687705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-60fb1923-2957-4662-b452-8ad993dd3af8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50bd676edd224c30b699e25fbce51a50'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:06.688424 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-60fb1923-2957-4662-b452-8ad993dd3af8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50bd676edd224c30b699e25fbce51a50'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:06.705706 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1041/2108] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:06 2022] DELETE /identity/v3/users/50bd676edd224c30b699e25fbce51a50 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:06.711022 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936c8cd-34c2-49dc-961a-e59dd049254a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:06.711370 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936c8cd-34c2-49dc-961a-e59dd049254a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:06.711738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936c8cd-34c2-49dc-961a-e59dd049254a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:06.734835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4936c8cd-34c2-49dc-961a-e59dd049254a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:06.736624 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4936c8cd-34c2-49dc-961a-e59dd049254a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:06.876763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1068/2109] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:06.889999 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb1923-2957-4662-b452-8ad993dd3af8 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:06.892564 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-60fb1923-2957-4662-b452-8ad993dd3af8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:06.950627 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:07.015358 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb1923-2957-4662-b452-8ad993dd3af8 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:07.030066 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bf094-786c-45d6-87ae-b9e9e09819d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:07.030979 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bf094-786c-45d6-87ae-b9e9e09819d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:07.031392 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bf094-786c-45d6-87ae-b9e9e09819d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:07.031675 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bf094-786c-45d6-87ae-b9e9e09819d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:07.052201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9bf094-786c-45d6-87ae-b9e9e09819d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:07.053696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9bf094-786c-45d6-87ae-b9e9e09819d4 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:07.104324 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1042/2110] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:07.194892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936c8cd-34c2-49dc-961a-e59dd049254a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:07.196717 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4936c8cd-34c2-49dc-961a-e59dd049254a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:07.224327 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936c8cd-34c2-49dc-961a-e59dd049254a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:07.230774 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e7da8-c6d4-4828-96dd-7e6a982aa33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:07.230774 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e7da8-c6d4-4828-96dd-7e6a982aa33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:07.232017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e7da8-c6d4-4828-96dd-7e6a982aa33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:07.232017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e7da8-c6d4-4828-96dd-7e6a982aa33d admin admin] PATH_INFO: `/v3/projects/2a95ba9f075a4b5aa0422de7ec044632` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:07.232543 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e7da8-c6d4-4828-96dd-7e6a982aa33d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a95ba9f075a4b5aa0422de7ec044632)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:07.234508 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e7da8-c6d4-4828-96dd-7e6a982aa33d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:07.322300 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-224e7da8-c6d4-4828-96dd-7e6a982aa33d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a95ba9f075a4b5aa0422de7ec044632', 'request_id': 'req-224e7da8-c6d4-4828-96dd-7e6a982aa33d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:07.329268 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-224e7da8-c6d4-4828-96dd-7e6a982aa33d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a95ba9f075a4b5aa0422de7ec044632', 'request_id': 'req-224e7da8-c6d4-4828-96dd-7e6a982aa33d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:07.336091 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-224e7da8-c6d4-4828-96dd-7e6a982aa33d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a95ba9f075a4b5aa0422de7ec044632', 'request_id': 'req-224e7da8-c6d4-4828-96dd-7e6a982aa33d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:07.351835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-224e7da8-c6d4-4828-96dd-7e6a982aa33d admin admin] The token cache is being invalidate because project 2a95ba9f075a4b5aa0422de7ec044632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:07.352545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-224e7da8-c6d4-4828-96dd-7e6a982aa33d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:07.353345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-224e7da8-c6d4-4828-96dd-7e6a982aa33d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:07.355089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1069/2111] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:07 2022] DELETE /identity/v3/projects/2a95ba9f075a4b5aa0422de7ec044632 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:07.360431 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae7d91-70d1-479f-9261-e1071bee770b None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:07.360920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae7d91-70d1-479f-9261-e1071bee770b None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:07.361154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae7d91-70d1-479f-9261-e1071bee770b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:07.387877 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-d9ae7d91-70d1-479f-9261-e1071bee770b None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:07.389468 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-d9ae7d91-70d1-479f-9261-e1071bee770b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:07.490249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1043/2112] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:07.498576 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3ed2b-fcb5-4e26-b38a-e3b287767e5a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:07.499102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3ed2b-fcb5-4e26-b38a-e3b287767e5a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:07.499102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3ed2b-fcb5-4e26-b38a-e3b287767e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:07.526116 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-88f3ed2b-fcb5-4e26-b38a-e3b287767e5a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:07.527416 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-88f3ed2b-fcb5-4e26-b38a-e3b287767e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:07.548263 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1070/2113] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:07.550016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae7d91-70d1-479f-9261-e1071bee770b None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:07.567841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae7d91-70d1-479f-9261-e1071bee770b None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:07.576920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f54b6-8a03-488d-9aa0-1abc2d57ef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:07.577754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f54b6-8a03-488d-9aa0-1abc2d57ef26 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:07.578088 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f54b6-8a03-488d-9aa0-1abc2d57ef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:07.578374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f54b6-8a03-488d-9aa0-1abc2d57ef26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:07.579098 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f54b6-8a03-488d-9aa0-1abc2d57ef26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:12:07.579583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f54b6-8a03-488d-9aa0-1abc2d57ef26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:07.581992 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f54b6-8a03-488d-9aa0-1abc2d57ef26 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:07.624554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1044/2114] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:12:07.626781 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3ed2b-fcb5-4e26-b38a-e3b287767e5a None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:07.642695 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3ed2b-fcb5-4e26-b38a-e3b287767e5a None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:07.656824 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ce24c-a665-4876-aae5-e7762ca81c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:07.658203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ce24c-a665-4876-aae5-e7762ca81c00 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:07.658640 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ce24c-a665-4876-aae5-e7762ca81c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:07.659090 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ce24c-a665-4876-aae5-e7762ca81c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:07.660686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ce24c-a665-4876-aae5-e7762ca81c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:07.663619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ce24c-a665-4876-aae5-e7762ca81c00 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:07.677474 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f54b6-8a03-488d-9aa0-1abc2d57ef26 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:07.679301 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-532f54b6-8a03-488d-9aa0-1abc2d57ef26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:07.711230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:07.711469 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f54b6-8a03-488d-9aa0-1abc2d57ef26 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:07.724585 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786ce67-b68d-42dd-9440-7d64bcbdfe20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:07.725255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786ce67-b68d-42dd-9440-7d64bcbdfe20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:07.725567 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786ce67-b68d-42dd-9440-7d64bcbdfe20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:07.725896 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786ce67-b68d-42dd-9440-7d64bcbdfe20 admin admin] PATH_INFO: `/v3/projects/9d23b3125132460394934cd2e50bd1d9` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:07.727926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1071/2115] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:07 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:12:07.729367 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786ce67-b68d-42dd-9440-7d64bcbdfe20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d23b3125132460394934cd2e50bd1d9)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:07.731804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ce24c-a665-4876-aae5-e7762ca81c00 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:07.736606 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786ce67-b68d-42dd-9440-7d64bcbdfe20 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:07.849667 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e786ce67-b68d-42dd-9440-7d64bcbdfe20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d23b3125132460394934cd2e50bd1d9', 'request_id': 'req-e786ce67-b68d-42dd-9440-7d64bcbdfe20'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:07.859828 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e786ce67-b68d-42dd-9440-7d64bcbdfe20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d23b3125132460394934cd2e50bd1d9', 'request_id': 'req-e786ce67-b68d-42dd-9440-7d64bcbdfe20'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:07.870860 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e786ce67-b68d-42dd-9440-7d64bcbdfe20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d23b3125132460394934cd2e50bd1d9', 'request_id': 'req-e786ce67-b68d-42dd-9440-7d64bcbdfe20'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:07.879088 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ce24c-a665-4876-aae5-e7762ca81c00 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:07.905641 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e786ce67-b68d-42dd-9440-7d64bcbdfe20 admin admin] The token cache is being invalidate because project 9d23b3125132460394934cd2e50bd1d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:07.906295 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e786ce67-b68d-42dd-9440-7d64bcbdfe20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:07.907890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e786ce67-b68d-42dd-9440-7d64bcbdfe20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:07.910244 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1045/2116] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:07 2022] DELETE /identity/v3/projects/9d23b3125132460394934cd2e50bd1d9 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:07.915284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786ce67-b68d-42dd-9440-7d64bcbdfe20 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:07.917784 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e786ce67-b68d-42dd-9440-7d64bcbdfe20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:07.977527 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766371b8-a940-43fb-b6f8-8a684c1fbd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:07.978260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766371b8-a940-43fb-b6f8-8a684c1fbd8f admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:07.978491 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766371b8-a940-43fb-b6f8-8a684c1fbd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:07.978746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766371b8-a940-43fb-b6f8-8a684c1fbd8f admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:07.979460 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766371b8-a940-43fb-b6f8-8a684c1fbd8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:07.981584 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766371b8-a940-43fb-b6f8-8a684c1fbd8f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:08.005366 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:08.020623 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1072/2117] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:07 2022] POST /identity/v3/users => generated 283 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:08.021787 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766371b8-a940-43fb-b6f8-8a684c1fbd8f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:08.024542 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-766371b8-a940-43fb-b6f8-8a684c1fbd8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:08.040901 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786ce67-b68d-42dd-9440-7d64bcbdfe20 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:08.042229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766371b8-a940-43fb-b6f8-8a684c1fbd8f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:08.046850 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b5e84f-65a5-42ee-bdd2-bbe4346d4cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:08.047498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5e84f-65a5-42ee-bdd2-bbe4346d4cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:08.047835 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5e84f-65a5-42ee-bdd2-bbe4346d4cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:08.048111 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b5e84f-65a5-42ee-bdd2-bbe4346d4cef admin admin] PATH_INFO: `/v3/users/a7e499764b9e48a4a8e06040949417cf` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:08.048372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011316e-bf51-45d4-a01b-d5fe57319d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:08.049230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011316e-bf51-45d4-a01b-d5fe57319d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:08.049346 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011316e-bf51-45d4-a01b-d5fe57319d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:08.049433 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5e84f-65a5-42ee-bdd2-bbe4346d4cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e499764b9e48a4a8e06040949417cf)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:08.049661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011316e-bf51-45d4-a01b-d5fe57319d7a admin admin] PATH_INFO: `/v3/users/4c7d90448a494d2eaeb2b7912dc000c5` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:08.051644 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011316e-bf51-45d4-a01b-d5fe57319d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c7d90448a494d2eaeb2b7912dc000c5)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:08.052147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b5e84f-65a5-42ee-bdd2-bbe4346d4cef admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:08.053617 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011316e-bf51-45d4-a01b-d5fe57319d7a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:08.110899 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b011316e-bf51-45d4-a01b-d5fe57319d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c7d90448a494d2eaeb2b7912dc000c5'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:08.111818 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b011316e-bf51-45d4-a01b-d5fe57319d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c7d90448a494d2eaeb2b7912dc000c5'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:08.117555 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-71b5e84f-65a5-42ee-bdd2-bbe4346d4cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e499764b9e48a4a8e06040949417cf'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:08.118412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-71b5e84f-65a5-42ee-bdd2-bbe4346d4cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e499764b9e48a4a8e06040949417cf'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:08.122012 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b011316e-bf51-45d4-a01b-d5fe57319d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c7d90448a494d2eaeb2b7912dc000c5'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:08.135626 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-71b5e84f-65a5-42ee-bdd2-bbe4346d4cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e499764b9e48a4a8e06040949417cf'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:08.138140 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b011316e-bf51-45d4-a01b-d5fe57319d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c7d90448a494d2eaeb2b7912dc000c5'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:08.146072 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-71b5e84f-65a5-42ee-bdd2-bbe4346d4cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e499764b9e48a4a8e06040949417cf'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:08.146941 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-71b5e84f-65a5-42ee-bdd2-bbe4346d4cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e499764b9e48a4a8e06040949417cf'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:08.149406 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b011316e-bf51-45d4-a01b-d5fe57319d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c7d90448a494d2eaeb2b7912dc000c5'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:08.159378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1073/2118] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:08 2022] DELETE /identity/v3/users/4c7d90448a494d2eaeb2b7912dc000c5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:08.160510 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011316e-bf51-45d4-a01b-d5fe57319d7a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:08.162786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b011316e-bf51-45d4-a01b-d5fe57319d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:08.173326 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:08.176714 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1046/2119] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:07 2022] DELETE /identity/v3/users/a7e499764b9e48a4a8e06040949417cf => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:08.178861 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432e030-fb50-42f6-92d1-1673a1cb3996 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:08.193871 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432e030-fb50-42f6-92d1-1673a1cb3996 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:08.194205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432e030-fb50-42f6-92d1-1673a1cb3996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:08.246695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-e432e030-fb50-42f6-92d1-1673a1cb3996 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:08.251914 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e432e030-fb50-42f6-92d1-1673a1cb3996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:08.273494 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011316e-bf51-45d4-a01b-d5fe57319d7a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:08.387528 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1047/2120] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:08.390004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432e030-fb50-42f6-92d1-1673a1cb3996 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:08.394759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1cf2e-1621-49d4-b199-e9a00fa8a9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:08.395456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1cf2e-1621-49d4-b199-e9a00fa8a9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:08.395594 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e432e030-fb50-42f6-92d1-1673a1cb3996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:08.395744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1cf2e-1621-49d4-b199-e9a00fa8a9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:08.396022 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d1cf2e-1621-49d4-b199-e9a00fa8a9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:08.396768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1cf2e-1621-49d4-b199-e9a00fa8a9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:08.398705 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d1cf2e-1621-49d4-b199-e9a00fa8a9a4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:08.410755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1074/2121] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:08.411225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1cf2e-1621-49d4-b199-e9a00fa8a9a4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:08.413041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-67d1cf2e-1621-49d4-b199-e9a00fa8a9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:08.422589 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432e030-fb50-42f6-92d1-1673a1cb3996 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:08.437692 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7334ff5-8ef8-4ddb-9397-7c6e9a85008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:08.438608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7334ff5-8ef8-4ddb-9397-7c6e9a85008b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:08.439076 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7334ff5-8ef8-4ddb-9397-7c6e9a85008b admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:08.439561 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7334ff5-8ef8-4ddb-9397-7c6e9a85008b admin admin] PATH_INFO: `/v3/users/8f4eede40d15421eb431278cd0c7e2fc` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:08.441609 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7334ff5-8ef8-4ddb-9397-7c6e9a85008b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f4eede40d15421eb431278cd0c7e2fc)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:08.444663 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7334ff5-8ef8-4ddb-9397-7c6e9a85008b admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:08.506581 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d1cf2e-1621-49d4-b199-e9a00fa8a9a4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:08.510821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f650e73-c6fd-434b-bd1c-887946709d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:08.511445 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f650e73-c6fd-434b-bd1c-887946709d7d service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:08.511911 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f650e73-c6fd-434b-bd1c-887946709d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:08.512017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f650e73-c6fd-434b-bd1c-887946709d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:08.514118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e7334ff5-8ef8-4ddb-9397-7c6e9a85008b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f4eede40d15421eb431278cd0c7e2fc'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:08.514854 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e7334ff5-8ef8-4ddb-9397-7c6e9a85008b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f4eede40d15421eb431278cd0c7e2fc'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:08.523462 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f650e73-c6fd-434b-bd1c-887946709d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:08.525983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:08.527283 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f650e73-c6fd-434b-bd1c-887946709d7d service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:08.535950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e7334ff5-8ef8-4ddb-9397-7c6e9a85008b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f4eede40d15421eb431278cd0c7e2fc'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:08.544652 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1075/2122] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:08.553317 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e7334ff5-8ef8-4ddb-9397-7c6e9a85008b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f4eede40d15421eb431278cd0c7e2fc'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:08.553598 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f650e73-c6fd-434b-bd1c-887946709d7d service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:08.563743 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f650e73-c6fd-434b-bd1c-887946709d7d service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:08.566668 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e7334ff5-8ef8-4ddb-9397-7c6e9a85008b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f4eede40d15421eb431278cd0c7e2fc'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:08.575587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09554bfa-af32-4d2a-a562-64808cdc2bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:08.576629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09554bfa-af32-4d2a-a562-64808cdc2bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:08.576898 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09554bfa-af32-4d2a-a562-64808cdc2bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:08.577173 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09554bfa-af32-4d2a-a562-64808cdc2bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:08.577870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09554bfa-af32-4d2a-a562-64808cdc2bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:08.579870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09554bfa-af32-4d2a-a562-64808cdc2bbd admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:08.588280 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1048/2123] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:08 2022] DELETE /identity/v3/users/8f4eede40d15421eb431278cd0c7e2fc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:08.593952 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7e5ad-7912-4c31-b460-e50345122018 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:08.594518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7e5ad-7912-4c31-b460-e50345122018 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:08.595738 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7e5ad-7912-4c31-b460-e50345122018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:08.601911 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1076/2124] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:08.603182 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09554bfa-af32-4d2a-a562-64808cdc2bbd admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:08.605844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-09554bfa-af32-4d2a-a562-64808cdc2bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:08.633255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-32a7e5ad-7912-4c31-b460-e50345122018 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:08.634677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09554bfa-af32-4d2a-a562-64808cdc2bbd admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:08.635372 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-32a7e5ad-7912-4c31-b460-e50345122018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:08.736286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:08.750821 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1049/2125] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:12:08.764360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7e5ad-7912-4c31-b460-e50345122018 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:08.768420 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-32a7e5ad-7912-4c31-b460-e50345122018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:08.777869 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf124d-a77c-4d93-9c95-73e99843f25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:08.778919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf124d-a77c-4d93-9c95-73e99843f25d admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:08.779385 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf124d-a77c-4d93-9c95-73e99843f25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:08.780223 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf124d-a77c-4d93-9c95-73e99843f25d admin admin] PATH_INFO: `/v3/projects/9977590e4a6248b5b1a440717d9edf4e/users/e72d67a6f2094ed0b77429ccdc4b7c86/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:08.798713 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7e5ad-7912-4c31-b460-e50345122018 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:08.805595 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe855eb8-167d-4ff8-a2f3-f6e3d7dbcc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:08.807366 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe855eb8-167d-4ff8-a2f3-f6e3d7dbcc39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:08.807660 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe855eb8-167d-4ff8-a2f3-f6e3d7dbcc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:08.807940 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe855eb8-167d-4ff8-a2f3-f6e3d7dbcc39 admin admin] PATH_INFO: `/v3/projects/4518e6fd847749f7b155cdcff55b458d` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:08.808317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf124d-a77c-4d93-9c95-73e99843f25d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9977590e4a6248b5b1a440717d9edf4e, user_id=e72d67a6f2094ed0b77429ccdc4b7c86, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:08.809960 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe855eb8-167d-4ff8-a2f3-f6e3d7dbcc39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4518e6fd847749f7b155cdcff55b458d)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:08.812018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf124d-a77c-4d93-9c95-73e99843f25d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:08.812218 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe855eb8-167d-4ff8-a2f3-f6e3d7dbcc39 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:08.841012 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1077/2126] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:08 2022] PUT /identity/v3/projects/9977590e4a6248b5b1a440717d9edf4e/users/e72d67a6f2094ed0b77429ccdc4b7c86/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:08.842083 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf124d-a77c-4d93-9c95-73e99843f25d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:08.844089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4adf124d-a77c-4d93-9c95-73e99843f25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:08.881077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fe855eb8-167d-4ff8-a2f3-f6e3d7dbcc39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4518e6fd847749f7b155cdcff55b458d', 'request_id': 'req-fe855eb8-167d-4ff8-a2f3-f6e3d7dbcc39'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:08.889048 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fe855eb8-167d-4ff8-a2f3-f6e3d7dbcc39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4518e6fd847749f7b155cdcff55b458d', 'request_id': 'req-fe855eb8-167d-4ff8-a2f3-f6e3d7dbcc39'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:08.896871 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fe855eb8-167d-4ff8-a2f3-f6e3d7dbcc39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4518e6fd847749f7b155cdcff55b458d', 'request_id': 'req-fe855eb8-167d-4ff8-a2f3-f6e3d7dbcc39'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:08.912701 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fe855eb8-167d-4ff8-a2f3-f6e3d7dbcc39 admin admin] The token cache is being invalidate because project 4518e6fd847749f7b155cdcff55b458d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:08.913017 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fe855eb8-167d-4ff8-a2f3-f6e3d7dbcc39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:08.913633 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fe855eb8-167d-4ff8-a2f3-f6e3d7dbcc39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:08.915539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1050/2127] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:08 2022] DELETE /identity/v3/projects/4518e6fd847749f7b155cdcff55b458d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:08.916658 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a9761-940b-4eab-98f4-314c354a7699 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:08.916962 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a9761-940b-4eab-98f4-314c354a7699 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:08.918685 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a9761-940b-4eab-98f4-314c354a7699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:08.925124 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf124d-a77c-4d93-9c95-73e99843f25d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:08.951887 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-a55a9761-940b-4eab-98f4-314c354a7699 None None] MFA Rules not processed for user `e72d67a6f2094ed0b77429ccdc4b7c86`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:08.953133 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a55a9761-940b-4eab-98f4-314c354a7699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:09.007424 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb3874-c6f3-4a09-a2e9-b8aa0f54668f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:09.008050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb3874-c6f3-4a09-a2e9-b8aa0f54668f service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:09.008583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb3874-c6f3-4a09-a2e9-b8aa0f54668f service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:09.008864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb3874-c6f3-4a09-a2e9-b8aa0f54668f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:09.011314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4efb3874-c6f3-4a09-a2e9-b8aa0f54668f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:09.013753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:09.047139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1051/2128] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:09.048786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471e2ed-ef3d-48fc-9b88-7b9b5cb32a60 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:09.049254 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471e2ed-ef3d-48fc-9b88-7b9b5cb32a60 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:09.049533 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471e2ed-ef3d-48fc-9b88-7b9b5cb32a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:09.085494 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-8471e2ed-ef3d-48fc-9b88-7b9b5cb32a60 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:09.086727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-8471e2ed-ef3d-48fc-9b88-7b9b5cb32a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:09.104092 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1052/2129] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:09.105189 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471e2ed-ef3d-48fc-9b88-7b9b5cb32a60 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:09.108361 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb3874-c6f3-4a09-a2e9-b8aa0f54668f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:09.110506 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb3874-c6f3-4a09-a2e9-b8aa0f54668f service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:09.112274 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-8471e2ed-ef3d-48fc-9b88-7b9b5cb32a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:09.126664 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471e2ed-ef3d-48fc-9b88-7b9b5cb32a60 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:09.128795 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1078/2130] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:09.129788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb3874-c6f3-4a09-a2e9-b8aa0f54668f service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:09.132028 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4efb3874-c6f3-4a09-a2e9-b8aa0f54668f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:09.132260 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e0a31-e772-42e1-85e0-09641935ff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:09.133023 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e0a31-e772-42e1-85e0-09641935ff62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:09.133310 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e0a31-e772-42e1-85e0-09641935ff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:09.133588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e0a31-e772-42e1-85e0-09641935ff62 admin admin] PATH_INFO: `/v3/projects/83b8b428262745b09198fab5af974e4f` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:09.134873 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e0a31-e772-42e1-85e0-09641935ff62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b8b428262745b09198fab5af974e4f)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:09.137223 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e0a31-e772-42e1-85e0-09641935ff62 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:09.148521 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb3874-c6f3-4a09-a2e9-b8aa0f54668f service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:09.155006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d98fdb7-221e-4a29-bb81-af592f90e4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:09.155732 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98fdb7-221e-4a29-bb81-af592f90e4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:09.156214 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98fdb7-221e-4a29-bb81-af592f90e4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:09.160386 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d98fdb7-221e-4a29-bb81-af592f90e4f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:09.161239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98fdb7-221e-4a29-bb81-af592f90e4f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:09.165204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d98fdb7-221e-4a29-bb81-af592f90e4f9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:09.197982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1079/2131] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:09 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:09.199706 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201ed60-e224-4ff2-92b9-f283396f398d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:09.200192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201ed60-e224-4ff2-92b9-f283396f398d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:09.200497 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8201ed60-e224-4ff2-92b9-f283396f398d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:09.204910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-698e0a31-e772-42e1-85e0-09641935ff62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b8b428262745b09198fab5af974e4f', 'request_id': 'req-698e0a31-e772-42e1-85e0-09641935ff62'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:09.214381 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-698e0a31-e772-42e1-85e0-09641935ff62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b8b428262745b09198fab5af974e4f', 'request_id': 'req-698e0a31-e772-42e1-85e0-09641935ff62'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:09.226265 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8201ed60-e224-4ff2-92b9-f283396f398d None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:09.227475 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8201ed60-e224-4ff2-92b9-f283396f398d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:09.228992 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-698e0a31-e772-42e1-85e0-09641935ff62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b8b428262745b09198fab5af974e4f', 'request_id': 'req-698e0a31-e772-42e1-85e0-09641935ff62'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:09.233274 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:09.254912 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-698e0a31-e772-42e1-85e0-09641935ff62 admin admin] The token cache is being invalidate because project 83b8b428262745b09198fab5af974e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:09.255218 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-698e0a31-e772-42e1-85e0-09641935ff62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:09.256436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-698e0a31-e772-42e1-85e0-09641935ff62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:09.261452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1053/2132] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:09 2022] DELETE /identity/v3/projects/83b8b428262745b09198fab5af974e4f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:09.262273 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e0a31-e772-42e1-85e0-09641935ff62 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:09.263700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-698e0a31-e772-42e1-85e0-09641935ff62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:09.311866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1080/2133] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:09.316748 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201ed60-e224-4ff2-92b9-f283396f398d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:09.319741 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8201ed60-e224-4ff2-92b9-f283396f398d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:09.341358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8201ed60-e224-4ff2-92b9-f283396f398d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:09.347867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50b46b-f6e9-4c43-9e41-03008cb27d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:09.348731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50b46b-f6e9-4c43-9e41-03008cb27d24 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:09.349027 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50b46b-f6e9-4c43-9e41-03008cb27d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:09.349413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50b46b-f6e9-4c43-9e41-03008cb27d24 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:09.350165 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50b46b-f6e9-4c43-9e41-03008cb27d24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:09.352293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50b46b-f6e9-4c43-9e41-03008cb27d24 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:09.373992 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e0a31-e772-42e1-85e0-09641935ff62 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:09.383801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80a44e-7834-4bae-a403-939a183260a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:09.383801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80a44e-7834-4bae-a403-939a183260a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:09.383801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80a44e-7834-4bae-a403-939a183260a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:09.383801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80a44e-7834-4bae-a403-939a183260a2 admin admin] PATH_INFO: `/v3/users/8e97ceb88cd841d0acef85dfe1be1dd9` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:09.384380 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80a44e-7834-4bae-a403-939a183260a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e97ceb88cd841d0acef85dfe1be1dd9)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:09.385237 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1081/2134] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:09 2022] POST /identity/v3/users => generated 289 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:09.386448 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80a44e-7834-4bae-a403-939a183260a2 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:09.388984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50b46b-f6e9-4c43-9e41-03008cb27d24 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:09.391455 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9d50b46b-f6e9-4c43-9e41-03008cb27d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:09.407456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50b46b-f6e9-4c43-9e41-03008cb27d24 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:09.415131 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3f6d2-cad8-4efc-ae8d-f009ddf352da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:09.416735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3f6d2-cad8-4efc-ae8d-f009ddf352da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:09.417445 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3f6d2-cad8-4efc-ae8d-f009ddf352da admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:09.417990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3f6d2-cad8-4efc-ae8d-f009ddf352da admin admin] PATH_INFO: `/v3/users/051f10cc22bd45d6aedfc1008dc5fbe6` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:09.419917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3f6d2-cad8-4efc-ae8d-f009ddf352da admin admin] RBAC: Authorizing `identity:delete_user(user_id=051f10cc22bd45d6aedfc1008dc5fbe6)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:09.425874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3f6d2-cad8-4efc-ae8d-f009ddf352da admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:09.454761 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-8f80a44e-7834-4bae-a403-939a183260a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e97ceb88cd841d0acef85dfe1be1dd9'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:09.455999 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-8f80a44e-7834-4bae-a403-939a183260a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e97ceb88cd841d0acef85dfe1be1dd9'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:09.474331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-8f80a44e-7834-4bae-a403-939a183260a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e97ceb88cd841d0acef85dfe1be1dd9'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:09.476895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:09.486692 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-8f80a44e-7834-4bae-a403-939a183260a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e97ceb88cd841d0acef85dfe1be1dd9'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:09.489103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-8f80a44e-7834-4bae-a403-939a183260a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e97ceb88cd841d0acef85dfe1be1dd9'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:09.494870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d2a3f6d2-cad8-4efc-ae8d-f009ddf352da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '051f10cc22bd45d6aedfc1008dc5fbe6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:09.496410 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d2a3f6d2-cad8-4efc-ae8d-f009ddf352da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '051f10cc22bd45d6aedfc1008dc5fbe6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:09.505468 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d2a3f6d2-cad8-4efc-ae8d-f009ddf352da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '051f10cc22bd45d6aedfc1008dc5fbe6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:09.508727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1054/2135] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:09 2022] DELETE /identity/v3/users/8e97ceb88cd841d0acef85dfe1be1dd9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:09.512828 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80a44e-7834-4bae-a403-939a183260a2 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:09.514387 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-8f80a44e-7834-4bae-a403-939a183260a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:09.521510 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d2a3f6d2-cad8-4efc-ae8d-f009ddf352da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '051f10cc22bd45d6aedfc1008dc5fbe6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:09.531302 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d2a3f6d2-cad8-4efc-ae8d-f009ddf352da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '051f10cc22bd45d6aedfc1008dc5fbe6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:09.546956 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1082/2136] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:09 2022] DELETE /identity/v3/users/051f10cc22bd45d6aedfc1008dc5fbe6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:09.548007 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3f6d2-cad8-4efc-ae8d-f009ddf352da admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:09.549953 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d2a3f6d2-cad8-4efc-ae8d-f009ddf352da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:09.604797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80a44e-7834-4bae-a403-939a183260a2 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:09.635047 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3f6d2-cad8-4efc-ae8d-f009ddf352da admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:09.640353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff34333d-71d9-455b-8bff-500bc8794046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:09.641028 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34333d-71d9-455b-8bff-500bc8794046 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:09.641682 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34333d-71d9-455b-8bff-500bc8794046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:09.641682 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff34333d-71d9-455b-8bff-500bc8794046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:09.642342 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34333d-71d9-455b-8bff-500bc8794046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:09.644073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff34333d-71d9-455b-8bff-500bc8794046 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:09.650129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:09.658047 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1083/2137] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:09.660223 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55591c79-ce63-4d93-8d09-6349f2214a6e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:09.660897 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55591c79-ce63-4d93-8d09-6349f2214a6e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:09.661953 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55591c79-ce63-4d93-8d09-6349f2214a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:09.687838 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6d45e-e991-4c8d-aa49-013684fc7a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:09.688621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6d45e-e991-4c8d-aa49-013684fc7a6b admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:09.688985 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6d45e-e991-4c8d-aa49-013684fc7a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:09.689334 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6d45e-e991-4c8d-aa49-013684fc7a6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:09.689609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-55591c79-ce63-4d93-8d09-6349f2214a6e None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:09.690181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6d45e-e991-4c8d-aa49-013684fc7a6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:12:09.691207 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6d45e-e991-4c8d-aa49-013684fc7a6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:09.691645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-55591c79-ce63-4d93-8d09-6349f2214a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:09.693702 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef6d45e-e991-4c8d-aa49-013684fc7a6b admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:09.705462 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1084/2138] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:09.705462 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55591c79-ce63-4d93-8d09-6349f2214a6e None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:09.718932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1055/2139] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:12:09.720274 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6d45e-e991-4c8d-aa49-013684fc7a6b admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:09.723748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-6ef6d45e-e991-4c8d-aa49-013684fc7a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:09.725013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55591c79-ce63-4d93-8d09-6349f2214a6e None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:09.736556 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb254c9-b933-4cba-8e6e-1fa1fba00708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:09.738618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb254c9-b933-4cba-8e6e-1fa1fba00708 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:09.738842 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb254c9-b933-4cba-8e6e-1fa1fba00708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:09.739859 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb254c9-b933-4cba-8e6e-1fa1fba00708 admin admin] PATH_INFO: `/v3/projects/62ce554aa9c5455cbc4c68f226eb7b2b/users/8469d320f6d1476cbf973d72feae973e/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:09.750782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6d45e-e991-4c8d-aa49-013684fc7a6b admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:09.763141 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5355d4-4e1e-4442-98e9-a7ce15c08b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:09.763790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5355d4-4e1e-4442-98e9-a7ce15c08b49 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:09.765986 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5355d4-4e1e-4442-98e9-a7ce15c08b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:09.766401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5355d4-4e1e-4442-98e9-a7ce15c08b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:09.767112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5355d4-4e1e-4442-98e9-a7ce15c08b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:09.771012 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5355d4-4e1e-4442-98e9-a7ce15c08b49 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:09.775388 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb254c9-b933-4cba-8e6e-1fa1fba00708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ce554aa9c5455cbc4c68f226eb7b2b, user_id=8469d320f6d1476cbf973d72feae973e, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:09.779017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb254c9-b933-4cba-8e6e-1fa1fba00708 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:09.811456 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1056/2140] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:09 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:09.812931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5355d4-4e1e-4442-98e9-a7ce15c08b49 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:09.823219 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ce5355d4-4e1e-4442-98e9-a7ce15c08b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:09.823363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1085/2141] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:09 2022] PUT /identity/v3/projects/62ce554aa9c5455cbc4c68f226eb7b2b/users/8469d320f6d1476cbf973d72feae973e/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:09.823363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb254c9-b933-4cba-8e6e-1fa1fba00708 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:09.951015 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5355d4-4e1e-4442-98e9-a7ce15c08b49 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:09.954029 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb254c9-b933-4cba-8e6e-1fa1fba00708 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:09.959161 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7e7f0-3fc3-434f-821e-be2116c19383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:09.960014 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e7f0-3fc3-434f-821e-be2116c19383 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:09.960401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e7f0-3fc3-434f-821e-be2116c19383 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:09.960912 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e7f0-3fc3-434f-821e-be2116c19383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:10.002524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:10.062496 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bc7fd-1001-43a4-a127-7ddf80291559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:10.063561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bc7fd-1001-43a4-a127-7ddf80291559 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:10.064017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bc7fd-1001-43a4-a127-7ddf80291559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:10.064429 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366bc7fd-1001-43a4-a127-7ddf80291559 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:10.065346 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366bc7fd-1001-43a4-a127-7ddf80291559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:10.071459 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366bc7fd-1001-43a4-a127-7ddf80291559 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:10.077923 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7e7f0-3fc3-434f-821e-be2116c19383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:10.079374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7e7f0-3fc3-434f-821e-be2116c19383 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:10.092759 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1057/2142] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:10.093931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7e7f0-3fc3-434f-821e-be2116c19383 service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:10.105318 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7e7f0-3fc3-434f-821e-be2116c19383 service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:10.110749 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e1079-18da-45fc-a1fb-d898a09d49c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:10.111371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e1079-18da-45fc-a1fb-d898a09d49c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:10.111656 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e1079-18da-45fc-a1fb-d898a09d49c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:10.111988 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e1079-18da-45fc-a1fb-d898a09d49c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:10.113268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e1079-18da-45fc-a1fb-d898a09d49c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:10.113996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1086/2143] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:09 2022] POST /identity/v3/users => generated 287 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:10.115214 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e1079-18da-45fc-a1fb-d898a09d49c0 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:10.118724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bc7fd-1001-43a4-a127-7ddf80291559 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:10.129503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1058/2144] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:10.133156 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e1079-18da-45fc-a1fb-d898a09d49c0 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:10.136746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366bc7fd-1001-43a4-a127-7ddf80291559 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:10.142230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315d1d1-86e6-4a0e-8a81-200e7f231392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:10.143244 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315d1d1-86e6-4a0e-8a81-200e7f231392 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:10.143714 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315d1d1-86e6-4a0e-8a81-200e7f231392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:10.144131 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315d1d1-86e6-4a0e-8a81-200e7f231392 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:10.145083 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315d1d1-86e6-4a0e-8a81-200e7f231392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:10.147090 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c315d1d1-86e6-4a0e-8a81-200e7f231392 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:10.148255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e1079-18da-45fc-a1fb-d898a09d49c0 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:10.156381 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20159391-d669-47ee-8b16-8b42b28c0e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:10.157542 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20159391-d669-47ee-8b16-8b42b28c0e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:10.158000 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20159391-d669-47ee-8b16-8b42b28c0e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:10.158513 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20159391-d669-47ee-8b16-8b42b28c0e63 admin admin] PATH_INFO: `/v3/projects/62ce554aa9c5455cbc4c68f226eb7b2b/users/8469d320f6d1476cbf973d72feae973e/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:10.161368 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20159391-d669-47ee-8b16-8b42b28c0e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ce554aa9c5455cbc4c68f226eb7b2b, user_id=8469d320f6d1476cbf973d72feae973e, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:10.162056 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1087/2145] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:10.164712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20159391-d669-47ee-8b16-8b42b28c0e63 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:10.165653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315d1d1-86e6-4a0e-8a81-200e7f231392 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:10.179734 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c315d1d1-86e6-4a0e-8a81-200e7f231392 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:10.180694 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1059/2146] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:10 2022] PUT /identity/v3/projects/62ce554aa9c5455cbc4c68f226eb7b2b/users/8469d320f6d1476cbf973d72feae973e/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:10.205586 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b3f6c-124c-4eb1-9866-28556ebfaafa None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:10.208525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b3f6c-124c-4eb1-9866-28556ebfaafa None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:10.209001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b3f6c-124c-4eb1-9866-28556ebfaafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:10.270093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-a46b3f6c-124c-4eb1-9866-28556ebfaafa None None] MFA Rules not processed for user `8469d320f6d1476cbf973d72feae973e`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:10.273261 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a46b3f6c-124c-4eb1-9866-28556ebfaafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:10.351701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:10.392651 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acdef2-8cf0-48f0-98c9-c0d932ed3877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:10.406624 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1060/2147] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:10.411486 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b3f6c-124c-4eb1-9866-28556ebfaafa None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:10.413291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acdef2-8cf0-48f0-98c9-c0d932ed3877 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:10.413875 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acdef2-8cf0-48f0-98c9-c0d932ed3877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:10.416229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03acdef2-8cf0-48f0-98c9-c0d932ed3877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:10.419061 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03acdef2-8cf0-48f0-98c9-c0d932ed3877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:10.421952 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a46b3f6c-124c-4eb1-9866-28556ebfaafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:10.422518 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03acdef2-8cf0-48f0-98c9-c0d932ed3877 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:10.435484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1088/2148] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:10.436693 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acdef2-8cf0-48f0-98c9-c0d932ed3877 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:10.438604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-03acdef2-8cf0-48f0-98c9-c0d932ed3877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:10.461143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b3f6c-124c-4eb1-9866-28556ebfaafa None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:10.475731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37df2c-7ab5-4650-a496-db9acca87358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:10.476407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37df2c-7ab5-4650-a496-db9acca87358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:10.476989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37df2c-7ab5-4650-a496-db9acca87358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:10.477256 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37df2c-7ab5-4650-a496-db9acca87358 admin admin] PATH_INFO: `/v3/projects/763c5b78630548458f3864b373581e59` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:10.479313 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37df2c-7ab5-4650-a496-db9acca87358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=763c5b78630548458f3864b373581e59)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:10.481292 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37df2c-7ab5-4650-a496-db9acca87358 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:10.523845 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03acdef2-8cf0-48f0-98c9-c0d932ed3877 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:10.530206 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2550ab-91c2-4630-89d8-4dcc3cb89408 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:10.531478 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2550ab-91c2-4630-89d8-4dcc3cb89408 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:10.532235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2550ab-91c2-4630-89d8-4dcc3cb89408 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:10.532942 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2550ab-91c2-4630-89d8-4dcc3cb89408 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:10.551293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2550ab-91c2-4630-89d8-4dcc3cb89408 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:10.553079 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2550ab-91c2-4630-89d8-4dcc3cb89408 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:10.567315 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1089/2149] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:10.568589 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2550ab-91c2-4630-89d8-4dcc3cb89408 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:10.581106 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2550ab-91c2-4630-89d8-4dcc3cb89408 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:10.588944 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-ee37df2c-7ab5-4650-a496-db9acca87358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '763c5b78630548458f3864b373581e59', 'request_id': 'req-ee37df2c-7ab5-4650-a496-db9acca87358'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:10.597317 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-ee37df2c-7ab5-4650-a496-db9acca87358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '763c5b78630548458f3864b373581e59', 'request_id': 'req-ee37df2c-7ab5-4650-a496-db9acca87358'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:10.605593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-ee37df2c-7ab5-4650-a496-db9acca87358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '763c5b78630548458f3864b373581e59', 'request_id': 'req-ee37df2c-7ab5-4650-a496-db9acca87358'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:10.614096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:10.648738 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-ee37df2c-7ab5-4650-a496-db9acca87358 admin admin] The token cache is being invalidate because project 763c5b78630548458f3864b373581e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:10.648962 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-ee37df2c-7ab5-4650-a496-db9acca87358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:10.649742 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-ee37df2c-7ab5-4650-a496-db9acca87358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:10.651781 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1061/2150] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:10 2022] DELETE /identity/v3/projects/763c5b78630548458f3864b373581e59 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:10.655926 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37df2c-7ab5-4650-a496-db9acca87358 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:10.658014 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ee37df2c-7ab5-4650-a496-db9acca87358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:10.695156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760dc88-221b-4fa4-9967-d7872e914b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:10.695980 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760dc88-221b-4fa4-9967-d7872e914b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:10.696139 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760dc88-221b-4fa4-9967-d7872e914b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:10.696417 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760dc88-221b-4fa4-9967-d7872e914b7b admin admin] PATH_INFO: `/v3/projects/7c88efd38c3e4edf96dd99854f39fc38/users/22bacfaa5aa3415da5d401947ccd666d/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:10.713686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760dc88-221b-4fa4-9967-d7872e914b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c88efd38c3e4edf96dd99854f39fc38, user_id=22bacfaa5aa3415da5d401947ccd666d, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:10.716604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760dc88-221b-4fa4-9967-d7872e914b7b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:10.734072 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1090/2151] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:10 2022] PUT /identity/v3/projects/7c88efd38c3e4edf96dd99854f39fc38/users/22bacfaa5aa3415da5d401947ccd666d/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:10.734706 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760dc88-221b-4fa4-9967-d7872e914b7b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:10.737106 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5760dc88-221b-4fa4-9967-d7872e914b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:10.747386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37df2c-7ab5-4650-a496-db9acca87358 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:10.810816 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760dc88-221b-4fa4-9967-d7872e914b7b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:10.814931 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad78a59-eb22-4f0c-8113-07fdb2ddefc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:10.816174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad78a59-eb22-4f0c-8113-07fdb2ddefc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:10.817210 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad78a59-eb22-4f0c-8113-07fdb2ddefc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:10.817210 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad78a59-eb22-4f0c-8113-07fdb2ddefc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:10.817918 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2594ec0-9d72-4fc7-ba22-811585c3d8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:10.818798 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2594ec0-9d72-4fc7-ba22-811585c3d8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:10.818971 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0ad78a59-eb22-4f0c-8113-07fdb2ddefc8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:10.819128 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2594ec0-9d72-4fc7-ba22-811585c3d8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:10.819367 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2594ec0-9d72-4fc7-ba22-811585c3d8e5 admin admin] PATH_INFO: `/v3/users/51878d0479c84b5da4010cef414eb53f` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:10.822332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2594ec0-9d72-4fc7-ba22-811585c3d8e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51878d0479c84b5da4010cef414eb53f)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:10.825837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2594ec0-9d72-4fc7-ba22-811585c3d8e5 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:10.855047 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:10.890487 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a2594ec0-9d72-4fc7-ba22-811585c3d8e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51878d0479c84b5da4010cef414eb53f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:10.891753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a2594ec0-9d72-4fc7-ba22-811585c3d8e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51878d0479c84b5da4010cef414eb53f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:10.895770 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad78a59-eb22-4f0c-8113-07fdb2ddefc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:10.897476 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad78a59-eb22-4f0c-8113-07fdb2ddefc8 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:10.909355 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1091/2152] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:10.913394 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a2594ec0-9d72-4fc7-ba22-811585c3d8e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51878d0479c84b5da4010cef414eb53f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:10.915264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d593d1e-9471-484d-9a21-0987e5d3d1ea None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:10.917109 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d593d1e-9471-484d-9a21-0987e5d3d1ea None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:10.917643 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d593d1e-9471-484d-9a21-0987e5d3d1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:10.928541 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a2594ec0-9d72-4fc7-ba22-811585c3d8e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51878d0479c84b5da4010cef414eb53f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:10.929859 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a2594ec0-9d72-4fc7-ba22-811585c3d8e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51878d0479c84b5da4010cef414eb53f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:10.951780 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1062/2153] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:10 2022] DELETE /identity/v3/users/51878d0479c84b5da4010cef414eb53f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:10.979087 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4d593d1e-9471-484d-9a21-0987e5d3d1ea None None] MFA Rules not processed for user `22bacfaa5aa3415da5d401947ccd666d`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:10.981353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4d593d1e-9471-484d-9a21-0987e5d3d1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:11.043732 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2594ec0-9d72-4fc7-ba22-811585c3d8e5 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:11.047697 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a2594ec0-9d72-4fc7-ba22-811585c3d8e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:11.140878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:11.176671 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1092/2154] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:11.189372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d593d1e-9471-484d-9a21-0987e5d3d1ea None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:11.194287 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4d593d1e-9471-484d-9a21-0987e5d3d1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:11.202960 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2594ec0-9d72-4fc7-ba22-811585c3d8e5 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:11.209523 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299dfba1-02cc-4540-bc52-4118e53ecba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:11.210237 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dfba1-02cc-4540-bc52-4118e53ecba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:11.210538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dfba1-02cc-4540-bc52-4118e53ecba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:11.210804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dfba1-02cc-4540-bc52-4118e53ecba5 admin admin] PATH_INFO: `/v3/projects/b94f5a7a06d54c17afb3ef6dacad91dc` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:11.212313 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299dfba1-02cc-4540-bc52-4118e53ecba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b94f5a7a06d54c17afb3ef6dacad91dc)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:11.214575 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299dfba1-02cc-4540-bc52-4118e53ecba5 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:11.324497 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-299dfba1-02cc-4540-bc52-4118e53ecba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b94f5a7a06d54c17afb3ef6dacad91dc', 'request_id': 'req-299dfba1-02cc-4540-bc52-4118e53ecba5'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:11.343993 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-299dfba1-02cc-4540-bc52-4118e53ecba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b94f5a7a06d54c17afb3ef6dacad91dc', 'request_id': 'req-299dfba1-02cc-4540-bc52-4118e53ecba5'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:11.359212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-299dfba1-02cc-4540-bc52-4118e53ecba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b94f5a7a06d54c17afb3ef6dacad91dc', 'request_id': 'req-299dfba1-02cc-4540-bc52-4118e53ecba5'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:11.391015 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-299dfba1-02cc-4540-bc52-4118e53ecba5 admin admin] The token cache is being invalidate because project b94f5a7a06d54c17afb3ef6dacad91dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:11.393196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-299dfba1-02cc-4540-bc52-4118e53ecba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:11.395284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-299dfba1-02cc-4540-bc52-4118e53ecba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:11.403062 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1063/2155] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:11 2022] DELETE /identity/v3/projects/b94f5a7a06d54c17afb3ef6dacad91dc => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:11.404198 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299dfba1-02cc-4540-bc52-4118e53ecba5 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:11.407204 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-299dfba1-02cc-4540-bc52-4118e53ecba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:11.420998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d593d1e-9471-484d-9a21-0987e5d3d1ea None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:11.516767 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb46aec-60f9-4517-a6b0-5e0b350e05ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:11.517405 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb46aec-60f9-4517-a6b0-5e0b350e05ac service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:11.517691 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb46aec-60f9-4517-a6b0-5e0b350e05ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:11.517967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb46aec-60f9-4517-a6b0-5e0b350e05ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:11.520754 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fdb46aec-60f9-4517-a6b0-5e0b350e05ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:11.540321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299dfba1-02cc-4540-bc52-4118e53ecba5 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:11.548391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523bd79-33ce-4c98-a8f5-9d81bbd19602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:11.549225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523bd79-33ce-4c98-a8f5-9d81bbd19602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:11.549579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523bd79-33ce-4c98-a8f5-9d81bbd19602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:11.551795 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523bd79-33ce-4c98-a8f5-9d81bbd19602 admin admin] PATH_INFO: `/v3/projects/365d8546119d4cdd96d522058b6ad166` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:11.553307 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523bd79-33ce-4c98-a8f5-9d81bbd19602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=365d8546119d4cdd96d522058b6ad166)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:11.555982 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523bd79-33ce-4c98-a8f5-9d81bbd19602 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:11.560154 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:11.593214 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb46aec-60f9-4517-a6b0-5e0b350e05ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:11.594794 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb46aec-60f9-4517-a6b0-5e0b350e05ac service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:11.605803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1093/2156] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:11.607045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95bdd8-7297-4649-aac0-ba9e23a68fc4 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:11.607342 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95bdd8-7297-4649-aac0-ba9e23a68fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:11.607624 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95bdd8-7297-4649-aac0-ba9e23a68fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:11.624538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-1523bd79-33ce-4c98-a8f5-9d81bbd19602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '365d8546119d4cdd96d522058b6ad166', 'request_id': 'req-1523bd79-33ce-4c98-a8f5-9d81bbd19602'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:11.630082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ba95bdd8-7297-4649-aac0-ba9e23a68fc4 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:11.630332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:11.634400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-1523bd79-33ce-4c98-a8f5-9d81bbd19602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '365d8546119d4cdd96d522058b6ad166', 'request_id': 'req-1523bd79-33ce-4c98-a8f5-9d81bbd19602'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:11.635137 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ba95bdd8-7297-4649-aac0-ba9e23a68fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:11.651805 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-1523bd79-33ce-4c98-a8f5-9d81bbd19602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '365d8546119d4cdd96d522058b6ad166', 'request_id': 'req-1523bd79-33ce-4c98-a8f5-9d81bbd19602'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:11.674014 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-1523bd79-33ce-4c98-a8f5-9d81bbd19602 admin admin] The token cache is being invalidate because project 365d8546119d4cdd96d522058b6ad166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:11.674752 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-1523bd79-33ce-4c98-a8f5-9d81bbd19602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:11.676018 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-1523bd79-33ce-4c98-a8f5-9d81bbd19602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:11.677608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1064/2157] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:11 2022] DELETE /identity/v3/projects/365d8546119d4cdd96d522058b6ad166 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:11.678449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523bd79-33ce-4c98-a8f5-9d81bbd19602 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:11.681514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-1523bd79-33ce-4c98-a8f5-9d81bbd19602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:11.726163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1094/2158] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:11.726648 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95bdd8-7297-4649-aac0-ba9e23a68fc4 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:11.727998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ba95bdd8-7297-4649-aac0-ba9e23a68fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:11.742139 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95bdd8-7297-4649-aac0-ba9e23a68fc4 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:11.755855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066376f-046e-4c54-9eba-6234374e9618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:11.756555 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066376f-046e-4c54-9eba-6234374e9618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:11.756842 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066376f-046e-4c54-9eba-6234374e9618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:11.757119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066376f-046e-4c54-9eba-6234374e9618 admin admin] PATH_INFO: `/v3/users/22bacfaa5aa3415da5d401947ccd666d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:11.758995 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066376f-046e-4c54-9eba-6234374e9618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22bacfaa5aa3415da5d401947ccd666d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:11.760996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066376f-046e-4c54-9eba-6234374e9618 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:11.761175 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523bd79-33ce-4c98-a8f5-9d81bbd19602 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:11.766541 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074938a-615c-42c5-90c3-cb0c306ff303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:11.767225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074938a-615c-42c5-90c3-cb0c306ff303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:11.767513 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074938a-615c-42c5-90c3-cb0c306ff303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:11.767792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3074938a-615c-42c5-90c3-cb0c306ff303 admin admin] PATH_INFO: `/v3/projects/a1aa6c949517493f920e82006bcc600e` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:11.769600 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074938a-615c-42c5-90c3-cb0c306ff303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1aa6c949517493f920e82006bcc600e)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:11.771936 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3074938a-615c-42c5-90c3-cb0c306ff303 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:11.825881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3074938a-615c-42c5-90c3-cb0c306ff303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1aa6c949517493f920e82006bcc600e', 'request_id': 'req-3074938a-615c-42c5-90c3-cb0c306ff303'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:11.830336 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8066376f-046e-4c54-9eba-6234374e9618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22bacfaa5aa3415da5d401947ccd666d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:11.832063 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8066376f-046e-4c54-9eba-6234374e9618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22bacfaa5aa3415da5d401947ccd666d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:11.835275 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3074938a-615c-42c5-90c3-cb0c306ff303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1aa6c949517493f920e82006bcc600e', 'request_id': 'req-3074938a-615c-42c5-90c3-cb0c306ff303'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:11.839810 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8066376f-046e-4c54-9eba-6234374e9618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22bacfaa5aa3415da5d401947ccd666d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:11.849322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3074938a-615c-42c5-90c3-cb0c306ff303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1aa6c949517493f920e82006bcc600e', 'request_id': 'req-3074938a-615c-42c5-90c3-cb0c306ff303'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:11.856622 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8066376f-046e-4c54-9eba-6234374e9618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22bacfaa5aa3415da5d401947ccd666d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:11.865543 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3074938a-615c-42c5-90c3-cb0c306ff303 admin admin] The token cache is being invalidate because project a1aa6c949517493f920e82006bcc600e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:11.865953 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8066376f-046e-4c54-9eba-6234374e9618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22bacfaa5aa3415da5d401947ccd666d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:11.866101 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3074938a-615c-42c5-90c3-cb0c306ff303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:11.866680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3074938a-615c-42c5-90c3-cb0c306ff303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:11.871625 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1065/2159] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:11 2022] DELETE /identity/v3/projects/a1aa6c949517493f920e82006bcc600e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:11.871625 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074938a-615c-42c5-90c3-cb0c306ff303 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:11.871625 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-3074938a-615c-42c5-90c3-cb0c306ff303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:11.878643 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1095/2160] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:11 2022] DELETE /identity/v3/users/22bacfaa5aa3415da5d401947ccd666d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:11.881920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0677f6-aaac-44f5-9f82-69fbe8e4a256 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:11.881920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0677f6-aaac-44f5-9f82-69fbe8e4a256 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:11.881920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0677f6-aaac-44f5-9f82-69fbe8e4a256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:11.903215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9e0677f6-aaac-44f5-9f82-69fbe8e4a256 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:11.904665 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9e0677f6-aaac-44f5-9f82-69fbe8e4a256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:11.956534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:11.982343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3074938a-615c-42c5-90c3-cb0c306ff303 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:11.990388 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1096/2161] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:11.991677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3b5da-8250-4c34-a62b-33ef0b590bed None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:11.991962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3b5da-8250-4c34-a62b-33ef0b590bed None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:11.992238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3b5da-8250-4c34-a62b-33ef0b590bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:11.993404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff8661-16e1-42d4-89e2-d23d75cf84ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:11.994542 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff8661-16e1-42d4-89e2-d23d75cf84ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:11.995030 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff8661-16e1-42d4-89e2-d23d75cf84ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:11.995842 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff8661-16e1-42d4-89e2-d23d75cf84ca admin admin] PATH_INFO: `/v3/users/668dbda43b9d470fb542f6d88ee17720` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:11.997653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff8661-16e1-42d4-89e2-d23d75cf84ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=668dbda43b9d470fb542f6d88ee17720)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:12.001120 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff8661-16e1-42d4-89e2-d23d75cf84ca admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:12.021673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0db3b5da-8250-4c34-a62b-33ef0b590bed None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:12.021875 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:12.027129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0db3b5da-8250-4c34-a62b-33ef0b590bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:12.054312 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1097/2162] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:12.054312 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa5ee8-bd3d-4d6d-b370-e35f6b3bd3dd None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:12.054312 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa5ee8-bd3d-4d6d-b370-e35f6b3bd3dd None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:12.054312 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa5ee8-bd3d-4d6d-b370-e35f6b3bd3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:12.076501 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-09aa5ee8-bd3d-4d6d-b370-e35f6b3bd3dd None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:12.077721 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-09aa5ee8-bd3d-4d6d-b370-e35f6b3bd3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:12.090268 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1098/2163] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:12.091285 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa5ee8-bd3d-4d6d-b370-e35f6b3bd3dd None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:12.097616 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-34ff8661-16e1-42d4-89e2-d23d75cf84ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '668dbda43b9d470fb542f6d88ee17720'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:12.098704 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-34ff8661-16e1-42d4-89e2-d23d75cf84ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '668dbda43b9d470fb542f6d88ee17720'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:12.116969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-34ff8661-16e1-42d4-89e2-d23d75cf84ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '668dbda43b9d470fb542f6d88ee17720'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:12.120736 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aa5ee8-bd3d-4d6d-b370-e35f6b3bd3dd None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:12.126743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-34ff8661-16e1-42d4-89e2-d23d75cf84ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '668dbda43b9d470fb542f6d88ee17720'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:12.127644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-34ff8661-16e1-42d4-89e2-d23d75cf84ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '668dbda43b9d470fb542f6d88ee17720'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:12.136308 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e98e16-70c1-49de-81fd-65d65a33a94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:12.136973 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e98e16-70c1-49de-81fd-65d65a33a94d admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:12.137251 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e98e16-70c1-49de-81fd-65d65a33a94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:12.137585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e98e16-70c1-49de-81fd-65d65a33a94d admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:12.138718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e98e16-70c1-49de-81fd-65d65a33a94d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:12:12.139003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e98e16-70c1-49de-81fd-65d65a33a94d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:12.140943 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e98e16-70c1-49de-81fd-65d65a33a94d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:12.148579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1066/2164] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:11 2022] DELETE /identity/v3/users/668dbda43b9d470fb542f6d88ee17720 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:12.150213 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68766e2-9247-4f0c-adf2-feec8480f387 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:12.150577 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68766e2-9247-4f0c-adf2-feec8480f387 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:12.151061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68766e2-9247-4f0c-adf2-feec8480f387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:12.171999 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1099/2165] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:12:12.173088 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e98e16-70c1-49de-81fd-65d65a33a94d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:12.176200 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-b68766e2-9247-4f0c-adf2-feec8480f387 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:12.177883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b68766e2-9247-4f0c-adf2-feec8480f387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:12.178204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-87e98e16-70c1-49de-81fd-65d65a33a94d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:12.267868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1067/2166] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:12.267868 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68766e2-9247-4f0c-adf2-feec8480f387 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:12.268183 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b68766e2-9247-4f0c-adf2-feec8480f387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:12.281166 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68766e2-9247-4f0c-adf2-feec8480f387 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:12.286648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab730e-792d-4adb-9411-8431d3016339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:12.287562 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab730e-792d-4adb-9411-8431d3016339 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:12.287984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab730e-792d-4adb-9411-8431d3016339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:12.288372 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab730e-792d-4adb-9411-8431d3016339 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:12.289907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab730e-792d-4adb-9411-8431d3016339 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:12.291998 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab730e-792d-4adb-9411-8431d3016339 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:12.312284 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e98e16-70c1-49de-81fd-65d65a33a94d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:12.340410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1068/2167] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:12 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:12.340410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab730e-792d-4adb-9411-8431d3016339 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:12.414792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea366f0-eb4a-4fda-9c04-6e7b0cddf57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:12.415735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea366f0-eb4a-4fda-9c04-6e7b0cddf57b service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:12.415735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea366f0-eb4a-4fda-9c04-6e7b0cddf57b service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:12.415948 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea366f0-eb4a-4fda-9c04-6e7b0cddf57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:12.419191 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bea366f0-eb4a-4fda-9c04-6e7b0cddf57b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:12.434380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea366f0-eb4a-4fda-9c04-6e7b0cddf57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:12.436626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea366f0-eb4a-4fda-9c04-6e7b0cddf57b service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:12.449883 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1100/2168] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:12.455124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab730e-792d-4adb-9411-8431d3016339 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:12.462152 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d68a8-22c7-4d67-ab91-2322d0a3ebb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:12.463279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d68a8-22c7-4d67-ab91-2322d0a3ebb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:12.463772 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d68a8-22c7-4d67-ab91-2322d0a3ebb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:12.464285 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d68a8-22c7-4d67-ab91-2322d0a3ebb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:12.465314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d68a8-22c7-4d67-ab91-2322d0a3ebb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:12:12.465888 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d68a8-22c7-4d67-ab91-2322d0a3ebb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:12.466585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea366f0-eb4a-4fda-9c04-6e7b0cddf57b service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:12.469012 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d68a8-22c7-4d67-ab91-2322d0a3ebb2 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:12.482262 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea366f0-eb4a-4fda-9c04-6e7b0cddf57b service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:12.489205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1069/2169] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:12:12.489517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18993836-d2dc-43d5-bdee-51a82ef17dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:12.489952 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18993836-d2dc-43d5-bdee-51a82ef17dbb admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:12.490320 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18993836-d2dc-43d5-bdee-51a82ef17dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:12.490535 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18993836-d2dc-43d5-bdee-51a82ef17dbb admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:12.491903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18993836-d2dc-43d5-bdee-51a82ef17dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:12.494393 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18993836-d2dc-43d5-bdee-51a82ef17dbb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:12.494906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d68a8-22c7-4d67-ab91-2322d0a3ebb2 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:12.511095 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:12.520404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d68a8-22c7-4d67-ab91-2322d0a3ebb2 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:12.524850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1101/2170] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:12 2022] POST /identity/v3/users => generated 292 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:12.528667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18993836-d2dc-43d5-bdee-51a82ef17dbb admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:12.532043 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefac1b-929b-4142-9f24-78231fe7ea11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:12.533961 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefac1b-929b-4142-9f24-78231fe7ea11 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:12.534878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefac1b-929b-4142-9f24-78231fe7ea11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:12.536275 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefac1b-929b-4142-9f24-78231fe7ea11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:12.537281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefac1b-929b-4142-9f24-78231fe7ea11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:12.542315 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdefac1b-929b-4142-9f24-78231fe7ea11 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:12.552428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18993836-d2dc-43d5-bdee-51a82ef17dbb admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:12.559508 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31f505-ae79-42a9-9675-712891ec60c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:12.560790 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31f505-ae79-42a9-9675-712891ec60c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:12.562099 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31f505-ae79-42a9-9675-712891ec60c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:12.565314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31f505-ae79-42a9-9675-712891ec60c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:12.569238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31f505-ae79-42a9-9675-712891ec60c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:12.573497 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31f505-ae79-42a9-9675-712891ec60c8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:12.594375 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1070/2171] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:12 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:12.598637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefac1b-929b-4142-9f24-78231fe7ea11 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:12.605380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1102/2172] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:12:12.610769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31f505-ae79-42a9-9675-712891ec60c8 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:12.628508 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31f505-ae79-42a9-9675-712891ec60c8 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:12.730775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:12.749367 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc094ed-0fbc-4c4d-a4a4-748a5c119cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:12.749981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc094ed-0fbc-4c4d-a4a4-748a5c119cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:12.750242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc094ed-0fbc-4c4d-a4a4-748a5c119cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:12.750550 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc094ed-0fbc-4c4d-a4a4-748a5c119cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:12.751230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc094ed-0fbc-4c4d-a4a4-748a5c119cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:12.753433 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdefac1b-929b-4142-9f24-78231fe7ea11 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:12.756308 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc094ed-0fbc-4c4d-a4a4-748a5c119cb2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:12.759111 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd64b4d-e97c-45d8-871f-24a854077df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:12.759598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd64b4d-e97c-45d8-871f-24a854077df8 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:12.759967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd64b4d-e97c-45d8-871f-24a854077df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:12.760396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd64b4d-e97c-45d8-871f-24a854077df8 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:12.761214 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd64b4d-e97c-45d8-871f-24a854077df8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:12.763353 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd64b4d-e97c-45d8-871f-24a854077df8 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:12.783984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1103/2173] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:12.787870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc094ed-0fbc-4c4d-a4a4-748a5c119cb2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:12.801330 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1071/2174] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:12 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:12.802469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc094ed-0fbc-4c4d-a4a4-748a5c119cb2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:12.803571 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd64b4d-e97c-45d8-871f-24a854077df8 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:12.815965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998abad-af3e-4dac-9b99-aea4e74e93ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:12.816845 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998abad-af3e-4dac-9b99-aea4e74e93ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:12.816845 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998abad-af3e-4dac-9b99-aea4e74e93ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:12.817130 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998abad-af3e-4dac-9b99-aea4e74e93ad admin admin] PATH_INFO: `/v3/projects/c92fefdfa2744583a03f82ab0b759617/users/32acb197fda74f409dd333518b2f8972/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:12.823652 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd64b4d-e97c-45d8-871f-24a854077df8 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:12.833160 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e95b70-8da5-4944-9b47-3e1eada92cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:12.836171 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e95b70-8da5-4944-9b47-3e1eada92cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:12.836585 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e95b70-8da5-4944-9b47-3e1eada92cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:12.836999 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e95b70-8da5-4944-9b47-3e1eada92cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:12.837964 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e95b70-8da5-4944-9b47-3e1eada92cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:12.839939 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e95b70-8da5-4944-9b47-3e1eada92cc4 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:12.861128 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998abad-af3e-4dac-9b99-aea4e74e93ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=c92fefdfa2744583a03f82ab0b759617, user_id=32acb197fda74f409dd333518b2f8972, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:12.864779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998abad-af3e-4dac-9b99-aea4e74e93ad admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:12.868886 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1072/2175] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:12.870065 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e95b70-8da5-4944-9b47-3e1eada92cc4 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:12.884546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e95b70-8da5-4944-9b47-3e1eada92cc4 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:12.887733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1104/2176] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:12 2022] PUT /identity/v3/projects/c92fefdfa2744583a03f82ab0b759617/users/32acb197fda74f409dd333518b2f8972/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:12.899191 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9d114-9297-4d8c-ad0b-e88552c83651 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:12.899477 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9d114-9297-4d8c-ad0b-e88552c83651 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:12.899751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9d114-9297-4d8c-ad0b-e88552c83651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:12.964018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-12f9d114-9297-4d8c-ad0b-e88552c83651 None None] MFA Rules not processed for user `32acb197fda74f409dd333518b2f8972`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:12.965691 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-12f9d114-9297-4d8c-ad0b-e88552c83651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:12.993497 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce506d-3363-4277-a7f1-0b4b421cf119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:12.994243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce506d-3363-4277-a7f1-0b4b421cf119 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:12.994534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce506d-3363-4277-a7f1-0b4b421cf119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:12.994809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce506d-3363-4277-a7f1-0b4b421cf119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:12.995797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce506d-3363-4277-a7f1-0b4b421cf119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:12.997532 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce506d-3363-4277-a7f1-0b4b421cf119 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:13.024688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1073/2177] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:13.024895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce506d-3363-4277-a7f1-0b4b421cf119 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:13.027099 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-08ce506d-3363-4277-a7f1-0b4b421cf119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:13.045172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce506d-3363-4277-a7f1-0b4b421cf119 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:13.054518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956db732-697d-42a2-8bfc-09d2aa44ac46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:13.055208 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956db732-697d-42a2-8bfc-09d2aa44ac46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:13.056616 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956db732-697d-42a2-8bfc-09d2aa44ac46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:13.056896 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956db732-697d-42a2-8bfc-09d2aa44ac46 admin admin] PATH_INFO: `/v3/projects/49cd60ecd73e449a92ef54a6810a42ef` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:13.060393 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956db732-697d-42a2-8bfc-09d2aa44ac46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49cd60ecd73e449a92ef54a6810a42ef)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:13.066386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956db732-697d-42a2-8bfc-09d2aa44ac46 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:13.126865 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-956db732-697d-42a2-8bfc-09d2aa44ac46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49cd60ecd73e449a92ef54a6810a42ef', 'request_id': 'req-956db732-697d-42a2-8bfc-09d2aa44ac46'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:13.129905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:13.136036 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-956db732-697d-42a2-8bfc-09d2aa44ac46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49cd60ecd73e449a92ef54a6810a42ef', 'request_id': 'req-956db732-697d-42a2-8bfc-09d2aa44ac46'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:13.160619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-956db732-697d-42a2-8bfc-09d2aa44ac46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49cd60ecd73e449a92ef54a6810a42ef', 'request_id': 'req-956db732-697d-42a2-8bfc-09d2aa44ac46'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:13.167530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1105/2178] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:13.167530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9d114-9297-4d8c-ad0b-e88552c83651 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:13.188865 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-956db732-697d-42a2-8bfc-09d2aa44ac46 admin admin] The token cache is being invalidate because project 49cd60ecd73e449a92ef54a6810a42ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:13.189252 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-956db732-697d-42a2-8bfc-09d2aa44ac46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:13.192991 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-956db732-697d-42a2-8bfc-09d2aa44ac46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:13.195338 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1074/2179] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:13 2022] DELETE /identity/v3/projects/49cd60ecd73e449a92ef54a6810a42ef => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:13.196788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9d114-9297-4d8c-ad0b-e88552c83651 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:13.200761 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956db732-697d-42a2-8bfc-09d2aa44ac46 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:13.204096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-956db732-697d-42a2-8bfc-09d2aa44ac46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:13.337803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956db732-697d-42a2-8bfc-09d2aa44ac46 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:13.345896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212d8e7-c600-4d6b-ac7b-444643810d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:13.346616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212d8e7-c600-4d6b-ac7b-444643810d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:13.347017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212d8e7-c600-4d6b-ac7b-444643810d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:13.347732 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212d8e7-c600-4d6b-ac7b-444643810d47 admin admin] PATH_INFO: `/v3/projects/b58034752b644f31bf44faedf31e73b6/users/11b6deee3d1a4b4d8c74e528530b9d98/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:13.349106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dc206-9798-41e5-a5fa-3c592e8108ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:13.349744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dc206-9798-41e5-a5fa-3c592e8108ab service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:13.351236 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dc206-9798-41e5-a5fa-3c592e8108ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:13.351527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dc206-9798-41e5-a5fa-3c592e8108ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:13.355011 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ef2dc206-9798-41e5-a5fa-3c592e8108ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:13.383312 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212d8e7-c600-4d6b-ac7b-444643810d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58034752b644f31bf44faedf31e73b6, user_id=11b6deee3d1a4b4d8c74e528530b9d98, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:13.386197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212d8e7-c600-4d6b-ac7b-444643810d47 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:13.429727 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1106/2180] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:13 2022] PUT /identity/v3/projects/b58034752b644f31bf44faedf31e73b6/users/11b6deee3d1a4b4d8c74e528530b9d98/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:13.429727 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212d8e7-c600-4d6b-ac7b-444643810d47 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:13.429727 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0212d8e7-c600-4d6b-ac7b-444643810d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:13.446785 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dc206-9798-41e5-a5fa-3c592e8108ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:13.449073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dc206-9798-41e5-a5fa-3c592e8108ab service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:13.463037 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1075/2181] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:13.464135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dc206-9798-41e5-a5fa-3c592e8108ab service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:13.467072 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ef2dc206-9798-41e5-a5fa-3c592e8108ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:13.485935 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dc206-9798-41e5-a5fa-3c592e8108ab service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:13.509721 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:13.606671 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212d8e7-c600-4d6b-ac7b-444643810d47 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:13.612201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa70ce-b413-4705-927d-37c94db8b8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:13.620359 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6e56c-623b-4d65-abf9-68eec8a1b700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:13.621068 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6e56c-623b-4d65-abf9-68eec8a1b700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:13.621348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6e56c-623b-4d65-abf9-68eec8a1b700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:13.621623 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6e56c-623b-4d65-abf9-68eec8a1b700 admin admin] PATH_INFO: `/v3/users/74a81b95ab434656b4fbaa8b8384a82e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:13.622922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6e56c-623b-4d65-abf9-68eec8a1b700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a81b95ab434656b4fbaa8b8384a82e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:13.625498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6e56c-623b-4d65-abf9-68eec8a1b700 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:13.627444 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa70ce-b413-4705-927d-37c94db8b8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:13.627843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa70ce-b413-4705-927d-37c94db8b8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:13.628408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa70ce-b413-4705-927d-37c94db8b8bc admin admin] PATH_INFO: `/v3/projects/7c88efd38c3e4edf96dd99854f39fc38` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:13.631540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa70ce-b413-4705-927d-37c94db8b8bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c88efd38c3e4edf96dd99854f39fc38)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:13.636671 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa70ce-b413-4705-927d-37c94db8b8bc admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:13.717376 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81c6e56c-623b-4d65-abf9-68eec8a1b700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a81b95ab434656b4fbaa8b8384a82e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:13.718421 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81c6e56c-623b-4d65-abf9-68eec8a1b700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a81b95ab434656b4fbaa8b8384a82e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:13.726804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81c6e56c-623b-4d65-abf9-68eec8a1b700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a81b95ab434656b4fbaa8b8384a82e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:13.740769 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:13.743431 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81c6e56c-623b-4d65-abf9-68eec8a1b700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a81b95ab434656b4fbaa8b8384a82e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:13.756005 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-47fa70ce-b413-4705-927d-37c94db8b8bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c88efd38c3e4edf96dd99854f39fc38', 'request_id': 'req-47fa70ce-b413-4705-927d-37c94db8b8bc'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:13.759779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-81c6e56c-623b-4d65-abf9-68eec8a1b700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a81b95ab434656b4fbaa8b8384a82e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:13.766738 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1107/2182] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:13 2022] DELETE /identity/v3/users/74a81b95ab434656b4fbaa8b8384a82e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:13.768130 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51a8ac-1794-4bef-9ebe-7c80be05dfe9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:13.768702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51a8ac-1794-4bef-9ebe-7c80be05dfe9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:13.769047 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51a8ac-1794-4bef-9ebe-7c80be05dfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:13.769211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-47fa70ce-b413-4705-927d-37c94db8b8bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c88efd38c3e4edf96dd99854f39fc38', 'request_id': 'req-47fa70ce-b413-4705-927d-37c94db8b8bc'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:13.777083 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-47fa70ce-b413-4705-927d-37c94db8b8bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c88efd38c3e4edf96dd99854f39fc38', 'request_id': 'req-47fa70ce-b413-4705-927d-37c94db8b8bc'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:13.807204 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-47fa70ce-b413-4705-927d-37c94db8b8bc admin admin] The token cache is being invalidate because project 7c88efd38c3e4edf96dd99854f39fc38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:13.807807 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-47fa70ce-b413-4705-927d-37c94db8b8bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:13.810716 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-47fa70ce-b413-4705-927d-37c94db8b8bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:13.813504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1076/2183] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:13 2022] DELETE /identity/v3/projects/7c88efd38c3e4edf96dd99854f39fc38 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:13.815351 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa70ce-b413-4705-927d-37c94db8b8bc admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:13.819548 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8a51a8ac-1794-4bef-9ebe-7c80be05dfe9 None None] MFA Rules not processed for user `11b6deee3d1a4b4d8c74e528530b9d98`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:13.820576 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-47fa70ce-b413-4705-927d-37c94db8b8bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:13.821015 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8a51a8ac-1794-4bef-9ebe-7c80be05dfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:13.953472 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa70ce-b413-4705-927d-37c94db8b8bc admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:13.976073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1108/2184] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:13.977777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd61084-dc78-43e2-881c-5c6ec7711858 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:13.978257 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd61084-dc78-43e2-881c-5c6ec7711858 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:13.978787 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd61084-dc78-43e2-881c-5c6ec7711858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:14.021531 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0cd61084-dc78-43e2-881c-5c6ec7711858 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:14.031920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0cd61084-dc78-43e2-881c-5c6ec7711858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:14.066440 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ad28d-1672-4505-b01e-2a836472c6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:14.067386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ad28d-1672-4505-b01e-2a836472c6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:14.067815 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ad28d-1672-4505-b01e-2a836472c6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:14.068570 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ad28d-1672-4505-b01e-2a836472c6a2 admin admin] PATH_INFO: `/v3/users/32acb197fda74f409dd333518b2f8972` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:14.070108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ad28d-1672-4505-b01e-2a836472c6a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32acb197fda74f409dd333518b2f8972)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:14.072659 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ad28d-1672-4505-b01e-2a836472c6a2 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:14.109037 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:14.165317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1109/2185] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:14.167278 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd61084-dc78-43e2-881c-5c6ec7711858 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:14.172030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0cd61084-dc78-43e2-881c-5c6ec7711858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:14.208230 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-184ad28d-1672-4505-b01e-2a836472c6a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32acb197fda74f409dd333518b2f8972'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:14.210202 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-184ad28d-1672-4505-b01e-2a836472c6a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32acb197fda74f409dd333518b2f8972'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:14.211551 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd61084-dc78-43e2-881c-5c6ec7711858 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:14.225474 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94f5f2-693a-485e-96a9-6d1ef6d15ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:14.226109 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94f5f2-693a-485e-96a9-6d1ef6d15ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:14.226390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94f5f2-693a-485e-96a9-6d1ef6d15ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:14.226663 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94f5f2-693a-485e-96a9-6d1ef6d15ae1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:14.227342 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94f5f2-693a-485e-96a9-6d1ef6d15ae1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:14.233710 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94f5f2-693a-485e-96a9-6d1ef6d15ae1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:14.233925 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-184ad28d-1672-4505-b01e-2a836472c6a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32acb197fda74f409dd333518b2f8972'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:14.255472 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-184ad28d-1672-4505-b01e-2a836472c6a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32acb197fda74f409dd333518b2f8972'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:14.256408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-184ad28d-1672-4505-b01e-2a836472c6a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32acb197fda74f409dd333518b2f8972'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:14.264963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:14.314728 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1077/2186] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:13 2022] DELETE /identity/v3/users/32acb197fda74f409dd333518b2f8972 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:14.317388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9728f4d-5956-482d-a870-960608fe5532 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:14.317701 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9728f4d-5956-482d-a870-960608fe5532 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:14.318005 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9728f4d-5956-482d-a870-960608fe5532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:14.339195 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1110/2187] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:14 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:14.340167 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94f5f2-693a-485e-96a9-6d1ef6d15ae1 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:14.343554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8a94f5f2-693a-485e-96a9-6d1ef6d15ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:14.343655 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-c9728f4d-5956-482d-a870-960608fe5532 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:14.344846 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-c9728f4d-5956-482d-a870-960608fe5532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:14.430273 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1078/2188] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:14.431848 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf783fc3-c845-4a94-ab29-e26a58694669 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:14.432197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf783fc3-c845-4a94-ab29-e26a58694669 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:14.432422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf783fc3-c845-4a94-ab29-e26a58694669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:14.458669 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-bf783fc3-c845-4a94-ab29-e26a58694669 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:14.460024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-bf783fc3-c845-4a94-ab29-e26a58694669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:14.474886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94f5f2-693a-485e-96a9-6d1ef6d15ae1 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:14.475726 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1079/2189] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:14.476624 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf783fc3-c845-4a94-ab29-e26a58694669 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:14.478371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-bf783fc3-c845-4a94-ab29-e26a58694669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:14.494282 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf783fc3-c845-4a94-ab29-e26a58694669 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:14.502124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f729d7-8ec0-43b3-b404-a927d31d4014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:14.502793 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f729d7-8ec0-43b3-b404-a927d31d4014 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:14.503314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f729d7-8ec0-43b3-b404-a927d31d4014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:14.504038 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f729d7-8ec0-43b3-b404-a927d31d4014 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:14.504770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f729d7-8ec0-43b3-b404-a927d31d4014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:14.505050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3584be-cabc-4d97-ac6c-9a5c0f5ef227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:14.505911 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3584be-cabc-4d97-ac6c-9a5c0f5ef227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:14.506389 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3584be-cabc-4d97-ac6c-9a5c0f5ef227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:14.506912 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f729d7-8ec0-43b3-b404-a927d31d4014 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:14.507081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3584be-cabc-4d97-ac6c-9a5c0f5ef227 admin admin] PATH_INFO: `/v3/projects/c79291eabab24f9faf49d57db7c83d16` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:14.508709 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3584be-cabc-4d97-ac6c-9a5c0f5ef227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c79291eabab24f9faf49d57db7c83d16)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:14.510299 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3584be-cabc-4d97-ac6c-9a5c0f5ef227 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:14.537916 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1080/2190] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:14 2022] POST /identity/v3/users => generated 300 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:14.539031 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f729d7-8ec0-43b3-b404-a927d31d4014 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:14.557037 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f729d7-8ec0-43b3-b404-a927d31d4014 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:14.562950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066bedc0-79eb-4a83-82a9-770ad08958ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:14.564067 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bedc0-79eb-4a83-82a9-770ad08958ef admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:14.564640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bedc0-79eb-4a83-82a9-770ad08958ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:14.564993 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bedc0-79eb-4a83-82a9-770ad08958ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:14.566373 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066bedc0-79eb-4a83-82a9-770ad08958ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:12:14.566867 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066bedc0-79eb-4a83-82a9-770ad08958ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:14.568835 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066bedc0-79eb-4a83-82a9-770ad08958ef admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:14.580575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4e3584be-cabc-4d97-ac6c-9a5c0f5ef227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c79291eabab24f9faf49d57db7c83d16', 'request_id': 'req-4e3584be-cabc-4d97-ac6c-9a5c0f5ef227'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:14.585423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1081/2191] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:12:14.586495 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066bedc0-79eb-4a83-82a9-770ad08958ef admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:14.588874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-066bedc0-79eb-4a83-82a9-770ad08958ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:14.590486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4e3584be-cabc-4d97-ac6c-9a5c0f5ef227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c79291eabab24f9faf49d57db7c83d16', 'request_id': 'req-4e3584be-cabc-4d97-ac6c-9a5c0f5ef227'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:14.599324 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4e3584be-cabc-4d97-ac6c-9a5c0f5ef227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c79291eabab24f9faf49d57db7c83d16', 'request_id': 'req-4e3584be-cabc-4d97-ac6c-9a5c0f5ef227'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:14.631488 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4e3584be-cabc-4d97-ac6c-9a5c0f5ef227 admin admin] The token cache is being invalidate because project c79291eabab24f9faf49d57db7c83d16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:14.632847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4e3584be-cabc-4d97-ac6c-9a5c0f5ef227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:14.633802 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4e3584be-cabc-4d97-ac6c-9a5c0f5ef227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:14.640593 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1111/2192] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:14 2022] DELETE /identity/v3/projects/c79291eabab24f9faf49d57db7c83d16 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:14.641926 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3584be-cabc-4d97-ac6c-9a5c0f5ef227 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:14.646612 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4e3584be-cabc-4d97-ac6c-9a5c0f5ef227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:14.693896 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066bedc0-79eb-4a83-82a9-770ad08958ef admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:14.739861 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:14.765945 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3584be-cabc-4d97-ac6c-9a5c0f5ef227 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:14.779542 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f1873-7815-42bd-8f1f-db2458d28870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:14.781034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f1873-7815-42bd-8f1f-db2458d28870 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:14.781431 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f1873-7815-42bd-8f1f-db2458d28870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:14.782050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f1873-7815-42bd-8f1f-db2458d28870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:14.782993 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f1873-7815-42bd-8f1f-db2458d28870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:14.787913 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f1873-7815-42bd-8f1f-db2458d28870 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:14.795649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c289a3-c6b1-45ec-846e-8860bf2af3e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:14.796883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c289a3-c6b1-45ec-846e-8860bf2af3e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:14.797442 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c289a3-c6b1-45ec-846e-8860bf2af3e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:14.798561 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c289a3-c6b1-45ec-846e-8860bf2af3e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:14.804507 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-45c289a3-c6b1-45ec-846e-8860bf2af3e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:14.805268 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1112/2193] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:14.806241 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f1873-7815-42bd-8f1f-db2458d28870 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:14.810297 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6f6f1873-7815-42bd-8f1f-db2458d28870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:14.825553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f1873-7815-42bd-8f1f-db2458d28870 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:14.827942 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c289a3-c6b1-45ec-846e-8860bf2af3e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:14.831155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c289a3-c6b1-45ec-846e-8860bf2af3e0 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:14.831905 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11579dae-4e74-4c19-8acb-01d3969ad45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:14.832757 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11579dae-4e74-4c19-8acb-01d3969ad45c admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:14.833135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11579dae-4e74-4c19-8acb-01d3969ad45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:14.833696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11579dae-4e74-4c19-8acb-01d3969ad45c admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:14.834676 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11579dae-4e74-4c19-8acb-01d3969ad45c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:14.837185 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11579dae-4e74-4c19-8acb-01d3969ad45c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:14.854112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1082/2194] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:14.859707 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c49438-077c-4a97-89df-147f90ff39cb None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:14.860478 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c49438-077c-4a97-89df-147f90ff39cb None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:14.860663 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c49438-077c-4a97-89df-147f90ff39cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:14.887484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1113/2195] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:14 2022] POST /identity/v3/projects => generated 399 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:14.887484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11579dae-4e74-4c19-8acb-01d3969ad45c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:14.900116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-12c49438-077c-4a97-89df-147f90ff39cb None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:14.901891 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-12c49438-077c-4a97-89df-147f90ff39cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:14.916741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:14.991273 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11579dae-4e74-4c19-8acb-01d3969ad45c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:15.012065 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e2e85-8d3f-47f7-ba89-a3de88e13c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:15.012809 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e2e85-8d3f-47f7-ba89-a3de88e13c5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:15.014612 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e2e85-8d3f-47f7-ba89-a3de88e13c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:15.014907 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e2e85-8d3f-47f7-ba89-a3de88e13c5d admin admin] PATH_INFO: `/v3/projects/6ea328d8930d49b98af441087512eab2/users/7b654864b39d4fa98b85f6e279d016bf/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:15.027915 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1083/2196] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:15.028906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c49438-077c-4a97-89df-147f90ff39cb None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:15.045021 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c49438-077c-4a97-89df-147f90ff39cb None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:15.054375 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04804172-6b0d-4c15-9c5f-4e5a163b746f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:15.057520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04804172-6b0d-4c15-9c5f-4e5a163b746f admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:15.057861 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04804172-6b0d-4c15-9c5f-4e5a163b746f admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:15.058065 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e2e85-8d3f-47f7-ba89-a3de88e13c5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea328d8930d49b98af441087512eab2, user_id=7b654864b39d4fa98b85f6e279d016bf, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:15.058222 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04804172-6b0d-4c15-9c5f-4e5a163b746f admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:15.058846 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04804172-6b0d-4c15-9c5f-4e5a163b746f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:15.061413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e2e85-8d3f-47f7-ba89-a3de88e13c5d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:15.061691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04804172-6b0d-4c15-9c5f-4e5a163b746f admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:15.087859 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1114/2197] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:14 2022] PUT /identity/v3/projects/6ea328d8930d49b98af441087512eab2/users/7b654864b39d4fa98b85f6e279d016bf/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:15.089460 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cf656-7f0f-4695-9ae2-c740d21b929b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:15.089806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cf656-7f0f-4695-9ae2-c740d21b929b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:15.090125 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cf656-7f0f-4695-9ae2-c740d21b929b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:15.101030 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1084/2198] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:15 2022] POST /identity/v3/users => generated 300 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:15.103598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04804172-6b0d-4c15-9c5f-4e5a163b746f admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:15.126309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04804172-6b0d-4c15-9c5f-4e5a163b746f admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:15.130987 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ce2cf656-7f0f-4695-9ae2-c740d21b929b None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:15.132677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ce2cf656-7f0f-4695-9ae2-c740d21b929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:15.241223 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821212f7-27dc-43a3-9327-555fcfeb90b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:15.242331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821212f7-27dc-43a3-9327-555fcfeb90b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:15.242843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821212f7-27dc-43a3-9327-555fcfeb90b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:15.243383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821212f7-27dc-43a3-9327-555fcfeb90b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:15.244381 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821212f7-27dc-43a3-9327-555fcfeb90b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:15.246974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821212f7-27dc-43a3-9327-555fcfeb90b2 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:15.251874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1115/2199] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:15.252794 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cf656-7f0f-4695-9ae2-c740d21b929b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:15.263570 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1085/2200] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:15.265460 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2cf656-7f0f-4695-9ae2-c740d21b929b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:15.270968 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc56ace-efcb-43c7-84dc-56a0b6652024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:15.271604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc56ace-efcb-43c7-84dc-56a0b6652024 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:15.272069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc56ace-efcb-43c7-84dc-56a0b6652024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:15.272486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc56ace-efcb-43c7-84dc-56a0b6652024 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:15.273236 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc56ace-efcb-43c7-84dc-56a0b6652024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:15.275145 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc56ace-efcb-43c7-84dc-56a0b6652024 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:15.279546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821212f7-27dc-43a3-9327-555fcfeb90b2 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:15.311287 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1116/2201] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:15.311809 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821212f7-27dc-43a3-9327-555fcfeb90b2 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:15.311946 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc56ace-efcb-43c7-84dc-56a0b6652024 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:15.324752 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b0601-d8d9-4e2a-a7d9-a1f69fb24534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:15.325140 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc56ace-efcb-43c7-84dc-56a0b6652024 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:15.325338 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b0601-d8d9-4e2a-a7d9-a1f69fb24534 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:15.325643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b0601-d8d9-4e2a-a7d9-a1f69fb24534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:15.325923 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b0601-d8d9-4e2a-a7d9-a1f69fb24534 admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:15.326726 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b0601-d8d9-4e2a-a7d9-a1f69fb24534 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:12:15.327041 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b0601-d8d9-4e2a-a7d9-a1f69fb24534 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:15.332867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a7a6f-33be-40ce-b7ba-28a0a655e629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:15.333444 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b0601-d8d9-4e2a-a7d9-a1f69fb24534 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:15.333756 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a7a6f-33be-40ce-b7ba-28a0a655e629 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:15.334153 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a7a6f-33be-40ce-b7ba-28a0a655e629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:15.334666 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a7a6f-33be-40ce-b7ba-28a0a655e629 admin admin] PATH_INFO: `/v3/projects/6ea328d8930d49b98af441087512eab2/users/7b654864b39d4fa98b85f6e279d016bf/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:15.339417 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a7a6f-33be-40ce-b7ba-28a0a655e629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea328d8930d49b98af441087512eab2, user_id=7b654864b39d4fa98b85f6e279d016bf, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:15.343464 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a7a6f-33be-40ce-b7ba-28a0a655e629 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:15.367735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1086/2202] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:12:15.368688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b0601-d8d9-4e2a-a7d9-a1f69fb24534 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:15.391436 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1117/2203] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:15 2022] PUT /identity/v3/projects/6ea328d8930d49b98af441087512eab2/users/7b654864b39d4fa98b85f6e279d016bf/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:15.391436 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a7a6f-33be-40ce-b7ba-28a0a655e629 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:15.398585 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b0601-d8d9-4e2a-a7d9-a1f69fb24534 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:15.479787 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:15.588137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c1158-8ab4-454a-922d-7e9b41159fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:15.592558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c1158-8ab4-454a-922d-7e9b41159fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:15.599243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c1158-8ab4-454a-922d-7e9b41159fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:15.599601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c1158-8ab4-454a-922d-7e9b41159fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:15.600373 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c1158-8ab4-454a-922d-7e9b41159fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:15.607746 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c1158-8ab4-454a-922d-7e9b41159fc6 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:15.614713 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a7a6f-33be-40ce-b7ba-28a0a655e629 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:15.625721 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8184d6f-3ad4-443b-acd5-da6ffebc6a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:15.629379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8184d6f-3ad4-443b-acd5-da6ffebc6a25 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:15.636639 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1087/2204] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:15.637284 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8184d6f-3ad4-443b-acd5-da6ffebc6a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:15.637284 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8184d6f-3ad4-443b-acd5-da6ffebc6a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:15.637284 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8184d6f-3ad4-443b-acd5-da6ffebc6a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:15.637284 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8184d6f-3ad4-443b-acd5-da6ffebc6a25 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:15.639344 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f76909-32ca-469c-8bb6-5b5b2af95045 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:15.641890 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f76909-32ca-469c-8bb6-5b5b2af95045 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:15.642377 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f76909-32ca-469c-8bb6-5b5b2af95045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:15.698117 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-55f76909-32ca-469c-8bb6-5b5b2af95045 None None] MFA Rules not processed for user `7b654864b39d4fa98b85f6e279d016bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:15.698679 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1118/2205] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:15 2022] POST /identity/v3/projects => generated 369 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:15.700151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8184d6f-3ad4-443b-acd5-da6ffebc6a25 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:15.702538 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f8184d6f-3ad4-443b-acd5-da6ffebc6a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:15.704351 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-55f76909-32ca-469c-8bb6-5b5b2af95045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:15.715963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:15.847901 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1088/2206] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:15.849008 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f76909-32ca-469c-8bb6-5b5b2af95045 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:15.873343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f76909-32ca-469c-8bb6-5b5b2af95045 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:15.874084 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8184d6f-3ad4-443b-acd5-da6ffebc6a25 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:15.881077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd8ee2-7717-4049-86aa-44906324c0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:15.881905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd8ee2-7717-4049-86aa-44906324c0ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:15.883383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd8ee2-7717-4049-86aa-44906324c0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:15.883383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd8ee2-7717-4049-86aa-44906324c0ac admin admin] PATH_INFO: `/v3/projects/d30efc7ff7c44f6e9ec16f07a6120a3d/users/c80a7e2ae6574c6e8a4b1fc8a106b66b/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:15.885662 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd8e32-1e02-4fe4-8328-cae101076773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:15.889634 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd8e32-1e02-4fe4-8328-cae101076773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:15.891321 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd8e32-1e02-4fe4-8328-cae101076773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:15.892551 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd8e32-1e02-4fe4-8328-cae101076773 admin admin] PATH_INFO: `/v3/projects/c92fefdfa2744583a03f82ab0b759617` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:15.897101 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd8e32-1e02-4fe4-8328-cae101076773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c92fefdfa2744583a03f82ab0b759617)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:15.903095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd8e32-1e02-4fe4-8328-cae101076773 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:15.906050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd8ee2-7717-4049-86aa-44906324c0ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30efc7ff7c44f6e9ec16f07a6120a3d, user_id=c80a7e2ae6574c6e8a4b1fc8a106b66b, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:15.909784 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd8ee2-7717-4049-86aa-44906324c0ac admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:15.929056 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1089/2207] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:15 2022] PUT /identity/v3/projects/d30efc7ff7c44f6e9ec16f07a6120a3d/users/c80a7e2ae6574c6e8a4b1fc8a106b66b/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:15.930251 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd8ee2-7717-4049-86aa-44906324c0ac admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:16.013223 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd8ee2-7717-4049-86aa-44906324c0ac admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:16.023195 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e3dd8e32-1e02-4fe4-8328-cae101076773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c92fefdfa2744583a03f82ab0b759617', 'request_id': 'req-e3dd8e32-1e02-4fe4-8328-cae101076773'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:16.032733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e3dd8e32-1e02-4fe4-8328-cae101076773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c92fefdfa2744583a03f82ab0b759617', 'request_id': 'req-e3dd8e32-1e02-4fe4-8328-cae101076773'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:16.041395 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e3dd8e32-1e02-4fe4-8328-cae101076773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c92fefdfa2744583a03f82ab0b759617', 'request_id': 'req-e3dd8e32-1e02-4fe4-8328-cae101076773'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:16.062527 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e3dd8e32-1e02-4fe4-8328-cae101076773 admin admin] The token cache is being invalidate because project c92fefdfa2744583a03f82ab0b759617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:16.063189 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e3dd8e32-1e02-4fe4-8328-cae101076773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:16.064504 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e3dd8e32-1e02-4fe4-8328-cae101076773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:16.070731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1119/2208] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:15 2022] DELETE /identity/v3/projects/c92fefdfa2744583a03f82ab0b759617 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:16.075329 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd8e32-1e02-4fe4-8328-cae101076773 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:16.077217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e3dd8e32-1e02-4fe4-8328-cae101076773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:16.089920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96484b3-1b30-4a2d-80e9-82f1b59bfd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:16.090560 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96484b3-1b30-4a2d-80e9-82f1b59bfd25 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:16.090846 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96484b3-1b30-4a2d-80e9-82f1b59bfd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:16.091123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96484b3-1b30-4a2d-80e9-82f1b59bfd25 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:16.091801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96484b3-1b30-4a2d-80e9-82f1b59bfd25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:16.094335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96484b3-1b30-4a2d-80e9-82f1b59bfd25 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:16.127040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1090/2209] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:15 2022] POST /identity/v3/users => generated 285 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:16.129211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c27739-3c26-4475-b2a7-3b37cece690f None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:16.129661 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c27739-3c26-4475-b2a7-3b37cece690f None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:16.130075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c27739-3c26-4475-b2a7-3b37cece690f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:16.147255 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:16.172406 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd8e32-1e02-4fe4-8328-cae101076773 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:16.179080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6b673-dbe4-4ae5-8d9f-3856dd0f8f48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:16.180063 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6b673-dbe4-4ae5-8d9f-3856dd0f8f48 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:16.180919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6b673-dbe4-4ae5-8d9f-3856dd0f8f48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:16.181411 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6b673-dbe4-4ae5-8d9f-3856dd0f8f48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:16.181899 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:16.183875 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-35d6b673-dbe4-4ae5-8d9f-3856dd0f8f48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:16.194803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-b9c27739-3c26-4475-b2a7-3b37cece690f None None] MFA Rules not processed for user `c80a7e2ae6574c6e8a4b1fc8a106b66b`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:16.196208 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b9c27739-3c26-4475-b2a7-3b37cece690f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:16.310435 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6b673-dbe4-4ae5-8d9f-3856dd0f8f48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:16.312242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6b673-dbe4-4ae5-8d9f-3856dd0f8f48 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:16.314705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1091/2210] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:16 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:16.318481 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2260e-7d32-4d8d-aa74-ce7de7b82f14 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:16.319124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2260e-7d32-4d8d-aa74-ce7de7b82f14 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:16.319883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2260e-7d32-4d8d-aa74-ce7de7b82f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:16.349384 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1120/2211] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:16.350118 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6b673-dbe4-4ae5-8d9f-3856dd0f8f48 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:16.354800 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-35d6b673-dbe4-4ae5-8d9f-3856dd0f8f48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:16.361887 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-e0f2260e-7d32-4d8d-aa74-ce7de7b82f14 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:16.364855 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e0f2260e-7d32-4d8d-aa74-ce7de7b82f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:16.376966 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6b673-dbe4-4ae5-8d9f-3856dd0f8f48 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:16.384911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1092/2212] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:16.397063 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4071c7-5ced-4360-962f-1a2f841118a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:16.397713 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4071c7-5ced-4360-962f-1a2f841118a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:16.397998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4071c7-5ced-4360-962f-1a2f841118a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:16.398280 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4071c7-5ced-4360-962f-1a2f841118a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:16.399270 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaec8a3-73df-43fe-8373-ae0a1396538f None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:16.399557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaec8a3-73df-43fe-8373-ae0a1396538f None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:16.399835 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaec8a3-73df-43fe-8373-ae0a1396538f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:16.401255 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4071c7-5ced-4360-962f-1a2f841118a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:16.405412 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4071c7-5ced-4360-962f-1a2f841118a2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:16.420025 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1121/2213] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:16.421697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4071c7-5ced-4360-962f-1a2f841118a2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:16.433249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4071c7-5ced-4360-962f-1a2f841118a2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:16.437923 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e844d8f-899a-4906-8df7-0513a438ddc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:16.438986 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e844d8f-899a-4906-8df7-0513a438ddc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:16.438986 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e844d8f-899a-4906-8df7-0513a438ddc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:16.439181 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e844d8f-899a-4906-8df7-0513a438ddc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:16.442798 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-daaec8a3-73df-43fe-8373-ae0a1396538f None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:16.444454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-daaec8a3-73df-43fe-8373-ae0a1396538f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:16.450939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e844d8f-899a-4906-8df7-0513a438ddc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:16.452844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e844d8f-899a-4906-8df7-0513a438ddc7 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:16.456255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1093/2214] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:16.457658 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaec8a3-73df-43fe-8373-ae0a1396538f None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:16.469832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaec8a3-73df-43fe-8373-ae0a1396538f None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:16.475810 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed854d1-3981-42bc-a52a-f75e7117d4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:16.488785 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed854d1-3981-42bc-a52a-f75e7117d4ad admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:16.488785 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed854d1-3981-42bc-a52a-f75e7117d4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:16.488785 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed854d1-3981-42bc-a52a-f75e7117d4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:16.488785 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed854d1-3981-42bc-a52a-f75e7117d4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:16.488785 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed854d1-3981-42bc-a52a-f75e7117d4ad admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:16.489426 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1122/2215] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:16 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:16.495857 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e844d8f-899a-4906-8df7-0513a438ddc7 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:16.496286 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1094/2216] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:16.497437 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed854d1-3981-42bc-a52a-f75e7117d4ad admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:16.513628 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed854d1-3981-42bc-a52a-f75e7117d4ad admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:16.524833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e844d8f-899a-4906-8df7-0513a438ddc7 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:16.527807 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdccdd-c5ca-47c4-924c-86756a8022e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:16.528967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdccdd-c5ca-47c4-924c-86756a8022e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:16.529230 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdccdd-c5ca-47c4-924c-86756a8022e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:16.529513 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdccdd-c5ca-47c4-924c-86756a8022e3 admin admin] PATH_INFO: `/v3/projects/8e788321ea1a4a5ea54b560bf88c1d4a/users/e6c30c9f2a894eb290e072aeba399bd0/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:16.535079 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e43078-0c56-477b-a146-6c4062e8eeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:16.536319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e43078-0c56-477b-a146-6c4062e8eeae admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:16.536948 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e43078-0c56-477b-a146-6c4062e8eeae admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:16.537403 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e43078-0c56-477b-a146-6c4062e8eeae admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:16.538295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e43078-0c56-477b-a146-6c4062e8eeae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:12:16.539583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e43078-0c56-477b-a146-6c4062e8eeae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:16.542954 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e43078-0c56-477b-a146-6c4062e8eeae admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:16.567388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdccdd-c5ca-47c4-924c-86756a8022e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e788321ea1a4a5ea54b560bf88c1d4a, user_id=e6c30c9f2a894eb290e072aeba399bd0, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:16.572056 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdccdd-c5ca-47c4-924c-86756a8022e3 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:16.589537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1123/2217] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:12:16.591830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e43078-0c56-477b-a146-6c4062e8eeae admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:16.594062 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-06e43078-0c56-477b-a146-6c4062e8eeae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:16.604421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1095/2218] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:16 2022] PUT /identity/v3/projects/8e788321ea1a4a5ea54b560bf88c1d4a/users/e6c30c9f2a894eb290e072aeba399bd0/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:16.606151 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdccdd-c5ca-47c4-924c-86756a8022e3 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:16.622325 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e43078-0c56-477b-a146-6c4062e8eeae admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:16.730618 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdccdd-c5ca-47c4-924c-86756a8022e3 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:16.738656 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2cfbf-f94f-4354-872b-26e646188f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:16.738819 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2cfbf-f94f-4354-872b-26e646188f55 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:16.739088 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2cfbf-f94f-4354-872b-26e646188f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:16.739376 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2cfbf-f94f-4354-872b-26e646188f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:16.740725 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2cfbf-f94f-4354-872b-26e646188f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:16.743088 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2cfbf-f94f-4354-872b-26e646188f55 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:16.743294 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f875d-e9be-409f-868a-856456a6078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:16.743899 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f875d-e9be-409f-868a-856456a6078b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:16.744063 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f875d-e9be-409f-868a-856456a6078b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:16.744642 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f875d-e9be-409f-868a-856456a6078b admin admin] PATH_INFO: `/v3/users/4a52bffd247140b6892388500d398044` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:16.746459 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f875d-e9be-409f-868a-856456a6078b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a52bffd247140b6892388500d398044)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:16.748898 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f875d-e9be-409f-868a-856456a6078b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:16.789245 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1096/2219] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:16 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:16.793004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8f57a-1358-4e61-a809-1b744ad69b3f None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:16.793405 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8f57a-1358-4e61-a809-1b744ad69b3f None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:16.793750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8f57a-1358-4e61-a809-1b744ad69b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:16.825000 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4e5f875d-e9be-409f-868a-856456a6078b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a52bffd247140b6892388500d398044'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:16.825915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4e5f875d-e9be-409f-868a-856456a6078b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a52bffd247140b6892388500d398044'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:16.832121 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:16.835841 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4e5f875d-e9be-409f-868a-856456a6078b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a52bffd247140b6892388500d398044'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:16.836864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-12c8f57a-1358-4e61-a809-1b744ad69b3f None None] MFA Rules not processed for user `e6c30c9f2a894eb290e072aeba399bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:16.838172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-12c8f57a-1358-4e61-a809-1b744ad69b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:16.861317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4e5f875d-e9be-409f-868a-856456a6078b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a52bffd247140b6892388500d398044'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:16.871754 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4e5f875d-e9be-409f-868a-856456a6078b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a52bffd247140b6892388500d398044'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:16.883875 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1124/2220] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:16 2022] DELETE /identity/v3/users/4a52bffd247140b6892388500d398044 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:16.884736 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f875d-e9be-409f-868a-856456a6078b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:16.888038 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:16.888344 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4e5f875d-e9be-409f-868a-856456a6078b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:16.969144 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1097/2221] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:16.996293 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8f57a-1358-4e61-a809-1b744ad69b3f None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:16.998235 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-12c8f57a-1358-4e61-a809-1b744ad69b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:17.012661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f875d-e9be-409f-868a-856456a6078b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:17.021876 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27955aa-78f3-4c3a-a046-f3dd32941a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:17.022780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27955aa-78f3-4c3a-a046-f3dd32941a64 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:17.023226 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27955aa-78f3-4c3a-a046-f3dd32941a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:17.023573 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27955aa-78f3-4c3a-a046-f3dd32941a64 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:17.024571 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27955aa-78f3-4c3a-a046-f3dd32941a64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:17.027776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27955aa-78f3-4c3a-a046-f3dd32941a64 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:17.067471 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1125/2222] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:16 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:17.069341 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27955aa-78f3-4c3a-a046-f3dd32941a64 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:17.091663 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27955aa-78f3-4c3a-a046-f3dd32941a64 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:17.099151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b506e47-a031-4b51-828c-7a9afe43d7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:17.100390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b506e47-a031-4b51-828c-7a9afe43d7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:17.101612 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b506e47-a031-4b51-828c-7a9afe43d7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:17.102140 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b506e47-a031-4b51-828c-7a9afe43d7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:17.103459 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b506e47-a031-4b51-828c-7a9afe43d7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:17.105562 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b506e47-a031-4b51-828c-7a9afe43d7b7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:17.124885 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1126/2223] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:17.126396 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b506e47-a031-4b51-828c-7a9afe43d7b7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:17.142004 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b506e47-a031-4b51-828c-7a9afe43d7b7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:17.150091 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc090bd-27eb-480c-bfbf-86bd5b7fa7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:17.151497 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc090bd-27eb-480c-bfbf-86bd5b7fa7ce admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:17.152082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc090bd-27eb-480c-bfbf-86bd5b7fa7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:17.152591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc090bd-27eb-480c-bfbf-86bd5b7fa7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:17.153628 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc090bd-27eb-480c-bfbf-86bd5b7fa7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:17.155906 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc090bd-27eb-480c-bfbf-86bd5b7fa7ce admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:17.170910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8f57a-1358-4e61-a809-1b744ad69b3f None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:17.176612 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1127/2224] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:17.179568 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc090bd-27eb-480c-bfbf-86bd5b7fa7ce admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:17.199807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc090bd-27eb-480c-bfbf-86bd5b7fa7ce admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:17.205850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e87fa-f96e-4f97-a9d4-d88bea36a367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:17.206999 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e87fa-f96e-4f97-a9d4-d88bea36a367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:17.207320 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e87fa-f96e-4f97-a9d4-d88bea36a367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:17.207614 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e87fa-f96e-4f97-a9d4-d88bea36a367 admin admin] PATH_INFO: `/v3/projects/877d8413923b449799ebcbc13db3327b/users/d1e24b48318e44abbdbe2f7cb03b5b13/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:17.230883 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e87fa-f96e-4f97-a9d4-d88bea36a367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=877d8413923b449799ebcbc13db3327b, user_id=d1e24b48318e44abbdbe2f7cb03b5b13, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:17.234652 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e87fa-f96e-4f97-a9d4-d88bea36a367 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:17.275870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1128/2225] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:17 2022] PUT /identity/v3/projects/877d8413923b449799ebcbc13db3327b/users/d1e24b48318e44abbdbe2f7cb03b5b13/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:17.276983 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e87fa-f96e-4f97-a9d4-d88bea36a367 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:17.291582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b72e87fa-f96e-4f97-a9d4-d88bea36a367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:17.323018 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823956f-e80e-4321-b8a1-4732ef63e54c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0af63c36df2c4ceaa2df4d3ac59542bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:17.323808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823956f-e80e-4321-b8a1-4732ef63e54c service glance] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:17.324137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823956f-e80e-4321-b8a1-4732ef63e54c service glance] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:17.324438 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823956f-e80e-4321-b8a1-4732ef63e54c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:17.403792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823956f-e80e-4321-b8a1-4732ef63e54c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:17.405501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823956f-e80e-4321-b8a1-4732ef63e54c service glance] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:17.417902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1098/2226] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:12:17.419344 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83abf6-b14c-4f66-9f4b-a144bfaf90ab None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:17.420161 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83abf6-b14c-4f66-9f4b-a144bfaf90ab None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:17.420640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83abf6-b14c-4f66-9f4b-a144bfaf90ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:17.454632 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e87fa-f96e-4f97-a9d4-d88bea36a367 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:17.466950 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4203b69-23fd-4f85-9f02-4d701d3a7858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:17.467832 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4203b69-23fd-4f85-9f02-4d701d3a7858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:17.468015 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-4f83abf6-b14c-4f66-9f4b-a144bfaf90ab None None] MFA Rules not processed for user `d1e24b48318e44abbdbe2f7cb03b5b13`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:17.468251 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4203b69-23fd-4f85-9f02-4d701d3a7858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:17.468741 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4203b69-23fd-4f85-9f02-4d701d3a7858 admin admin] PATH_INFO: `/v3/projects/513336570b36443d914c58ed2f363996` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:17.469701 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4f83abf6-b14c-4f66-9f4b-a144bfaf90ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:17.470276 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4203b69-23fd-4f85-9f02-4d701d3a7858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=513336570b36443d914c58ed2f363996)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:17.473218 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4203b69-23fd-4f85-9f02-4d701d3a7858 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:17.494651 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:17.516643 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:17.615398 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1099/2227] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:17.616585 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83abf6-b14c-4f66-9f4b-a144bfaf90ab None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:17.616732 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a4203b69-23fd-4f85-9f02-4d701d3a7858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513336570b36443d914c58ed2f363996', 'request_id': 'req-a4203b69-23fd-4f85-9f02-4d701d3a7858'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:17.638262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83abf6-b14c-4f66-9f4b-a144bfaf90ab None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:17.639770 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a4203b69-23fd-4f85-9f02-4d701d3a7858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513336570b36443d914c58ed2f363996', 'request_id': 'req-a4203b69-23fd-4f85-9f02-4d701d3a7858'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:17.650985 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a4203b69-23fd-4f85-9f02-4d701d3a7858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513336570b36443d914c58ed2f363996', 'request_id': 'req-a4203b69-23fd-4f85-9f02-4d701d3a7858'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:17.680646 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a4203b69-23fd-4f85-9f02-4d701d3a7858 admin admin] The token cache is being invalidate because project 513336570b36443d914c58ed2f363996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:17.681636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a4203b69-23fd-4f85-9f02-4d701d3a7858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:17.682790 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-a4203b69-23fd-4f85-9f02-4d701d3a7858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:17.688616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1129/2228] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:17 2022] DELETE /identity/v3/projects/513336570b36443d914c58ed2f363996 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:17.694867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b39f8-fa79-4531-b990-e49d58a5fa31 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:17.695151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b39f8-fa79-4531-b990-e49d58a5fa31 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:17.695493 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b39f8-fa79-4531-b990-e49d58a5fa31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:17.731727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6db54-3866-4f4a-8c44-36119ce7a927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:17.732303 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6db54-3866-4f4a-8c44-36119ce7a927 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:17.732564 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6db54-3866-4f4a-8c44-36119ce7a927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:17.732912 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6db54-3866-4f4a-8c44-36119ce7a927 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:17.733792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6db54-3866-4f4a-8c44-36119ce7a927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:17.734213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9d1b39f8-fa79-4531-b990-e49d58a5fa31 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:17.736377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9d1b39f8-fa79-4531-b990-e49d58a5fa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:17.736589 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6db54-3866-4f4a-8c44-36119ce7a927 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:17.750477 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1130/2229] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:17.760258 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b39f8-fa79-4531-b990-e49d58a5fa31 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:17.762084 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9d1b39f8-fa79-4531-b990-e49d58a5fa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:17.784563 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b39f8-fa79-4531-b990-e49d58a5fa31 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:17.788992 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1100/2230] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:17 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:17.788992 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df8638-2744-40cb-9479-3b3268460c29 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:17.788992 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df8638-2744-40cb-9479-3b3268460c29 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:17.788992 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df8638-2744-40cb-9479-3b3268460c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:17.812767 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-90df8638-2744-40cb-9479-3b3268460c29 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:17.814734 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-90df8638-2744-40cb-9479-3b3268460c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:17.869730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bb8fa-2305-427f-8c5d-e17fddf613a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:17.870603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bb8fa-2305-427f-8c5d-e17fddf613a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:17.870957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bb8fa-2305-427f-8c5d-e17fddf613a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:17.871464 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bb8fa-2305-427f-8c5d-e17fddf613a7 admin admin] PATH_INFO: `/v3/users/11b6deee3d1a4b4d8c74e528530b9d98` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:17.873349 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bb8fa-2305-427f-8c5d-e17fddf613a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11b6deee3d1a4b4d8c74e528530b9d98)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:17.875976 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bb8fa-2305-427f-8c5d-e17fddf613a7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:17.919916 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1101/2231] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:17.921325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df8638-2744-40cb-9479-3b3268460c29 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:17.922975 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-90df8638-2744-40cb-9479-3b3268460c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:17.941312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df8638-2744-40cb-9479-3b3268460c29 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:17.948033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4224bc-5d29-4432-bb92-90265f489bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:17.948769 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4224bc-5d29-4432-bb92-90265f489bcf admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:17.949086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4224bc-5d29-4432-bb92-90265f489bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:17.949410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4224bc-5d29-4432-bb92-90265f489bcf admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:17.950190 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4224bc-5d29-4432-bb92-90265f489bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:17.952696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4224bc-5d29-4432-bb92-90265f489bcf admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:17.955356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-724bb8fa-2305-427f-8c5d-e17fddf613a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11b6deee3d1a4b4d8c74e528530b9d98'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:17.956407 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-724bb8fa-2305-427f-8c5d-e17fddf613a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11b6deee3d1a4b4d8c74e528530b9d98'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:17.976648 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-724bb8fa-2305-427f-8c5d-e17fddf613a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11b6deee3d1a4b4d8c74e528530b9d98'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:17.996644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1102/2232] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:17 2022] POST /identity/v3/users => generated 288 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:17.998195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4224bc-5d29-4432-bb92-90265f489bcf admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:18.000171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-724bb8fa-2305-427f-8c5d-e17fddf613a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11b6deee3d1a4b4d8c74e528530b9d98'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:18.010297 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-724bb8fa-2305-427f-8c5d-e17fddf613a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11b6deee3d1a4b4d8c74e528530b9d98'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:18.017002 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4224bc-5d29-4432-bb92-90265f489bcf admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:18.023633 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1131/2233] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:17 2022] DELETE /identity/v3/users/11b6deee3d1a4b4d8c74e528530b9d98 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:18.023780 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbf0c9-91aa-406a-a66a-111571b6d2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:18.024444 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbf0c9-91aa-406a-a66a-111571b6d2e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:18.024621 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bb8fa-2305-427f-8c5d-e17fddf613a7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:18.025130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbf0c9-91aa-406a-a66a-111571b6d2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:18.025551 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbf0c9-91aa-406a-a66a-111571b6d2e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:18.026199 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-724bb8fa-2305-427f-8c5d-e17fddf613a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:18.026464 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbf0c9-91aa-406a-a66a-111571b6d2e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:12:18.026900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbf0c9-91aa-406a-a66a-111571b6d2e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:18.028600 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbf0c9-91aa-406a-a66a-111571b6d2e5 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:18.056023 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1103/2234] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:12:18.056023 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16ccc2-32a0-4191-ae7c-896ede3ee6f9 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:18.056023 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16ccc2-32a0-4191-ae7c-896ede3ee6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:18.056023 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c16ccc2-32a0-4191-ae7c-896ede3ee6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:18.056383 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:18.060633 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:18.080090 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-5c16ccc2-32a0-4191-ae7c-896ede3ee6f9 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:18.080090 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-5c16ccc2-32a0-4191-ae7c-896ede3ee6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:18.141572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bb8fa-2305-427f-8c5d-e17fddf613a7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:18.146940 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6ab24-3a70-4721-b195-bd59ccd725c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:18.148276 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6ab24-3a70-4721-b195-bd59ccd725c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:18.148674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6ab24-3a70-4721-b195-bd59ccd725c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:18.154534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f6ab24-3a70-4721-b195-bd59ccd725c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:18.158673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6ab24-3a70-4721-b195-bd59ccd725c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:18.160377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f6ab24-3a70-4721-b195-bd59ccd725c6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:18.183084 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1132/2235] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:18.183805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6ab24-3a70-4721-b195-bd59ccd725c6 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:18.185677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-34f6ab24-3a70-4721-b195-bd59ccd725c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:18.192562 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1104/2236] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:18.202132 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f6ab24-3a70-4721-b195-bd59ccd725c6 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:18.202577 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16ccc2-32a0-4191-ae7c-896ede3ee6f9 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:18.205732 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-5c16ccc2-32a0-4191-ae7c-896ede3ee6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:18.208189 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a3f17-65d7-4d23-85cc-befc9cf2e55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:18.209107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a3f17-65d7-4d23-85cc-befc9cf2e55b admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:18.209107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a3f17-65d7-4d23-85cc-befc9cf2e55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:18.209315 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a3f17-65d7-4d23-85cc-befc9cf2e55b admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:18.209967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a3f17-65d7-4d23-85cc-befc9cf2e55b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:18.211903 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a3f17-65d7-4d23-85cc-befc9cf2e55b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:18.255892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1133/2237] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:18 2022] POST /identity/v3/projects => generated 391 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:18.257039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a3f17-65d7-4d23-85cc-befc9cf2e55b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:18.288085 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c16ccc2-32a0-4191-ae7c-896ede3ee6f9 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:18.338407 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a3f17-65d7-4d23-85cc-befc9cf2e55b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:18.343549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd9eab-c8b5-4f9a-8137-80859ed83535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:18.344242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd9eab-c8b5-4f9a-8137-80859ed83535 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:18.344640 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd9eab-c8b5-4f9a-8137-80859ed83535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:18.344990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd9eab-c8b5-4f9a-8137-80859ed83535 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:18.345766 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd9eab-c8b5-4f9a-8137-80859ed83535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:18.347249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d116263-234b-4b99-9824-d2b2b6ee705c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:18.348299 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d116263-234b-4b99-9824-d2b2b6ee705c service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:18.348537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd9eab-c8b5-4f9a-8137-80859ed83535 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:18.348989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d116263-234b-4b99-9824-d2b2b6ee705c service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:18.349555 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d116263-234b-4b99-9824-d2b2b6ee705c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:18.352814 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4d116263-234b-4b99-9824-d2b2b6ee705c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:18.362942 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1134/2238] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:18.362942 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd9eab-c8b5-4f9a-8137-80859ed83535 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:18.362942 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-17dd9eab-c8b5-4f9a-8137-80859ed83535 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:18.449943 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d116263-234b-4b99-9824-d2b2b6ee705c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:18.452077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d116263-234b-4b99-9824-d2b2b6ee705c service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:18.464427 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd9eab-c8b5-4f9a-8137-80859ed83535 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:18.464737 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1105/2239] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:18.465593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d116263-234b-4b99-9824-d2b2b6ee705c service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:18.480447 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dada9d9-0edc-4d38-9ca0-7492d2f9cab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:18.481010 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d116263-234b-4b99-9824-d2b2b6ee705c service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:18.483577 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dada9d9-0edc-4d38-9ca0-7492d2f9cab2 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:18.484797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dada9d9-0edc-4d38-9ca0-7492d2f9cab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:18.486900 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dada9d9-0edc-4d38-9ca0-7492d2f9cab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:18.487041 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee14109-1bb9-407f-8c56-5954d74ffecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:18.487893 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee14109-1bb9-407f-8c56-5954d74ffecc admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:18.488351 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee14109-1bb9-407f-8c56-5954d74ffecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:18.488963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee14109-1bb9-407f-8c56-5954d74ffecc admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:18.489748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee14109-1bb9-407f-8c56-5954d74ffecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:18.491997 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee14109-1bb9-407f-8c56-5954d74ffecc admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:18.505249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:18.510313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dada9d9-0edc-4d38-9ca0-7492d2f9cab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:18.513389 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dada9d9-0edc-4d38-9ca0-7492d2f9cab2 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:18.529215 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1106/2240] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:18 2022] POST /identity/v3/users => generated 296 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:18.533258 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1135/2241] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:18.534234 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dada9d9-0edc-4d38-9ca0-7492d2f9cab2 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:18.545132 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee14109-1bb9-407f-8c56-5954d74ffecc admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:18.549025 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dada9d9-0edc-4d38-9ca0-7492d2f9cab2 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:18.555898 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59eba9d-40c4-489e-8e05-2d3a6339048f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:18.556755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eba9d-40c4-489e-8e05-2d3a6339048f admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:18.557072 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eba9d-40c4-489e-8e05-2d3a6339048f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:18.557428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eba9d-40c4-489e-8e05-2d3a6339048f admin admin] PATH_INFO: `/v3/projects/39f595698c4d486abe9f757d14441af7/users/12d278835c5c4ff7ad8b85979d40c35d/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:18.574191 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee14109-1bb9-407f-8c56-5954d74ffecc admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:18.594721 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08021b04-65ed-4630-a62f-26aeb7178009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:18.595646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08021b04-65ed-4630-a62f-26aeb7178009 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:18.596202 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08021b04-65ed-4630-a62f-26aeb7178009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:18.596547 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08021b04-65ed-4630-a62f-26aeb7178009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:18.598931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08021b04-65ed-4630-a62f-26aeb7178009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:18.603636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08021b04-65ed-4630-a62f-26aeb7178009 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:18.626994 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1107/2242] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:18.634216 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08021b04-65ed-4630-a62f-26aeb7178009 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:18.634702 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59eba9d-40c4-489e-8e05-2d3a6339048f admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f595698c4d486abe9f757d14441af7, user_id=12d278835c5c4ff7ad8b85979d40c35d, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:18.643148 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59eba9d-40c4-489e-8e05-2d3a6339048f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:18.670705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08021b04-65ed-4630-a62f-26aeb7178009 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:18.686290 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1136/2243] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:18 2022] PUT /identity/v3/projects/39f595698c4d486abe9f757d14441af7/users/12d278835c5c4ff7ad8b85979d40c35d/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:18.699394 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cdc2e-ac58-40c6-9c2c-4887b42d1efd None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:18.699759 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cdc2e-ac58-40c6-9c2c-4887b42d1efd None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:18.699969 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cdc2e-ac58-40c6-9c2c-4887b42d1efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:18.716518 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:18.804692 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d17cdc2e-ac58-40c6-9c2c-4887b42d1efd None None] MFA Rules not processed for user `12d278835c5c4ff7ad8b85979d40c35d`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:18.808262 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d17cdc2e-ac58-40c6-9c2c-4887b42d1efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:18.841181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca82cb-4c60-46db-acb8-5aaa16b76658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:18.841798 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca82cb-4c60-46db-acb8-5aaa16b76658 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:18.841798 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca82cb-4c60-46db-acb8-5aaa16b76658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:18.842137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca82cb-4c60-46db-acb8-5aaa16b76658 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:18.842987 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca82cb-4c60-46db-acb8-5aaa16b76658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:18.845985 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca82cb-4c60-46db-acb8-5aaa16b76658 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:18.867041 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1108/2244] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:18.869347 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca82cb-4c60-46db-acb8-5aaa16b76658 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:18.889959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca82cb-4c60-46db-acb8-5aaa16b76658 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:18.905390 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77548c-db41-49eb-861f-933bc898d956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:18.906975 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77548c-db41-49eb-861f-933bc898d956 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:18.907320 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77548c-db41-49eb-861f-933bc898d956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:18.907647 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77548c-db41-49eb-861f-933bc898d956 admin admin] PATH_INFO: `/v3/projects/c93b7cf72a1546e4a83974777e864ee8/users/7511e2f8a2c24c92be08dc5056bac4f4/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:18.959778 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77548c-db41-49eb-861f-933bc898d956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c93b7cf72a1546e4a83974777e864ee8, user_id=7511e2f8a2c24c92be08dc5056bac4f4, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:18.969654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77548c-db41-49eb-861f-933bc898d956 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:19.012617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1109/2245] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:18 2022] PUT /identity/v3/projects/c93b7cf72a1546e4a83974777e864ee8/users/7511e2f8a2c24c92be08dc5056bac4f4/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:19.017991 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a83398-d520-439f-a7b7-a45823838db2 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:19.018908 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a83398-d520-439f-a7b7-a45823838db2 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:19.020521 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a83398-d520-439f-a7b7-a45823838db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:19.029786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1137/2246] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:19.036852 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cdc2e-ac58-40c6-9c2c-4887b42d1efd None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:19.058547 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cdc2e-ac58-40c6-9c2c-4887b42d1efd None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:19.066086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-75a83398-d520-439f-a7b7-a45823838db2 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:19.067610 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-75a83398-d520-439f-a7b7-a45823838db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:19.193172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1110/2247] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:19.194262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a83398-d520-439f-a7b7-a45823838db2 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:19.195703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-75a83398-d520-439f-a7b7-a45823838db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:19.208620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e37ede-d9d5-40d0-85d7-7f6b6b0466af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:19.209364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e37ede-d9d5-40d0-85d7-7f6b6b0466af admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:19.209710 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e37ede-d9d5-40d0-85d7-7f6b6b0466af admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:19.209828 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a83398-d520-439f-a7b7-a45823838db2 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:19.210046 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e37ede-d9d5-40d0-85d7-7f6b6b0466af admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:19.210872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e37ede-d9d5-40d0-85d7-7f6b6b0466af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:19.213216 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e37ede-d9d5-40d0-85d7-7f6b6b0466af admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:19.219983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020417c0-a713-4b4f-9b6b-851d9854f599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:19.221544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020417c0-a713-4b4f-9b6b-851d9854f599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:19.223430 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020417c0-a713-4b4f-9b6b-851d9854f599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:19.223844 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020417c0-a713-4b4f-9b6b-851d9854f599 admin admin] PATH_INFO: `/v3/users/e72d67a6f2094ed0b77429ccdc4b7c86` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:19.225453 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020417c0-a713-4b4f-9b6b-851d9854f599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e72d67a6f2094ed0b77429ccdc4b7c86)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:19.229723 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020417c0-a713-4b4f-9b6b-851d9854f599 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:19.293990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1138/2248] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:19 2022] POST /identity/v3/projects => generated 377 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:19.295594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e37ede-d9d5-40d0-85d7-7f6b6b0466af admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:19.314823 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-020417c0-a713-4b4f-9b6b-851d9854f599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e72d67a6f2094ed0b77429ccdc4b7c86'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:19.317795 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-020417c0-a713-4b4f-9b6b-851d9854f599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e72d67a6f2094ed0b77429ccdc4b7c86'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:19.322587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:19.336125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-020417c0-a713-4b4f-9b6b-851d9854f599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e72d67a6f2094ed0b77429ccdc4b7c86'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:19.352694 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-020417c0-a713-4b4f-9b6b-851d9854f599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e72d67a6f2094ed0b77429ccdc4b7c86'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:19.353391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-020417c0-a713-4b4f-9b6b-851d9854f599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e72d67a6f2094ed0b77429ccdc4b7c86'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:19.370143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1111/2249] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:19 2022] DELETE /identity/v3/users/e72d67a6f2094ed0b77429ccdc4b7c86 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:19.371069 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020417c0-a713-4b4f-9b6b-851d9854f599 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:19.373757 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-020417c0-a713-4b4f-9b6b-851d9854f599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:19.388165 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e37ede-d9d5-40d0-85d7-7f6b6b0466af admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:19.435584 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:19.457151 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020417c0-a713-4b4f-9b6b-851d9854f599 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:19.457396 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1a3fc-c0c4-443f-ab06-9b942dac6b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:19.458029 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1a3fc-c0c4-443f-ab06-9b942dac6b09 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:19.458404 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1a3fc-c0c4-443f-ab06-9b942dac6b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:19.458686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1a3fc-c0c4-443f-ab06-9b942dac6b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:19.460588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f4f1a3fc-c0c4-443f-ab06-9b942dac6b09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:19.462752 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c6372-ff0d-4ec8-acb6-830620e627b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:19.463401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c6372-ff0d-4ec8-acb6-830620e627b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:19.463686 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c6372-ff0d-4ec8-acb6-830620e627b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:19.463982 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c6372-ff0d-4ec8-acb6-830620e627b8 admin admin] PATH_INFO: `/v3/projects/b58034752b644f31bf44faedf31e73b6` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:19.465278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c6372-ff0d-4ec8-acb6-830620e627b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b58034752b644f31bf44faedf31e73b6)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:19.467123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c6372-ff0d-4ec8-acb6-830620e627b8 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:19.474228 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1a3fc-c0c4-443f-ab06-9b942dac6b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:19.476214 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1a3fc-c0c4-443f-ab06-9b942dac6b09 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:19.487747 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1139/2250] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:19.488498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1a3fc-c0c4-443f-ab06-9b942dac6b09 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:19.489897 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f4f1a3fc-c0c4-443f-ab06-9b942dac6b09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:19.501834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1a3fc-c0c4-443f-ab06-9b942dac6b09 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:19.508590 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cbbb4-301b-4ee1-aae8-85bf4854ac93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:19.509136 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cbbb4-301b-4ee1-aae8-85bf4854ac93 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:19.509449 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cbbb4-301b-4ee1-aae8-85bf4854ac93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:19.509708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cbbb4-301b-4ee1-aae8-85bf4854ac93 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:19.510811 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8cbbb4-301b-4ee1-aae8-85bf4854ac93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:19.513162 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8cbbb4-301b-4ee1-aae8-85bf4854ac93 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:19.536758 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9b5c6372-ff0d-4ec8-acb6-830620e627b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b58034752b644f31bf44faedf31e73b6', 'request_id': 'req-9b5c6372-ff0d-4ec8-acb6-830620e627b8'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:19.543499 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1140/2251] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:19 2022] POST /identity/v3/users => generated 295 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:19.545112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9b5c6372-ff0d-4ec8-acb6-830620e627b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b58034752b644f31bf44faedf31e73b6', 'request_id': 'req-9b5c6372-ff0d-4ec8-acb6-830620e627b8'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:19.545241 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac5b4f-f172-410f-b3e7-beafe42f68f0 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:19.545534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac5b4f-f172-410f-b3e7-beafe42f68f0 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:19.545811 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac5b4f-f172-410f-b3e7-beafe42f68f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:19.557118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9b5c6372-ff0d-4ec8-acb6-830620e627b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b58034752b644f31bf44faedf31e73b6', 'request_id': 'req-9b5c6372-ff0d-4ec8-acb6-830620e627b8'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:19.572924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7fac5b4f-f172-410f-b3e7-beafe42f68f0 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:19.574263 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7fac5b4f-f172-410f-b3e7-beafe42f68f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:19.577374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9b5c6372-ff0d-4ec8-acb6-830620e627b8 admin admin] The token cache is being invalidate because project b58034752b644f31bf44faedf31e73b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:19.577812 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9b5c6372-ff0d-4ec8-acb6-830620e627b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:19.578869 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9b5c6372-ff0d-4ec8-acb6-830620e627b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:19.584498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1112/2252] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:19 2022] DELETE /identity/v3/projects/b58034752b644f31bf44faedf31e73b6 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:19.584498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c6372-ff0d-4ec8-acb6-830620e627b8 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:19.587020 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-9b5c6372-ff0d-4ec8-acb6-830620e627b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:19.689317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1141/2253] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:19.692683 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac5b4f-f172-410f-b3e7-beafe42f68f0 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:19.696321 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7fac5b4f-f172-410f-b3e7-beafe42f68f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:19.704536 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:19.712221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c6372-ff0d-4ec8-acb6-830620e627b8 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:19.718158 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac5b4f-f172-410f-b3e7-beafe42f68f0 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:19.719645 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad299924-800a-43c8-b79a-3a4be6b8382e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:19.720394 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad299924-800a-43c8-b79a-3a4be6b8382e admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:19.721003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad299924-800a-43c8-b79a-3a4be6b8382e admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:19.721698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad299924-800a-43c8-b79a-3a4be6b8382e admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:19.722716 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad299924-800a-43c8-b79a-3a4be6b8382e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:19.725586 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad299924-800a-43c8-b79a-3a4be6b8382e admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:19.726515 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8198b6-ca5b-4dbb-b457-4a1eaa160d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:19.727817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8198b6-ca5b-4dbb-b457-4a1eaa160d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:19.728126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8198b6-ca5b-4dbb-b457-4a1eaa160d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:19.728558 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8198b6-ca5b-4dbb-b457-4a1eaa160d28 admin admin] PATH_INFO: `/v3/users/7b654864b39d4fa98b85f6e279d016bf` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:19.730998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8198b6-ca5b-4dbb-b457-4a1eaa160d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b654864b39d4fa98b85f6e279d016bf)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:19.735060 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8198b6-ca5b-4dbb-b457-4a1eaa160d28 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:19.751435 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1113/2254] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:19.754597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad299924-800a-43c8-b79a-3a4be6b8382e admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:19.763248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ad299924-800a-43c8-b79a-3a4be6b8382e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:19.816082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8f8198b6-ca5b-4dbb-b457-4a1eaa160d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b654864b39d4fa98b85f6e279d016bf'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:19.817196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8f8198b6-ca5b-4dbb-b457-4a1eaa160d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b654864b39d4fa98b85f6e279d016bf'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:19.828917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8f8198b6-ca5b-4dbb-b457-4a1eaa160d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b654864b39d4fa98b85f6e279d016bf'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:19.845282 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8f8198b6-ca5b-4dbb-b457-4a1eaa160d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b654864b39d4fa98b85f6e279d016bf'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:19.855802 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8f8198b6-ca5b-4dbb-b457-4a1eaa160d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b654864b39d4fa98b85f6e279d016bf'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:19.856188 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad299924-800a-43c8-b79a-3a4be6b8382e admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:19.865060 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92329055-bfac-4346-a8fd-614c2c3b5563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:19.866228 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92329055-bfac-4346-a8fd-614c2c3b5563 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:19.866390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1142/2255] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:19 2022] DELETE /identity/v3/users/7b654864b39d4fa98b85f6e279d016bf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:19.868302 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8198b6-ca5b-4dbb-b457-4a1eaa160d28 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:19.869268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92329055-bfac-4346-a8fd-614c2c3b5563 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:19.869985 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92329055-bfac-4346-a8fd-614c2c3b5563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:19.874389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-92329055-bfac-4346-a8fd-614c2c3b5563 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:19.883681 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8f8198b6-ca5b-4dbb-b457-4a1eaa160d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:19.893117 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92329055-bfac-4346-a8fd-614c2c3b5563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:19.895880 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92329055-bfac-4346-a8fd-614c2c3b5563 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:19.915439 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1114/2256] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:19.949779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:20.104425 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8198b6-ca5b-4dbb-b457-4a1eaa160d28 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:20.119125 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b94cf5-998a-4a6f-a41f-50b545eb3c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:20.119737 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b94cf5-998a-4a6f-a41f-50b545eb3c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:20.120014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b94cf5-998a-4a6f-a41f-50b545eb3c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:20.120334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b94cf5-998a-4a6f-a41f-50b545eb3c81 admin admin] PATH_INFO: `/v3/projects/df642956bbe04c038b83faecf7b24572/users/977c3912ddc146efad9c09290afcae5e/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:20.154047 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b94cf5-998a-4a6f-a41f-50b545eb3c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df642956bbe04c038b83faecf7b24572, user_id=977c3912ddc146efad9c09290afcae5e, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:20.156811 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b94cf5-998a-4a6f-a41f-50b545eb3c81 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:20.186898 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1143/2257] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:19 2022] PUT /identity/v3/projects/df642956bbe04c038b83faecf7b24572/users/977c3912ddc146efad9c09290afcae5e/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:20.193431 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92329055-bfac-4346-a8fd-614c2c3b5563 service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:20.209431 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92329055-bfac-4346-a8fd-614c2c3b5563 service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:20.299581 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6c77f-0bdd-4377-b29f-af1d0f6fe912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:20.301353 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6c77f-0bdd-4377-b29f-af1d0f6fe912 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:20.302000 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6c77f-0bdd-4377-b29f-af1d0f6fe912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:20.302622 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6c77f-0bdd-4377-b29f-af1d0f6fe912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:20.303637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6c77f-0bdd-4377-b29f-af1d0f6fe912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:20.309628 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6c77f-0bdd-4377-b29f-af1d0f6fe912 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:20.331844 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1115/2258] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:20 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:12:20.336379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b94cf5-998a-4a6f-a41f-50b545eb3c81 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:20.354734 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b94cf5-998a-4a6f-a41f-50b545eb3c81 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:20.361344 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328f5a1-a0df-4de6-87e5-16f0599cfd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:20.363735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328f5a1-a0df-4de6-87e5-16f0599cfd2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:20.364130 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328f5a1-a0df-4de6-87e5-16f0599cfd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:20.364672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328f5a1-a0df-4de6-87e5-16f0599cfd2a admin admin] PATH_INFO: `/v3/projects/df642956bbe04c038b83faecf7b24572/users/977c3912ddc146efad9c09290afcae5e/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:20.366996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328f5a1-a0df-4de6-87e5-16f0599cfd2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=df642956bbe04c038b83faecf7b24572, user_id=977c3912ddc146efad9c09290afcae5e, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:20.371109 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328f5a1-a0df-4de6-87e5-16f0599cfd2a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:20.405163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1144/2259] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:20 2022] PUT /identity/v3/projects/df642956bbe04c038b83faecf7b24572/users/977c3912ddc146efad9c09290afcae5e/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:20.416619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43af9f-7233-439b-b64e-6c94d92bd4d0 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:20.417085 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43af9f-7233-439b-b64e-6c94d92bd4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:20.417457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43af9f-7233-439b-b64e-6c94d92bd4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:20.464226 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-7b43af9f-7233-439b-b64e-6c94d92bd4d0 None None] MFA Rules not processed for user `977c3912ddc146efad9c09290afcae5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:20.466552 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7b43af9f-7233-439b-b64e-6c94d92bd4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:20.537318 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328f5a1-a0df-4de6-87e5-16f0599cfd2a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:20.539480 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8328f5a1-a0df-4de6-87e5-16f0599cfd2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:20.553865 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1116/2260] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:20.568080 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43af9f-7233-439b-b64e-6c94d92bd4d0 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:20.569552 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7b43af9f-7233-439b-b64e-6c94d92bd4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:20.590693 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:20.633083 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43af9f-7233-439b-b64e-6c94d92bd4d0 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:20.637842 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b448b-3ed2-4f2d-9071-b8e4e7281055 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:20.638483 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b448b-3ed2-4f2d-9071-b8e4e7281055 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:20.638763 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b448b-3ed2-4f2d-9071-b8e4e7281055 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:20.639036 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b448b-3ed2-4f2d-9071-b8e4e7281055 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:20.640967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-660b448b-3ed2-4f2d-9071-b8e4e7281055 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:20.696562 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328f5a1-a0df-4de6-87e5-16f0599cfd2a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:20.704069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab65596-b38e-4e89-91d7-34f667dc6c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:20.705113 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab65596-b38e-4e89-91d7-34f667dc6c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:20.705615 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab65596-b38e-4e89-91d7-34f667dc6c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:20.706306 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab65596-b38e-4e89-91d7-34f667dc6c21 admin admin] PATH_INFO: `/v3/projects/6ea328d8930d49b98af441087512eab2` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:20.707995 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab65596-b38e-4e89-91d7-34f667dc6c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ea328d8930d49b98af441087512eab2)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:20.710693 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab65596-b38e-4e89-91d7-34f667dc6c21 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:20.712700 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b448b-3ed2-4f2d-9071-b8e4e7281055 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:20.714256 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b448b-3ed2-4f2d-9071-b8e4e7281055 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:20.740671 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1117/2261] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:20.755452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b448b-3ed2-4f2d-9071-b8e4e7281055 service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:20.758746 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-660b448b-3ed2-4f2d-9071-b8e4e7281055 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:20.790383 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9ab65596-b38e-4e89-91d7-34f667dc6c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ea328d8930d49b98af441087512eab2', 'request_id': 'req-9ab65596-b38e-4e89-91d7-34f667dc6c21'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:20.792255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b448b-3ed2-4f2d-9071-b8e4e7281055 service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:20.804581 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9ab65596-b38e-4e89-91d7-34f667dc6c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ea328d8930d49b98af441087512eab2', 'request_id': 'req-9ab65596-b38e-4e89-91d7-34f667dc6c21'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:20.820166 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9ab65596-b38e-4e89-91d7-34f667dc6c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ea328d8930d49b98af441087512eab2', 'request_id': 'req-9ab65596-b38e-4e89-91d7-34f667dc6c21'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:20.843880 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9ab65596-b38e-4e89-91d7-34f667dc6c21 admin admin] The token cache is being invalidate because project 6ea328d8930d49b98af441087512eab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:20.845155 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9ab65596-b38e-4e89-91d7-34f667dc6c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:20.846378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9ab65596-b38e-4e89-91d7-34f667dc6c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:20.849755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1145/2262] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:20 2022] DELETE /identity/v3/projects/6ea328d8930d49b98af441087512eab2 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:20.855533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d57383-d35c-43b1-a0ae-7b39524e00de None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:20.855533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d57383-d35c-43b1-a0ae-7b39524e00de None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:20.856772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d57383-d35c-43b1-a0ae-7b39524e00de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:20.899221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-28d57383-d35c-43b1-a0ae-7b39524e00de None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:20.903097 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-28d57383-d35c-43b1-a0ae-7b39524e00de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:20.911713 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ad999-7e45-470a-b24d-3342f27bcfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:20.912755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ad999-7e45-470a-b24d-3342f27bcfd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:20.913045 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ad999-7e45-470a-b24d-3342f27bcfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:20.913566 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ad999-7e45-470a-b24d-3342f27bcfd8 admin admin] PATH_INFO: `/v3/projects/9977590e4a6248b5b1a440717d9edf4e` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:20.915670 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ad999-7e45-470a-b24d-3342f27bcfd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9977590e4a6248b5b1a440717d9edf4e)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:20.917780 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ad999-7e45-470a-b24d-3342f27bcfd8 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:20.922083 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1146/2263] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:12:20.930650 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b62893-c6f7-414a-9559-a6c44a069779 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:20.931430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b62893-c6f7-414a-9559-a6c44a069779 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:20.931430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b62893-c6f7-414a-9559-a6c44a069779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:20.976986 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e6b62893-c6f7-414a-9559-a6c44a069779 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:20.979694 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e6b62893-c6f7-414a-9559-a6c44a069779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:20.996615 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1147/2264] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:12:21.004508 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b62893-c6f7-414a-9559-a6c44a069779 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:21.026171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b62893-c6f7-414a-9559-a6c44a069779 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:21.042625 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-288ad999-7e45-470a-b24d-3342f27bcfd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9977590e4a6248b5b1a440717d9edf4e', 'request_id': 'req-288ad999-7e45-470a-b24d-3342f27bcfd8'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:21.053632 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-288ad999-7e45-470a-b24d-3342f27bcfd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9977590e4a6248b5b1a440717d9edf4e', 'request_id': 'req-288ad999-7e45-470a-b24d-3342f27bcfd8'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:21.060296 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:21.071484 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-288ad999-7e45-470a-b24d-3342f27bcfd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9977590e4a6248b5b1a440717d9edf4e', 'request_id': 'req-288ad999-7e45-470a-b24d-3342f27bcfd8'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:21.113478 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-288ad999-7e45-470a-b24d-3342f27bcfd8 admin admin] The token cache is being invalidate because project 9977590e4a6248b5b1a440717d9edf4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:21.113849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-288ad999-7e45-470a-b24d-3342f27bcfd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:21.114761 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-288ad999-7e45-470a-b24d-3342f27bcfd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:21.123420 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1118/2265] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:20 2022] DELETE /identity/v3/projects/9977590e4a6248b5b1a440717d9edf4e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:21.125715 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ad999-7e45-470a-b24d-3342f27bcfd8 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:21.127616 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-288ad999-7e45-470a-b24d-3342f27bcfd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:21.150062 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:21.167374 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1fa36-d31e-4729-9a92-907d5bcde71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:21.168146 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1fa36-d31e-4729-9a92-907d5bcde71d admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:21.168511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1fa36-d31e-4729-9a92-907d5bcde71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:21.171846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1fa36-d31e-4729-9a92-907d5bcde71d admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:21.172894 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1fa36-d31e-4729-9a92-907d5bcde71d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:12:21.173448 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1fa36-d31e-4729-9a92-907d5bcde71d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:21.177486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e1fa36-d31e-4729-9a92-907d5bcde71d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:21.214090 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1148/2266] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 10:12:21.216208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1fa36-d31e-4729-9a92-907d5bcde71d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:21.219433 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-76e1fa36-d31e-4729-9a92-907d5bcde71d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:21.260803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1fa36-d31e-4729-9a92-907d5bcde71d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:21.278526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b469c-c3b0-4310-b113-80b716066aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:21.280608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b469c-c3b0-4310-b113-80b716066aeb admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:21.280912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b469c-c3b0-4310-b113-80b716066aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:21.281199 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b469c-c3b0-4310-b113-80b716066aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:21.282088 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b469c-c3b0-4310-b113-80b716066aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:21.289138 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b469c-c3b0-4310-b113-80b716066aeb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:21.364449 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1149/2267] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:21 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:21.370204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b469c-c3b0-4310-b113-80b716066aeb admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:21.413419 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ad999-7e45-470a-b24d-3342f27bcfd8 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:21.516311 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b469c-c3b0-4310-b113-80b716066aeb admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:21.529185 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd182f-0b43-499e-9603-3e81f9598cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:21.533143 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd182f-0b43-499e-9603-3e81f9598cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:21.533580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd182f-0b43-499e-9603-3e81f9598cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:21.534113 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd182f-0b43-499e-9603-3e81f9598cfb admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:21.535663 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd182f-0b43-499e-9603-3e81f9598cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:21.540577 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd182f-0b43-499e-9603-3e81f9598cfb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:21.574015 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd010ec-2f3f-4923-8327-b1b0bc9f3ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:21.574927 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd010ec-2f3f-4923-8327-b1b0bc9f3ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:21.575501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd010ec-2f3f-4923-8327-b1b0bc9f3ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:21.575904 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd010ec-2f3f-4923-8327-b1b0bc9f3ca4 admin admin] PATH_INFO: `/v3/users/8469d320f6d1476cbf973d72feae973e` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:21.577459 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd010ec-2f3f-4923-8327-b1b0bc9f3ca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8469d320f6d1476cbf973d72feae973e)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:21.579792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd010ec-2f3f-4923-8327-b1b0bc9f3ca4 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:21.582084 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1150/2268] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:21 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:21.593965 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd182f-0b43-499e-9603-3e81f9598cfb admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:21.617536 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd182f-0b43-499e-9603-3e81f9598cfb admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:21.629301 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e37e83-6051-402a-8283-aa75fdb643e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:21.630451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e37e83-6051-402a-8283-aa75fdb643e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:21.630904 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e37e83-6051-402a-8283-aa75fdb643e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:21.631380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e37e83-6051-402a-8283-aa75fdb643e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:21.632398 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e37e83-6051-402a-8283-aa75fdb643e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:21.635047 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e37e83-6051-402a-8283-aa75fdb643e7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:21.657246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1151/2269] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:21.659832 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e37e83-6051-402a-8283-aa75fdb643e7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:21.677588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e37e83-6051-402a-8283-aa75fdb643e7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:21.685326 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884e712-088e-4869-a4dd-9d7a6256deee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:21.686369 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884e712-088e-4869-a4dd-9d7a6256deee admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:21.687320 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884e712-088e-4869-a4dd-9d7a6256deee admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:21.687810 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e884e712-088e-4869-a4dd-9d7a6256deee admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:21.689092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884e712-088e-4869-a4dd-9d7a6256deee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:21.692298 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e884e712-088e-4869-a4dd-9d7a6256deee admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:21.708228 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1152/2270] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:12:21.714007 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884e712-088e-4869-a4dd-9d7a6256deee admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:21.728279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9fd010ec-2f3f-4923-8327-b1b0bc9f3ca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8469d320f6d1476cbf973d72feae973e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:21.729217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9fd010ec-2f3f-4923-8327-b1b0bc9f3ca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8469d320f6d1476cbf973d72feae973e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:21.732202 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e884e712-088e-4869-a4dd-9d7a6256deee admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:21.740186 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafbd3c-7cab-45db-a317-8b24b3aa08db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:21.741345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafbd3c-7cab-45db-a317-8b24b3aa08db admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:21.742400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafbd3c-7cab-45db-a317-8b24b3aa08db admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:21.743034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafbd3c-7cab-45db-a317-8b24b3aa08db admin admin] PATH_INFO: `/v3/projects/dd501ec0c1334707a5e896593e08640a/users/decfa5c8e33e4e4693dc10cec148a393/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:21.743427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9fd010ec-2f3f-4923-8327-b1b0bc9f3ca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8469d320f6d1476cbf973d72feae973e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:21.766398 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9fd010ec-2f3f-4923-8327-b1b0bc9f3ca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8469d320f6d1476cbf973d72feae973e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:21.767206 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9fd010ec-2f3f-4923-8327-b1b0bc9f3ca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8469d320f6d1476cbf973d72feae973e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:21.770512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafbd3c-7cab-45db-a317-8b24b3aa08db admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd501ec0c1334707a5e896593e08640a, user_id=decfa5c8e33e4e4693dc10cec148a393, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:21.776321 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafbd3c-7cab-45db-a317-8b24b3aa08db admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:21.788391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1119/2271] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:21 2022] DELETE /identity/v3/users/8469d320f6d1476cbf973d72feae973e => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:21.796816 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1153/2272] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:21 2022] PUT /identity/v3/projects/dd501ec0c1334707a5e896593e08640a/users/decfa5c8e33e4e4693dc10cec148a393/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:21.809611 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deb2d8-92fc-44b9-a080-f148619c91da None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:21.810022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deb2d8-92fc-44b9-a080-f148619c91da None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:21.810760 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02deb2d8-92fc-44b9-a080-f148619c91da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:21.870081 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-02deb2d8-92fc-44b9-a080-f148619c91da None None] MFA Rules not processed for user `decfa5c8e33e4e4693dc10cec148a393`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:21.871542 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-02deb2d8-92fc-44b9-a080-f148619c91da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:21.922359 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:22.018068 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1120/2273] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:22.030764 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafbd3c-7cab-45db-a317-8b24b3aa08db admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:22.033090 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-beafbd3c-7cab-45db-a317-8b24b3aa08db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:22.091297 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:22.120851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafbd3c-7cab-45db-a317-8b24b3aa08db admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:22.133015 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad925fc6-e945-4d04-b418-19b42ca22a31 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0af63c36df2c4ceaa2df4d3ac59542bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:22.133879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad925fc6-e945-4d04-b418-19b42ca22a31 service glance] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:22.134165 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad925fc6-e945-4d04-b418-19b42ca22a31 service glance] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:22.134445 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad925fc6-e945-4d04-b418-19b42ca22a31 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:22.150173 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad925fc6-e945-4d04-b418-19b42ca22a31 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:22.151656 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad925fc6-e945-4d04-b418-19b42ca22a31 service glance] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:22.173313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1154/2274] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:22.554905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02deb2d8-92fc-44b9-a080-f148619c91da None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:22.560474 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-02deb2d8-92fc-44b9-a080-f148619c91da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:22.577534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad925fc6-e945-4d04-b418-19b42ca22a31 service glance] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:22.580226 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ad925fc6-e945-4d04-b418-19b42ca22a31 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:22.836867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad925fc6-e945-4d04-b418-19b42ca22a31 service glance] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:22.854675 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a0441-9906-4b24-9299-78b95f4c0f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:22.855466 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a0441-9906-4b24-9299-78b95f4c0f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:22.855824 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a0441-9906-4b24-9299-78b95f4c0f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:22.857005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a0441-9906-4b24-9299-78b95f4c0f5d admin admin] PATH_INFO: `/v3/projects/62ce554aa9c5455cbc4c68f226eb7b2b` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:22.860780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a0441-9906-4b24-9299-78b95f4c0f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=62ce554aa9c5455cbc4c68f226eb7b2b)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:22.863713 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a0441-9906-4b24-9299-78b95f4c0f5d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:22.914948 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02deb2d8-92fc-44b9-a080-f148619c91da None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:22.942735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0b0a0441-9906-4b24-9299-78b95f4c0f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62ce554aa9c5455cbc4c68f226eb7b2b', 'request_id': 'req-0b0a0441-9906-4b24-9299-78b95f4c0f5d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:22.958177 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0b0a0441-9906-4b24-9299-78b95f4c0f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62ce554aa9c5455cbc4c68f226eb7b2b', 'request_id': 'req-0b0a0441-9906-4b24-9299-78b95f4c0f5d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:22.977475 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0b0a0441-9906-4b24-9299-78b95f4c0f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62ce554aa9c5455cbc4c68f226eb7b2b', 'request_id': 'req-0b0a0441-9906-4b24-9299-78b95f4c0f5d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:22.998568 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0b0a0441-9906-4b24-9299-78b95f4c0f5d admin admin] The token cache is being invalidate because project 62ce554aa9c5455cbc4c68f226eb7b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:22.998862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0b0a0441-9906-4b24-9299-78b95f4c0f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:23.001487 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0b0a0441-9906-4b24-9299-78b95f4c0f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:23.008168 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1155/2275] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:22 2022] DELETE /identity/v3/projects/62ce554aa9c5455cbc4c68f226eb7b2b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:23.009155 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a0441-9906-4b24-9299-78b95f4c0f5d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:23.010538 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0b0a0441-9906-4b24-9299-78b95f4c0f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:23.049082 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa002f26-3729-43a9-aecf-06b538eea041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:23.050078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa002f26-3729-43a9-aecf-06b538eea041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:23.052649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa002f26-3729-43a9-aecf-06b538eea041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:23.053010 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa002f26-3729-43a9-aecf-06b538eea041 admin admin] PATH_INFO: `/v3/users/c80a7e2ae6574c6e8a4b1fc8a106b66b` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:23.057662 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa002f26-3729-43a9-aecf-06b538eea041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c80a7e2ae6574c6e8a4b1fc8a106b66b)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:23.060659 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa002f26-3729-43a9-aecf-06b538eea041 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:23.116157 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a0441-9906-4b24-9299-78b95f4c0f5d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:23.121475 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b3ab0-4708-4c15-85f4-8999ff20c186 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:23.122488 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b3ab0-4708-4c15-85f4-8999ff20c186 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:23.122488 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b3ab0-4708-4c15-85f4-8999ff20c186 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:23.122625 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b3ab0-4708-4c15-85f4-8999ff20c186 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:23.125946 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fa1b3ab0-4708-4c15-85f4-8999ff20c186 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:23.190355 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:23.232066 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-aa002f26-3729-43a9-aecf-06b538eea041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c80a7e2ae6574c6e8a4b1fc8a106b66b'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:23.238420 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-aa002f26-3729-43a9-aecf-06b538eea041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c80a7e2ae6574c6e8a4b1fc8a106b66b'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:23.250028 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b3ab0-4708-4c15-85f4-8999ff20c186 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:23.251503 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b3ab0-4708-4c15-85f4-8999ff20c186 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:23.266327 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-aa002f26-3729-43a9-aecf-06b538eea041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c80a7e2ae6574c6e8a4b1fc8a106b66b'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:23.272216 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1156/2276] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:23.274934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8630d-feb0-4a63-a704-572a063181e2 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:23.275228 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8630d-feb0-4a63-a704-572a063181e2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:23.275749 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8630d-feb0-4a63-a704-572a063181e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:23.303688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:23.314934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-aa002f26-3729-43a9-aecf-06b538eea041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c80a7e2ae6574c6e8a4b1fc8a106b66b'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:23.332319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c7b8630d-feb0-4a63-a704-572a063181e2 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:23.333778 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c7b8630d-feb0-4a63-a704-572a063181e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:23.334192 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-aa002f26-3729-43a9-aecf-06b538eea041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c80a7e2ae6574c6e8a4b1fc8a106b66b'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:23.350198 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1157/2277] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:23.352194 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1121/2278] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:22 2022] DELETE /identity/v3/users/c80a7e2ae6574c6e8a4b1fc8a106b66b => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:23.361014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d54ed7-2ab8-40de-9da2-2f79c800753b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:23.361298 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d54ed7-2ab8-40de-9da2-2f79c800753b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:23.361789 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d54ed7-2ab8-40de-9da2-2f79c800753b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:23.361936 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ceb55-8ad3-432a-8103-adf33bd85fda None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:23.363069 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ceb55-8ad3-432a-8103-adf33bd85fda None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:23.363613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ceb55-8ad3-432a-8103-adf33bd85fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:23.396215 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-4a3ceb55-8ad3-432a-8103-adf33bd85fda None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:23.397939 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4a3ceb55-8ad3-432a-8103-adf33bd85fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:23.413850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a3d54ed7-2ab8-40de-9da2-2f79c800753b None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:23.415118 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a3d54ed7-2ab8-40de-9da2-2f79c800753b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:23.494897 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1122/2279] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:23.499480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ceb55-8ad3-432a-8103-adf33bd85fda None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:23.514855 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ceb55-8ad3-432a-8103-adf33bd85fda None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:23.529343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567229c-28c3-4ec5-851f-80608433dbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:23.529964 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567229c-28c3-4ec5-851f-80608433dbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:23.530281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567229c-28c3-4ec5-851f-80608433dbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:23.530572 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567229c-28c3-4ec5-851f-80608433dbf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:23.531623 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567229c-28c3-4ec5-851f-80608433dbf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:12:23.531948 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567229c-28c3-4ec5-851f-80608433dbf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:23.535354 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567229c-28c3-4ec5-851f-80608433dbf5 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:23.557931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1123/2280] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:12:23.559097 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567229c-28c3-4ec5-851f-80608433dbf5 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:23.577745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567229c-28c3-4ec5-851f-80608433dbf5 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:23.586020 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a4ff2-51a2-4ea3-8914-592a87031c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:23.587012 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a4ff2-51a2-4ea3-8914-592a87031c99 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:23.587458 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a4ff2-51a2-4ea3-8914-592a87031c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:23.588037 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a4ff2-51a2-4ea3-8914-592a87031c99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:23.589163 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a4ff2-51a2-4ea3-8914-592a87031c99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:23.591753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a4ff2-51a2-4ea3-8914-592a87031c99 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:23.597849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1158/2281] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:23.608633 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d54ed7-2ab8-40de-9da2-2f79c800753b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:23.610078 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a3d54ed7-2ab8-40de-9da2-2f79c800753b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:23.696230 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1124/2282] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:23 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:23.700483 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a4ff2-51a2-4ea3-8914-592a87031c99 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:23.717376 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d54ed7-2ab8-40de-9da2-2f79c800753b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:23.820391 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde2d1b-7884-453a-8d41-76681aff22aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:23.821375 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde2d1b-7884-453a-8d41-76681aff22aa service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:23.821822 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde2d1b-7884-453a-8d41-76681aff22aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:23.822242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde2d1b-7884-453a-8d41-76681aff22aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:23.839750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a4ff2-51a2-4ea3-8914-592a87031c99 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:23.848568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510316f8-9248-4415-b2cd-9d3c70f5609d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:23.849542 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510316f8-9248-4415-b2cd-9d3c70f5609d admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:23.849712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510316f8-9248-4415-b2cd-9d3c70f5609d admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:23.854204 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510316f8-9248-4415-b2cd-9d3c70f5609d admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:23.855092 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510316f8-9248-4415-b2cd-9d3c70f5609d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:23.857075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510316f8-9248-4415-b2cd-9d3c70f5609d admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:23.896794 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:23.918224 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1125/2283] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:23 2022] POST /identity/v3/users => generated 291 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:23.919309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510316f8-9248-4415-b2cd-9d3c70f5609d admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:23.944384 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510316f8-9248-4415-b2cd-9d3c70f5609d admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:23.971790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcac46-1823-4461-af8f-9451367916fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:23.971790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcac46-1823-4461-af8f-9451367916fa admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:23.971790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcac46-1823-4461-af8f-9451367916fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:23.971790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcac46-1823-4461-af8f-9451367916fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:23.972319 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcac46-1823-4461-af8f-9451367916fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:23.972652 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcac46-1823-4461-af8f-9451367916fa admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:23.976779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde2d1b-7884-453a-8d41-76681aff22aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:23.978359 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde2d1b-7884-453a-8d41-76681aff22aa service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:23.994497 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1126/2284] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:24.003448 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1159/2285] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:12:24.003721 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcac46-1823-4461-af8f-9451367916fa admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:24.015701 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcac46-1823-4461-af8f-9451367916fa admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:24.022267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f21cb-a3d5-447d-9734-a42fca5e96d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:24.022949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f21cb-a3d5-447d-9734-a42fca5e96d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:24.023387 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f21cb-a3d5-447d-9734-a42fca5e96d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:24.023726 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f21cb-a3d5-447d-9734-a42fca5e96d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:24.024420 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f21cb-a3d5-447d-9734-a42fca5e96d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:24.026462 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f21cb-a3d5-447d-9734-a42fca5e96d0 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:24.041586 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1127/2286] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:24.046214 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde2d1b-7884-453a-8d41-76681aff22aa service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:24.057896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde2d1b-7884-453a-8d41-76681aff22aa service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:24.062864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19def336-fb11-440c-bdcd-f4a4e76c6b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:24.063556 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19def336-fb11-440c-bdcd-f4a4e76c6b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:24.063834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19def336-fb11-440c-bdcd-f4a4e76c6b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:24.064108 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19def336-fb11-440c-bdcd-f4a4e76c6b45 admin admin] PATH_INFO: `/v3/projects/6a7060f47a4c4a1c8da8e6e619c785c1/users/8873b5f88c504090b66ff85bb7ad74ec/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:24.086685 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19def336-fb11-440c-bdcd-f4a4e76c6b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7060f47a4c4a1c8da8e6e619c785c1, user_id=8873b5f88c504090b66ff85bb7ad74ec, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:24.090982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19def336-fb11-440c-bdcd-f4a4e76c6b45 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:24.124454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4da57f-7b15-4c05-8c00-4dd1ed6ddfb4 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:24.125704 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4da57f-7b15-4c05-8c00-4dd1ed6ddfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:24.126296 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4da57f-7b15-4c05-8c00-4dd1ed6ddfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:24.130453 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1160/2287] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:24 2022] PUT /identity/v3/projects/6a7060f47a4c4a1c8da8e6e619c785c1/users/8873b5f88c504090b66ff85bb7ad74ec/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:24.192422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-7f4da57f-7b15-4c05-8c00-4dd1ed6ddfb4 None None] MFA Rules not processed for user `8873b5f88c504090b66ff85bb7ad74ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:24.196898 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7f4da57f-7b15-4c05-8c00-4dd1ed6ddfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:24.214275 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:24.506250 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1128/2288] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:24.509061 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19def336-fb11-440c-bdcd-f4a4e76c6b45 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:24.649482 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19def336-fb11-440c-bdcd-f4a4e76c6b45 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:24.660439 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec43ef3-f840-4b20-b751-5b7f7dae3971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:24.661196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec43ef3-f840-4b20-b751-5b7f7dae3971 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:24.661564 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec43ef3-f840-4b20-b751-5b7f7dae3971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:24.661950 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec43ef3-f840-4b20-b751-5b7f7dae3971 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:24.662904 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec43ef3-f840-4b20-b751-5b7f7dae3971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:24.666053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec43ef3-f840-4b20-b751-5b7f7dae3971 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:24.715318 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4da57f-7b15-4c05-8c00-4dd1ed6ddfb4 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:24.717112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7f4da57f-7b15-4c05-8c00-4dd1ed6ddfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:24.759777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1161/2289] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:24 2022] POST /identity/v3/projects => generated 383 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:24.760897 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec43ef3-f840-4b20-b751-5b7f7dae3971 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:24.911705 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec43ef3-f840-4b20-b751-5b7f7dae3971 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:24.916623 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4da57f-7b15-4c05-8c00-4dd1ed6ddfb4 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:24.921767 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1934087-a40b-4c22-bb00-98c4d5b8dcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:24.924215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1934087-a40b-4c22-bb00-98c4d5b8dcb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:24.925537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1934087-a40b-4c22-bb00-98c4d5b8dcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:24.925537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1934087-a40b-4c22-bb00-98c4d5b8dcb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:24.926736 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1934087-a40b-4c22-bb00-98c4d5b8dcb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:24.930065 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1934087-a40b-4c22-bb00-98c4d5b8dcb9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:24.981355 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1162/2290] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:24 2022] POST /identity/v3/users => generated 298 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:24.983258 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1934087-a40b-4c22-bb00-98c4d5b8dcb9 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:24.991130 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e1934087-a40b-4c22-bb00-98c4d5b8dcb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:25.005668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1934087-a40b-4c22-bb00-98c4d5b8dcb9 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:25.010534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec07b6-b5d6-4357-b35c-0f44eb7599dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:25.011404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec07b6-b5d6-4357-b35c-0f44eb7599dd service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:25.011788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec07b6-b5d6-4357-b35c-0f44eb7599dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:25.012154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec07b6-b5d6-4357-b35c-0f44eb7599dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:25.012729 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca0d4c-457a-43f6-82cd-7fd96ebc317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:25.013883 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca0d4c-457a-43f6-82cd-7fd96ebc317d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:25.014343 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca0d4c-457a-43f6-82cd-7fd96ebc317d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:25.014445 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-46ec07b6-b5d6-4357-b35c-0f44eb7599dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:25.014894 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca0d4c-457a-43f6-82cd-7fd96ebc317d admin admin] PATH_INFO: `/v3/projects/d30efc7ff7c44f6e9ec16f07a6120a3d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:25.016546 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca0d4c-457a-43f6-82cd-7fd96ebc317d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30efc7ff7c44f6e9ec16f07a6120a3d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:25.019866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca0d4c-457a-43f6-82cd-7fd96ebc317d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:25.034386 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:25.107977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5aca0d4c-457a-43f6-82cd-7fd96ebc317d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30efc7ff7c44f6e9ec16f07a6120a3d', 'request_id': 'req-5aca0d4c-457a-43f6-82cd-7fd96ebc317d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:25.117563 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5aca0d4c-457a-43f6-82cd-7fd96ebc317d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30efc7ff7c44f6e9ec16f07a6120a3d', 'request_id': 'req-5aca0d4c-457a-43f6-82cd-7fd96ebc317d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:25.121077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec07b6-b5d6-4357-b35c-0f44eb7599dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:25.122659 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ec07b6-b5d6-4357-b35c-0f44eb7599dd service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:25.126015 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5aca0d4c-457a-43f6-82cd-7fd96ebc317d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30efc7ff7c44f6e9ec16f07a6120a3d', 'request_id': 'req-5aca0d4c-457a-43f6-82cd-7fd96ebc317d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:25.138704 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1129/2291] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:25.140167 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec07b6-b5d6-4357-b35c-0f44eb7599dd service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:25.158636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ec07b6-b5d6-4357-b35c-0f44eb7599dd service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:25.162198 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5aca0d4c-457a-43f6-82cd-7fd96ebc317d admin admin] The token cache is being invalidate because project d30efc7ff7c44f6e9ec16f07a6120a3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:25.162198 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5aca0d4c-457a-43f6-82cd-7fd96ebc317d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:25.165697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5aca0d4c-457a-43f6-82cd-7fd96ebc317d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:25.171210 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1163/2292] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:24 2022] DELETE /identity/v3/projects/d30efc7ff7c44f6e9ec16f07a6120a3d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:25.204984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:25.355284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857f5da-31cc-48ee-925b-d8a8cb2530a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:25.355284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857f5da-31cc-48ee-925b-d8a8cb2530a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:25.355284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857f5da-31cc-48ee-925b-d8a8cb2530a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:25.355881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0857f5da-31cc-48ee-925b-d8a8cb2530a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:25.356208 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857f5da-31cc-48ee-925b-d8a8cb2530a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:25.361181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0857f5da-31cc-48ee-925b-d8a8cb2530a2 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:25.395441 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1130/2293] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:25.397374 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca0d4c-457a-43f6-82cd-7fd96ebc317d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:25.399257 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5aca0d4c-457a-43f6-82cd-7fd96ebc317d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:25.432508 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca0d4c-457a-43f6-82cd-7fd96ebc317d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:25.445307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81694c02-495d-44ab-9785-2f6f1ed33cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:25.449755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81694c02-495d-44ab-9785-2f6f1ed33cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:25.451653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81694c02-495d-44ab-9785-2f6f1ed33cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:25.452430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81694c02-495d-44ab-9785-2f6f1ed33cd4 admin admin] PATH_INFO: `/v3/projects/2f8eeef4198140848c52f6e37f704cc7/users/1498f6b5f28f43d887714409e64eff39/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:25.479158 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81694c02-495d-44ab-9785-2f6f1ed33cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f8eeef4198140848c52f6e37f704cc7, user_id=1498f6b5f28f43d887714409e64eff39, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:25.482548 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81694c02-495d-44ab-9785-2f6f1ed33cd4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:25.499648 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1164/2294] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:25 2022] PUT /identity/v3/projects/2f8eeef4198140848c52f6e37f704cc7/users/1498f6b5f28f43d887714409e64eff39/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:25.505135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857f5da-31cc-48ee-925b-d8a8cb2530a2 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:25.520251 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0857f5da-31cc-48ee-925b-d8a8cb2530a2 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:25.609726 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a64eb67-ef4c-47f4-8578-61268c225bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:25.611021 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64eb67-ef4c-47f4-8578-61268c225bfd admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:25.611536 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64eb67-ef4c-47f4-8578-61268c225bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:25.612698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a64eb67-ef4c-47f4-8578-61268c225bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:25.614096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64eb67-ef4c-47f4-8578-61268c225bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:25.616505 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a64eb67-ef4c-47f4-8578-61268c225bfd admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:25.631066 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1131/2295] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:25.635332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81694c02-495d-44ab-9785-2f6f1ed33cd4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:25.653793 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81694c02-495d-44ab-9785-2f6f1ed33cd4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:25.666363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a354e-e945-458b-9708-8743022c0509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:25.667394 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a354e-e945-458b-9708-8743022c0509 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:25.668341 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a354e-e945-458b-9708-8743022c0509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:25.668453 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a354e-e945-458b-9708-8743022c0509 admin admin] PATH_INFO: `/v3/projects/2f8eeef4198140848c52f6e37f704cc7/users/1498f6b5f28f43d887714409e64eff39/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:25.671585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a354e-e945-458b-9708-8743022c0509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f8eeef4198140848c52f6e37f704cc7, user_id=1498f6b5f28f43d887714409e64eff39, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:25.677596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a354e-e945-458b-9708-8743022c0509 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:25.692893 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1165/2296] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:25 2022] PUT /identity/v3/projects/2f8eeef4198140848c52f6e37f704cc7/users/1498f6b5f28f43d887714409e64eff39/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:25.702908 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c9da9-18c4-40d1-b94e-10bbc5562911 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:25.703003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c9da9-18c4-40d1-b94e-10bbc5562911 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:25.703317 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c9da9-18c4-40d1-b94e-10bbc5562911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:25.739756 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-af5c9da9-18c4-40d1-b94e-10bbc5562911 None None] MFA Rules not processed for user `1498f6b5f28f43d887714409e64eff39`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:25.740207 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-af5c9da9-18c4-40d1-b94e-10bbc5562911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:25.875294 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1132/2297] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:25.887498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a354e-e945-458b-9708-8743022c0509 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:25.890545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-143a354e-e945-458b-9708-8743022c0509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:26.006897 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a354e-e945-458b-9708-8743022c0509 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:26.013806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec51bd6-cd69-4bd8-bae1-00f31d2af619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:26.020040 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec51bd6-cd69-4bd8-bae1-00f31d2af619 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:26.020648 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec51bd6-cd69-4bd8-bae1-00f31d2af619 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:26.021320 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec51bd6-cd69-4bd8-bae1-00f31d2af619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:26.042653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec51bd6-cd69-4bd8-bae1-00f31d2af619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:26.044059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec51bd6-cd69-4bd8-bae1-00f31d2af619 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:26.082207 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1166/2298] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:12:26.237228 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c9da9-18c4-40d1-b94e-10bbc5562911 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:26.263606 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c9da9-18c4-40d1-b94e-10bbc5562911 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:26.269931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfd5db-aee2-4f7f-b459-e94fe33d01c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:26.271612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfd5db-aee2-4f7f-b459-e94fe33d01c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:26.272960 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfd5db-aee2-4f7f-b459-e94fe33d01c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:26.272960 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfd5db-aee2-4f7f-b459-e94fe33d01c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:26.275463 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-5bbfd5db-aee2-4f7f-b459-e94fe33d01c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:26.365895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:26.435846 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfd5db-aee2-4f7f-b459-e94fe33d01c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:26.438989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfd5db-aee2-4f7f-b459-e94fe33d01c6 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:26.452077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1133/2299] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:26.970579 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6392fa-9a8c-4a5a-aacd-b8b4b74e540f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:26.972680 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6392fa-9a8c-4a5a-aacd-b8b4b74e540f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:26.973165 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6392fa-9a8c-4a5a-aacd-b8b4b74e540f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:27.029171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0f6392fa-9a8c-4a5a-aacd-b8b4b74e540f None None] MFA Rules not processed for user `7511e2f8a2c24c92be08dc5056bac4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:27.030780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0f6392fa-9a8c-4a5a-aacd-b8b4b74e540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:27.125652 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:27.138540 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1167/2300] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:27.150675 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95648e-3655-4d21-9c7a-d0dee1ee2b4a None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:27.150977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95648e-3655-4d21-9c7a-d0dee1ee2b4a None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:27.151253 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95648e-3655-4d21-9c7a-d0dee1ee2b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:27.172172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-2c95648e-3655-4d21-9c7a-d0dee1ee2b4a None None] MFA Rules not processed for user `7511e2f8a2c24c92be08dc5056bac4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:27.173441 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2c95648e-3655-4d21-9c7a-d0dee1ee2b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:27.181312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1134/2301] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:27.192864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6392fa-9a8c-4a5a-aacd-b8b4b74e540f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:27.194426 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0f6392fa-9a8c-4a5a-aacd-b8b4b74e540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:27.281365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6392fa-9a8c-4a5a-aacd-b8b4b74e540f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:27.287793 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53792bea-2f2f-44a8-8170-a7667c330cec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:27.288417 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53792bea-2f2f-44a8-8170-a7667c330cec service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:27.288752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53792bea-2f2f-44a8-8170-a7667c330cec service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:27.289025 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53792bea-2f2f-44a8-8170-a7667c330cec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:27.298388 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53792bea-2f2f-44a8-8170-a7667c330cec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:27.300160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53792bea-2f2f-44a8-8170-a7667c330cec service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:27.310385 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1168/2302] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:29.314710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95648e-3655-4d21-9c7a-d0dee1ee2b4a None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:29.383707 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c95648e-3655-4d21-9c7a-d0dee1ee2b4a None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:29.388447 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509e233-0229-446e-8c6f-a40571316534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:29.389132 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509e233-0229-446e-8c6f-a40571316534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:29.389444 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509e233-0229-446e-8c6f-a40571316534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:29.389686 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509e233-0229-446e-8c6f-a40571316534 admin admin] PATH_INFO: `/v3/users/8873b5f88c504090b66ff85bb7ad74ec` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:29.390858 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509e233-0229-446e-8c6f-a40571316534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8873b5f88c504090b66ff85bb7ad74ec)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:29.392823 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509e233-0229-446e-8c6f-a40571316534 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:29.469790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-7509e233-0229-446e-8c6f-a40571316534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8873b5f88c504090b66ff85bb7ad74ec'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:29.470469 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-7509e233-0229-446e-8c6f-a40571316534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8873b5f88c504090b66ff85bb7ad74ec'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:29.484160 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-7509e233-0229-446e-8c6f-a40571316534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8873b5f88c504090b66ff85bb7ad74ec'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:29.493845 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-7509e233-0229-446e-8c6f-a40571316534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8873b5f88c504090b66ff85bb7ad74ec'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:29.494721 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-7509e233-0229-446e-8c6f-a40571316534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8873b5f88c504090b66ff85bb7ad74ec'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:29.511693 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1135/2303] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:29 2022] DELETE /identity/v3/users/8873b5f88c504090b66ff85bb7ad74ec => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:29.517524 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9494cdc-8159-4201-adc0-8232e4a5a0f3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:29.518531 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9494cdc-8159-4201-adc0-8232e4a5a0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:29.519243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9494cdc-8159-4201-adc0-8232e4a5a0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:29.544893 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f9494cdc-8159-4201-adc0-8232e4a5a0f3 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:29.546500 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f9494cdc-8159-4201-adc0-8232e4a5a0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:29.580850 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509e233-0229-446e-8c6f-a40571316534 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:29.582495 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7509e233-0229-446e-8c6f-a40571316534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:29.662339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1169/2304] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:29.673102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9494cdc-8159-4201-adc0-8232e4a5a0f3 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:29.674906 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f9494cdc-8159-4201-adc0-8232e4a5a0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:29.689768 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:29.719389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509e233-0229-446e-8c6f-a40571316534 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:29.726214 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06695443-2dab-4771-8908-973c8ca76e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:29.727557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06695443-2dab-4771-8908-973c8ca76e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:29.727855 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06695443-2dab-4771-8908-973c8ca76e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:29.728133 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06695443-2dab-4771-8908-973c8ca76e56 admin admin] PATH_INFO: `/v3/users/d1e24b48318e44abbdbe2f7cb03b5b13` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:29.730131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06695443-2dab-4771-8908-973c8ca76e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e24b48318e44abbdbe2f7cb03b5b13)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:29.732743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06695443-2dab-4771-8908-973c8ca76e56 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:29.793601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9494cdc-8159-4201-adc0-8232e4a5a0f3 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:29.800979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b3ee4-8a9d-40fa-a8f5-7863423f7c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:29.802168 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b3ee4-8a9d-40fa-a8f5-7863423f7c68 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:29.802291 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-06695443-2dab-4771-8908-973c8ca76e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e24b48318e44abbdbe2f7cb03b5b13'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:29.802640 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b3ee4-8a9d-40fa-a8f5-7863423f7c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:29.803316 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b3ee4-8a9d-40fa-a8f5-7863423f7c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:29.803447 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-06695443-2dab-4771-8908-973c8ca76e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e24b48318e44abbdbe2f7cb03b5b13'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:29.820906 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b3ee4-8a9d-40fa-a8f5-7863423f7c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:29.823481 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b3ee4-8a9d-40fa-a8f5-7863423f7c68 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:29.830619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-06695443-2dab-4771-8908-973c8ca76e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e24b48318e44abbdbe2f7cb03b5b13'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:29.848067 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-06695443-2dab-4771-8908-973c8ca76e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e24b48318e44abbdbe2f7cb03b5b13'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:29.848995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-06695443-2dab-4771-8908-973c8ca76e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e24b48318e44abbdbe2f7cb03b5b13'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:29.858237 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1170/2305] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:29.873703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1136/2306] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:29 2022] DELETE /identity/v3/users/d1e24b48318e44abbdbe2f7cb03b5b13 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:29.878798 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f20088-8367-457c-b8a8-af583fd7e19d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:29.879330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f20088-8367-457c-b8a8-af583fd7e19d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:29.879609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f20088-8367-457c-b8a8-af583fd7e19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:29.902037 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-58f20088-8367-457c-b8a8-af583fd7e19d None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:29.903663 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-58f20088-8367-457c-b8a8-af583fd7e19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:29.926865 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:29.996388 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1171/2307] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:30.008073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06695443-2dab-4771-8908-973c8ca76e56 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:30.009758 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-06695443-2dab-4771-8908-973c8ca76e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:30.134641 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06695443-2dab-4771-8908-973c8ca76e56 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:30.141988 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52146b0-577e-4e48-bdd8-ebd51f422d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:30.142679 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52146b0-577e-4e48-bdd8-ebd51f422d8d service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:30.142988 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52146b0-577e-4e48-bdd8-ebd51f422d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:30.143889 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52146b0-577e-4e48-bdd8-ebd51f422d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:30.158789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52146b0-577e-4e48-bdd8-ebd51f422d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:30.160996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52146b0-577e-4e48-bdd8-ebd51f422d8d service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:30.175321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1137/2308] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:30.359818 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f20088-8367-457c-b8a8-af583fd7e19d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:30.365889 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-58f20088-8367-457c-b8a8-af583fd7e19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:30.412439 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f20088-8367-457c-b8a8-af583fd7e19d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:30.429447 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68992f84-610e-44dc-9508-957906151b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:30.430401 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68992f84-610e-44dc-9508-957906151b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:30.430881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68992f84-610e-44dc-9508-957906151b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:30.431405 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68992f84-610e-44dc-9508-957906151b3d admin admin] PATH_INFO: `/v3/projects/6a7060f47a4c4a1c8da8e6e619c785c1` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:30.432659 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68992f84-610e-44dc-9508-957906151b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a7060f47a4c4a1c8da8e6e619c785c1)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:30.434681 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68992f84-610e-44dc-9508-957906151b3d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:30.577126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-68992f84-610e-44dc-9508-957906151b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a7060f47a4c4a1c8da8e6e619c785c1', 'request_id': 'req-68992f84-610e-44dc-9508-957906151b3d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:30.589655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-68992f84-610e-44dc-9508-957906151b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a7060f47a4c4a1c8da8e6e619c785c1', 'request_id': 'req-68992f84-610e-44dc-9508-957906151b3d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:30.599392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-68992f84-610e-44dc-9508-957906151b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a7060f47a4c4a1c8da8e6e619c785c1', 'request_id': 'req-68992f84-610e-44dc-9508-957906151b3d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:30.626656 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-68992f84-610e-44dc-9508-957906151b3d admin admin] The token cache is being invalidate because project 6a7060f47a4c4a1c8da8e6e619c785c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:30.628595 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-68992f84-610e-44dc-9508-957906151b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:30.629297 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-68992f84-610e-44dc-9508-957906151b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:30.632227 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1172/2309] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:30 2022] DELETE /identity/v3/projects/6a7060f47a4c4a1c8da8e6e619c785c1 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:30.636338 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52146b0-577e-4e48-bdd8-ebd51f422d8d service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:30.648269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68992f84-610e-44dc-9508-957906151b3d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:30.650608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-68992f84-610e-44dc-9508-957906151b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:30.651536 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52146b0-577e-4e48-bdd8-ebd51f422d8d service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:30.746937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980c713-1637-4777-bab3-d93eb9d7140d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:30.747851 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980c713-1637-4777-bab3-d93eb9d7140d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:30.748229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980c713-1637-4777-bab3-d93eb9d7140d admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:30.748636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980c713-1637-4777-bab3-d93eb9d7140d admin admin] PATH_INFO: `/v3/users/1498f6b5f28f43d887714409e64eff39` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:30.749930 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980c713-1637-4777-bab3-d93eb9d7140d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1498f6b5f28f43d887714409e64eff39)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:30.753326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980c713-1637-4777-bab3-d93eb9d7140d admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:30.758865 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68992f84-610e-44dc-9508-957906151b3d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:30.764066 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e86ee-fd6f-404b-96d3-b6da6597fa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:30.764908 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e86ee-fd6f-404b-96d3-b6da6597fa5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:30.765477 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e86ee-fd6f-404b-96d3-b6da6597fa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:30.765937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e86ee-fd6f-404b-96d3-b6da6597fa5a admin admin] PATH_INFO: `/v3/projects/877d8413923b449799ebcbc13db3327b` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:30.767529 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e86ee-fd6f-404b-96d3-b6da6597fa5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=877d8413923b449799ebcbc13db3327b)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:30.770257 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e86ee-fd6f-404b-96d3-b6da6597fa5a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:30.770548 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:30.834558 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:30.835881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-740e86ee-fd6f-404b-96d3-b6da6597fa5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '877d8413923b449799ebcbc13db3327b', 'request_id': 'req-740e86ee-fd6f-404b-96d3-b6da6597fa5a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:30.846281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f980c713-1637-4777-bab3-d93eb9d7140d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1498f6b5f28f43d887714409e64eff39'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:30.847912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-740e86ee-fd6f-404b-96d3-b6da6597fa5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '877d8413923b449799ebcbc13db3327b', 'request_id': 'req-740e86ee-fd6f-404b-96d3-b6da6597fa5a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:30.848065 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f980c713-1637-4777-bab3-d93eb9d7140d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1498f6b5f28f43d887714409e64eff39'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:30.867048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-740e86ee-fd6f-404b-96d3-b6da6597fa5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '877d8413923b449799ebcbc13db3327b', 'request_id': 'req-740e86ee-fd6f-404b-96d3-b6da6597fa5a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:30.892430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-740e86ee-fd6f-404b-96d3-b6da6597fa5a admin admin] The token cache is being invalidate because project 877d8413923b449799ebcbc13db3327b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:30.893020 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-740e86ee-fd6f-404b-96d3-b6da6597fa5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:30.894959 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-740e86ee-fd6f-404b-96d3-b6da6597fa5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:30.900023 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f980c713-1637-4777-bab3-d93eb9d7140d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1498f6b5f28f43d887714409e64eff39'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:30.900488 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1173/2310] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:30 2022] DELETE /identity/v3/projects/877d8413923b449799ebcbc13db3327b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:30.901443 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e86ee-fd6f-404b-96d3-b6da6597fa5a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:30.903680 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-740e86ee-fd6f-404b-96d3-b6da6597fa5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:30.910428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f980c713-1637-4777-bab3-d93eb9d7140d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1498f6b5f28f43d887714409e64eff39'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:30.911131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f980c713-1637-4777-bab3-d93eb9d7140d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1498f6b5f28f43d887714409e64eff39'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:30.928523 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1138/2311] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:30 2022] DELETE /identity/v3/users/1498f6b5f28f43d887714409e64eff39 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:30.991703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e86ee-fd6f-404b-96d3-b6da6597fa5a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:31.067996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de33ac-20f2-41ee-a7cb-64d26c16b056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:31.068695 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de33ac-20f2-41ee-a7cb-64d26c16b056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:31.068977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de33ac-20f2-41ee-a7cb-64d26c16b056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:31.069440 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de33ac-20f2-41ee-a7cb-64d26c16b056 admin admin] PATH_INFO: `/v3/users/12d278835c5c4ff7ad8b85979d40c35d` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:31.070682 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de33ac-20f2-41ee-a7cb-64d26c16b056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d278835c5c4ff7ad8b85979d40c35d)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:31.072744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de33ac-20f2-41ee-a7cb-64d26c16b056 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:31.159612 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e3de33ac-20f2-41ee-a7cb-64d26c16b056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d278835c5c4ff7ad8b85979d40c35d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:31.160798 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e3de33ac-20f2-41ee-a7cb-64d26c16b056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d278835c5c4ff7ad8b85979d40c35d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:31.173003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e3de33ac-20f2-41ee-a7cb-64d26c16b056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d278835c5c4ff7ad8b85979d40c35d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:31.190519 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e3de33ac-20f2-41ee-a7cb-64d26c16b056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d278835c5c4ff7ad8b85979d40c35d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:31.202133 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e3de33ac-20f2-41ee-a7cb-64d26c16b056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d278835c5c4ff7ad8b85979d40c35d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:31.214356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1174/2312] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:30 2022] DELETE /identity/v3/users/12d278835c5c4ff7ad8b85979d40c35d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:31.334904 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980c713-1637-4777-bab3-d93eb9d7140d admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:31.338861 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f980c713-1637-4777-bab3-d93eb9d7140d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:31.360923 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980c713-1637-4777-bab3-d93eb9d7140d admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:31.477668 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fa507-484c-4bf5-844a-783c3b7c876d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:31.478641 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fa507-484c-4bf5-844a-783c3b7c876d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:31.478934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fa507-484c-4bf5-844a-783c3b7c876d admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:31.479215 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fa507-484c-4bf5-844a-783c3b7c876d admin admin] PATH_INFO: `/v3/projects/2f8eeef4198140848c52f6e37f704cc7` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:31.489496 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fa507-484c-4bf5-844a-783c3b7c876d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f8eeef4198140848c52f6e37f704cc7)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:31.491850 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fa507-484c-4bf5-844a-783c3b7c876d admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:31.553710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a22fa507-484c-4bf5-844a-783c3b7c876d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f8eeef4198140848c52f6e37f704cc7', 'request_id': 'req-a22fa507-484c-4bf5-844a-783c3b7c876d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:31.560027 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a22fa507-484c-4bf5-844a-783c3b7c876d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f8eeef4198140848c52f6e37f704cc7', 'request_id': 'req-a22fa507-484c-4bf5-844a-783c3b7c876d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:31.568873 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a22fa507-484c-4bf5-844a-783c3b7c876d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f8eeef4198140848c52f6e37f704cc7', 'request_id': 'req-a22fa507-484c-4bf5-844a-783c3b7c876d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:31.597939 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a22fa507-484c-4bf5-844a-783c3b7c876d admin admin] The token cache is being invalidate because project 2f8eeef4198140848c52f6e37f704cc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:31.599570 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a22fa507-484c-4bf5-844a-783c3b7c876d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:31.601268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a22fa507-484c-4bf5-844a-783c3b7c876d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:31.605280 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1139/2313] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:31 2022] DELETE /identity/v3/projects/2f8eeef4198140848c52f6e37f704cc7 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:31.613287 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c66be-81ce-49f5-b939-6c43e1234481 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:31.613777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c66be-81ce-49f5-b939-6c43e1234481 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:31.613777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c66be-81ce-49f5-b939-6c43e1234481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:31.629805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:31.669756 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-378c66be-81ce-49f5-b939-6c43e1234481 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:31.671068 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-378c66be-81ce-49f5-b939-6c43e1234481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:31.704373 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fa507-484c-4bf5-844a-783c3b7c876d admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:31.707217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a22fa507-484c-4bf5-844a-783c3b7c876d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:31.751879 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:31.821866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1175/2314] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:31.824315 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d994f3-d4e8-4292-ba95-5c01f2575436 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:31.824751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d994f3-d4e8-4292-ba95-5c01f2575436 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:31.825132 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d994f3-d4e8-4292-ba95-5c01f2575436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:31.874781 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-61d994f3-d4e8-4292-ba95-5c01f2575436 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:31.876122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-61d994f3-d4e8-4292-ba95-5c01f2575436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:31.892258 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1176/2315] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:31.893907 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d994f3-d4e8-4292-ba95-5c01f2575436 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:31.895893 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fa507-484c-4bf5-844a-783c3b7c876d admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:31.904390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d994f3-d4e8-4292-ba95-5c01f2575436 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:31.905673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990b3bc-8735-43bc-8ad7-d01feaceee25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:31.906651 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990b3bc-8735-43bc-8ad7-d01feaceee25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:31.907065 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990b3bc-8735-43bc-8ad7-d01feaceee25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:31.907485 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990b3bc-8735-43bc-8ad7-d01feaceee25 admin admin] PATH_INFO: `/v3/projects/39f595698c4d486abe9f757d14441af7` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:31.909074 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990b3bc-8735-43bc-8ad7-d01feaceee25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f595698c4d486abe9f757d14441af7)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:31.910951 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0979c-bb91-4623-94ba-f216fef9b468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:31.911705 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0979c-bb91-4623-94ba-f216fef9b468 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:31.912230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0979c-bb91-4623-94ba-f216fef9b468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:31.912346 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990b3bc-8735-43bc-8ad7-d01feaceee25 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:31.912725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0979c-bb91-4623-94ba-f216fef9b468 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:31.913544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0979c-bb91-4623-94ba-f216fef9b468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:12:31.914144 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0979c-bb91-4623-94ba-f216fef9b468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:31.916611 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0979c-bb91-4623-94ba-f216fef9b468 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:31.938308 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1177/2316] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:12:31.944877 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0979c-bb91-4623-94ba-f216fef9b468 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:31.962780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0979c-bb91-4623-94ba-f216fef9b468 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:31.975668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b02e5b-77b0-4b7c-a78d-cc1ccf30ee03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:31.976363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b02e5b-77b0-4b7c-a78d-cc1ccf30ee03 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:31.976607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b02e5b-77b0-4b7c-a78d-cc1ccf30ee03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:31.976888 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b02e5b-77b0-4b7c-a78d-cc1ccf30ee03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:31.977569 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b02e5b-77b0-4b7c-a78d-cc1ccf30ee03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:31.979506 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b02e5b-77b0-4b7c-a78d-cc1ccf30ee03 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:31.989214 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3990b3bc-8735-43bc-8ad7-d01feaceee25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f595698c4d486abe9f757d14441af7', 'request_id': 'req-3990b3bc-8735-43bc-8ad7-d01feaceee25'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:32.000740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3990b3bc-8735-43bc-8ad7-d01feaceee25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f595698c4d486abe9f757d14441af7', 'request_id': 'req-3990b3bc-8735-43bc-8ad7-d01feaceee25'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:32.012518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3990b3bc-8735-43bc-8ad7-d01feaceee25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f595698c4d486abe9f757d14441af7', 'request_id': 'req-3990b3bc-8735-43bc-8ad7-d01feaceee25'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:32.020511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1178/2317] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:31 2022] POST /identity/v3/projects => generated 365 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:32.024748 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b02e5b-77b0-4b7c-a78d-cc1ccf30ee03 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:32.040484 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3990b3bc-8735-43bc-8ad7-d01feaceee25 admin admin] The token cache is being invalidate because project 39f595698c4d486abe9f757d14441af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:32.040484 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3990b3bc-8735-43bc-8ad7-d01feaceee25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:32.042032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3990b3bc-8735-43bc-8ad7-d01feaceee25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:32.046164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1140/2318] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:31 2022] DELETE /identity/v3/projects/39f595698c4d486abe9f757d14441af7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:32.050457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990b3bc-8735-43bc-8ad7-d01feaceee25 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:32.052504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-3990b3bc-8735-43bc-8ad7-d01feaceee25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:32.120202 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b02e5b-77b0-4b7c-a78d-cc1ccf30ee03 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:32.129121 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee5d90-b23d-4e3f-be3c-28ad06847611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:32.130382 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee5d90-b23d-4e3f-be3c-28ad06847611 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:32.131333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee5d90-b23d-4e3f-be3c-28ad06847611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:32.131838 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee5d90-b23d-4e3f-be3c-28ad06847611 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:32.133240 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee5d90-b23d-4e3f-be3c-28ad06847611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:32.136890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee5d90-b23d-4e3f-be3c-28ad06847611 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:32.149133 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990b3bc-8735-43bc-8ad7-d01feaceee25 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:32.156673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00496375-45f6-4ced-a825-3e6a0a0a39ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:32.158469 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496375-45f6-4ced-a825-3e6a0a0a39ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:32.158916 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496375-45f6-4ced-a825-3e6a0a0a39ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:32.159298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00496375-45f6-4ced-a825-3e6a0a0a39ec admin admin] PATH_INFO: `/v3/users/977c3912ddc146efad9c09290afcae5e` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:32.161699 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00496375-45f6-4ced-a825-3e6a0a0a39ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=977c3912ddc146efad9c09290afcae5e)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:32.164279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00496375-45f6-4ced-a825-3e6a0a0a39ec admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:32.173985 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1179/2319] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:32 2022] POST /identity/v3/users => generated 283 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:32.179927 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee5d90-b23d-4e3f-be3c-28ad06847611 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:32.182907 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4bee5d90-b23d-4e3f-be3c-28ad06847611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:32.201839 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee5d90-b23d-4e3f-be3c-28ad06847611 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:32.208816 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35db236-15a6-44e2-9c6d-e0a2616e1202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:32.209664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35db236-15a6-44e2-9c6d-e0a2616e1202 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:32.209974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35db236-15a6-44e2-9c6d-e0a2616e1202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:32.210321 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35db236-15a6-44e2-9c6d-e0a2616e1202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:32.211261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35db236-15a6-44e2-9c6d-e0a2616e1202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:32.213348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35db236-15a6-44e2-9c6d-e0a2616e1202 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:32.226528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1180/2320] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:12:32.230798 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35db236-15a6-44e2-9c6d-e0a2616e1202 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:32.231231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:32.234181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-00496375-45f6-4ced-a825-3e6a0a0a39ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '977c3912ddc146efad9c09290afcae5e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:32.235602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-00496375-45f6-4ced-a825-3e6a0a0a39ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '977c3912ddc146efad9c09290afcae5e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:32.243222 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35db236-15a6-44e2-9c6d-e0a2616e1202 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:32.248422 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19696b-0b02-4266-9e0d-65dbc3608a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:32.249131 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19696b-0b02-4266-9e0d-65dbc3608a35 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:32.249414 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19696b-0b02-4266-9e0d-65dbc3608a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:32.249691 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f19696b-0b02-4266-9e0d-65dbc3608a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:32.250456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19696b-0b02-4266-9e0d-65dbc3608a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:32.252275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f19696b-0b02-4266-9e0d-65dbc3608a35 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:32.256969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-00496375-45f6-4ced-a825-3e6a0a0a39ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '977c3912ddc146efad9c09290afcae5e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:32.265399 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-00496375-45f6-4ced-a825-3e6a0a0a39ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '977c3912ddc146efad9c09290afcae5e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:32.265886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1181/2321] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:32.266149 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-00496375-45f6-4ced-a825-3e6a0a0a39ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '977c3912ddc146efad9c09290afcae5e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:32.271079 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19696b-0b02-4266-9e0d-65dbc3608a35 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:32.273326 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6f19696b-0b02-4266-9e0d-65dbc3608a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:32.286403 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1141/2322] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:32 2022] DELETE /identity/v3/users/977c3912ddc146efad9c09290afcae5e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:32.290578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f19696b-0b02-4266-9e0d-65dbc3608a35 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:32.326885 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:32.371866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47b9b7-30c7-4559-9ae9-a922c332d529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:32.372895 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47b9b7-30c7-4559-9ae9-a922c332d529 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:32.373372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47b9b7-30c7-4559-9ae9-a922c332d529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:32.373873 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47b9b7-30c7-4559-9ae9-a922c332d529 admin admin] PATH_INFO: `/v3/projects/6aac2308850e44fda909a926d90a6339/users/816c60aa9adb469ca926fca0d9807608/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:32.398719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47b9b7-30c7-4559-9ae9-a922c332d529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aac2308850e44fda909a926d90a6339, user_id=816c60aa9adb469ca926fca0d9807608, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:32.402946 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47b9b7-30c7-4559-9ae9-a922c332d529 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:32.423162 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1182/2323] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:32 2022] PUT /identity/v3/projects/6aac2308850e44fda909a926d90a6339/users/816c60aa9adb469ca926fca0d9807608/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:32.433923 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c6e46-0b44-458a-b372-3b6c2c2eb9b2 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:32.434217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c6e46-0b44-458a-b372-3b6c2c2eb9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:32.434500 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c6e46-0b44-458a-b372-3b6c2c2eb9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:32.474346 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-595c6e46-0b44-458a-b372-3b6c2c2eb9b2 None None] MFA Rules not processed for user `816c60aa9adb469ca926fca0d9807608`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:32.475638 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-595c6e46-0b44-458a-b372-3b6c2c2eb9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:32.554757 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1142/2324] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:32.559486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47b9b7-30c7-4559-9ae9-a922c332d529 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:32.604264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c6e46-0b44-458a-b372-3b6c2c2eb9b2 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:32.606345 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-595c6e46-0b44-458a-b372-3b6c2c2eb9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:32.635594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47b9b7-30c7-4559-9ae9-a922c332d529 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:32.640688 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06782dc9-fc13-4e8c-a6b9-bef09bb18cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:32.641328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06782dc9-fc13-4e8c-a6b9-bef09bb18cde admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:32.641594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06782dc9-fc13-4e8c-a6b9-bef09bb18cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:32.641872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06782dc9-fc13-4e8c-a6b9-bef09bb18cde admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:32.642563 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06782dc9-fc13-4e8c-a6b9-bef09bb18cde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:32.645222 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06782dc9-fc13-4e8c-a6b9-bef09bb18cde admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:32.679156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1183/2325] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:32 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:32.680198 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06782dc9-fc13-4e8c-a6b9-bef09bb18cde admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:32.687157 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c6e46-0b44-458a-b372-3b6c2c2eb9b2 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:32.759428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c94145-3e53-4bf8-8508-281d40692d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:32.760086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c94145-3e53-4bf8-8508-281d40692d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:32.760417 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c94145-3e53-4bf8-8508-281d40692d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:32.760844 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c94145-3e53-4bf8-8508-281d40692d49 admin admin] PATH_INFO: `/v3/projects/df642956bbe04c038b83faecf7b24572` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:32.762090 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c94145-3e53-4bf8-8508-281d40692d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df642956bbe04c038b83faecf7b24572)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:32.764121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c94145-3e53-4bf8-8508-281d40692d49 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:32.765832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:32.768946 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06782dc9-fc13-4e8c-a6b9-bef09bb18cde admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:32.775271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba08c5-24fe-4d0e-91bc-3bbd14d94b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:32.775906 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba08c5-24fe-4d0e-91bc-3bbd14d94b7e admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:32.776184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba08c5-24fe-4d0e-91bc-3bbd14d94b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:32.776648 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba08c5-24fe-4d0e-91bc-3bbd14d94b7e admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:32.777330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba08c5-24fe-4d0e-91bc-3bbd14d94b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:32.779515 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba08c5-24fe-4d0e-91bc-3bbd14d94b7e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:32.803250 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1184/2326] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:32 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:12:32.807371 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba08c5-24fe-4d0e-91bc-3bbd14d94b7e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:32.817212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f8c94145-3e53-4bf8-8508-281d40692d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df642956bbe04c038b83faecf7b24572', 'request_id': 'req-f8c94145-3e53-4bf8-8508-281d40692d49'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:32.818600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba08c5-24fe-4d0e-91bc-3bbd14d94b7e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:32.823287 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f8c94145-3e53-4bf8-8508-281d40692d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df642956bbe04c038b83faecf7b24572', 'request_id': 'req-f8c94145-3e53-4bf8-8508-281d40692d49'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:32.839379 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f8c94145-3e53-4bf8-8508-281d40692d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df642956bbe04c038b83faecf7b24572', 'request_id': 'req-f8c94145-3e53-4bf8-8508-281d40692d49'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:32.849261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:32.853391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f8c94145-3e53-4bf8-8508-281d40692d49 admin admin] The token cache is being invalidate because project df642956bbe04c038b83faecf7b24572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:32.853695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f8c94145-3e53-4bf8-8508-281d40692d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:32.854559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f8c94145-3e53-4bf8-8508-281d40692d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:32.856289 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1143/2327] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:32 2022] DELETE /identity/v3/projects/df642956bbe04c038b83faecf7b24572 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:32.861253 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6037e1-1f83-44f0-9b55-7c28ecaf1c9f None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:32.861543 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6037e1-1f83-44f0-9b55-7c28ecaf1c9f None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:32.861954 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6037e1-1f83-44f0-9b55-7c28ecaf1c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:32.885432 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-ba6037e1-1f83-44f0-9b55-7c28ecaf1c9f None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:32.886071 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ba6037e1-1f83-44f0-9b55-7c28ecaf1c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:32.890990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5eec21-8fbf-44b3-b693-2df3bbb8c561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:32.891670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5eec21-8fbf-44b3-b693-2df3bbb8c561 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:32.891951 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5eec21-8fbf-44b3-b693-2df3bbb8c561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:32.892255 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5eec21-8fbf-44b3-b693-2df3bbb8c561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:32.893173 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5eec21-8fbf-44b3-b693-2df3bbb8c561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:32.895537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5eec21-8fbf-44b3-b693-2df3bbb8c561 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:32.895676 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1144/2328] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:12:32.903839 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3148eb3-6c5a-48ab-b367-79e7db018a7a None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:32.904506 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3148eb3-6c5a-48ab-b367-79e7db018a7a None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:32.904506 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3148eb3-6c5a-48ab-b367-79e7db018a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:32.909274 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1185/2329] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:12:32.913975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5eec21-8fbf-44b3-b693-2df3bbb8c561 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:32.915880 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4f5eec21-8fbf-44b3-b693-2df3bbb8c561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:32.925635 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-a3148eb3-6c5a-48ab-b367-79e7db018a7a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:32.926829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a3148eb3-6c5a-48ab-b367-79e7db018a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:32.934947 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1145/2330] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:12:32.937405 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5eec21-8fbf-44b3-b693-2df3bbb8c561 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:32.939211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3148eb3-6c5a-48ab-b367-79e7db018a7a None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:32.943650 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaae97-9788-408a-bbc7-094792e1401a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:32.944325 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaae97-9788-408a-bbc7-094792e1401a admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:32.944636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaae97-9788-408a-bbc7-094792e1401a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:32.944924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaae97-9788-408a-bbc7-094792e1401a admin admin] PATH_INFO: `/v3/projects/083978ba8c404e46988186457bfa6d53/users/4a2e2919cc854c949fa8546884fb1a7f/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:32.949929 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3148eb3-6c5a-48ab-b367-79e7db018a7a None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:32.954772 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f8cd8-e6fa-447d-bdcd-aade85f99e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:32.955382 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f8cd8-e6fa-447d-bdcd-aade85f99e8b admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:32.956712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f8cd8-e6fa-447d-bdcd-aade85f99e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:32.957230 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f8cd8-e6fa-447d-bdcd-aade85f99e8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:32.957959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f8cd8-e6fa-447d-bdcd-aade85f99e8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:12:32.958276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f8cd8-e6fa-447d-bdcd-aade85f99e8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:32.960085 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f8cd8-e6fa-447d-bdcd-aade85f99e8b admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:32.965000 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaaae97-9788-408a-bbc7-094792e1401a admin admin] RBAC: Authorizing `identity:create_grant(project_id=083978ba8c404e46988186457bfa6d53, user_id=4a2e2919cc854c949fa8546884fb1a7f, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:32.968039 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaaae97-9788-408a-bbc7-094792e1401a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:32.975580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1146/2331] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 10:12:32.980123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f8cd8-e6fa-447d-bdcd-aade85f99e8b admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:32.983161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1186/2332] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:32 2022] PUT /identity/v3/projects/083978ba8c404e46988186457bfa6d53/users/4a2e2919cc854c949fa8546884fb1a7f/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:32.988410 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaae97-9788-408a-bbc7-094792e1401a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:32.991770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f8cd8-e6fa-447d-bdcd-aade85f99e8b admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:33.060033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e81ee2-dad9-4c06-8855-f5a6a05785dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:33.060709 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e81ee2-dad9-4c06-8855-f5a6a05785dd admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:33.061014 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e81ee2-dad9-4c06-8855-f5a6a05785dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:33.061288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e81ee2-dad9-4c06-8855-f5a6a05785dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:33.062141 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e81ee2-dad9-4c06-8855-f5a6a05785dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:33.064933 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e81ee2-dad9-4c06-8855-f5a6a05785dd admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:33.071976 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaaae97-9788-408a-bbc7-094792e1401a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:33.085539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad857d-6a7b-4a89-ad87-cef2d40d220d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:33.085539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad857d-6a7b-4a89-ad87-cef2d40d220d admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:33.085539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad857d-6a7b-4a89-ad87-cef2d40d220d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:33.085539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad857d-6a7b-4a89-ad87-cef2d40d220d admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:33.086079 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad857d-6a7b-4a89-ad87-cef2d40d220d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:33.086571 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad857d-6a7b-4a89-ad87-cef2d40d220d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:33.104561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1187/2333] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:12:33.110841 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad857d-6a7b-4a89-ad87-cef2d40d220d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:33.126850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad857d-6a7b-4a89-ad87-cef2d40d220d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:33.134382 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1147/2334] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:32 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:12:33.136428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e81ee2-dad9-4c06-8855-f5a6a05785dd admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:33.214491 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705a3a0-0923-4ac8-805a-59575d71257d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:33.215869 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705a3a0-0923-4ac8-805a-59575d71257d admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:33.216317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705a3a0-0923-4ac8-805a-59575d71257d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:33.217033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705a3a0-0923-4ac8-805a-59575d71257d admin admin] PATH_INFO: `/v3/projects/083978ba8c404e46988186457bfa6d53/users/4a2e2919cc854c949fa8546884fb1a7f/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:33.219247 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705a3a0-0923-4ac8-805a-59575d71257d admin admin] RBAC: Authorizing `identity:create_grant(project_id=083978ba8c404e46988186457bfa6d53, user_id=4a2e2919cc854c949fa8546884fb1a7f, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:33.222111 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:33.222774 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705a3a0-0923-4ac8-805a-59575d71257d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:33.234286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1188/2335] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:33 2022] PUT /identity/v3/projects/083978ba8c404e46988186457bfa6d53/users/4a2e2919cc854c949fa8546884fb1a7f/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:33.247023 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c7ed3-f192-41fa-a423-71151fa60933 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:33.247405 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c7ed3-f192-41fa-a423-71151fa60933 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:33.247602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c7ed3-f192-41fa-a423-71151fa60933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:33.247795 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e81ee2-dad9-4c06-8855-f5a6a05785dd admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:33.286437 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-100c7ed3-f192-41fa-a423-71151fa60933 None None] MFA Rules not processed for user `4a2e2919cc854c949fa8546884fb1a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:33.288067 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-100c7ed3-f192-41fa-a423-71151fa60933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:33.321974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:33.343176 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815ead2-8c04-465b-bfa5-27dad5b36ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:33.343859 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815ead2-8c04-465b-bfa5-27dad5b36ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:33.344139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815ead2-8c04-465b-bfa5-27dad5b36ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:33.344498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815ead2-8c04-465b-bfa5-27dad5b36ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:33.345259 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815ead2-8c04-465b-bfa5-27dad5b36ec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:33.347387 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4815ead2-8c04-465b-bfa5-27dad5b36ec7 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:33.423882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1148/2336] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:33 2022] POST /identity/v3/users => generated 288 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:33.429534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815ead2-8c04-465b-bfa5-27dad5b36ec7 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:33.446624 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4815ead2-8c04-465b-bfa5-27dad5b36ec7 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:33.453111 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5d0b2-061c-4fed-bf30-6a82659e491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:33.453747 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5d0b2-061c-4fed-bf30-6a82659e491c admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:33.454029 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5d0b2-061c-4fed-bf30-6a82659e491c admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:33.454309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5d0b2-061c-4fed-bf30-6a82659e491c admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:33.455005 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5d0b2-061c-4fed-bf30-6a82659e491c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:33.456941 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5d0b2-061c-4fed-bf30-6a82659e491c admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:33.492250 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1149/2337] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:12:33.496654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5d0b2-061c-4fed-bf30-6a82659e491c admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:33.497822 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1189/2338] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:33.513207 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c7ed3-f192-41fa-a423-71151fa60933 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:33.513905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5d0b2-061c-4fed-bf30-6a82659e491c admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:33.515581 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-100c7ed3-f192-41fa-a423-71151fa60933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:33.542843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3128d-c341-46ef-9a04-3ceffc33aa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:33.543517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3128d-c341-46ef-9a04-3ceffc33aa3d admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:33.544027 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3128d-c341-46ef-9a04-3ceffc33aa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:33.544305 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a3128d-c341-46ef-9a04-3ceffc33aa3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:33.545650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3128d-c341-46ef-9a04-3ceffc33aa3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:33.547285 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a3128d-c341-46ef-9a04-3ceffc33aa3d admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:33.563116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1150/2339] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:33.568489 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3128d-c341-46ef-9a04-3ceffc33aa3d admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:33.583231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a3128d-c341-46ef-9a04-3ceffc33aa3d admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:33.589209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeebff7-f0e0-4b86-b952-430bb947c4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:33.589981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeebff7-f0e0-4b86-b952-430bb947c4c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:33.590370 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeebff7-f0e0-4b86-b952-430bb947c4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:33.590652 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeebff7-f0e0-4b86-b952-430bb947c4c9 admin admin] PATH_INFO: `/v3/projects/31ef05df60474d159522233f809d4dc4/users/0b295d85c6074e40b6eaaed5d18bb5ed/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:33.605520 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c7ed3-f192-41fa-a423-71151fa60933 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:33.611162 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397fd8d-a4af-4ad0-b6f7-22b226cab0eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:33.612135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397fd8d-a4af-4ad0-b6f7-22b226cab0eb service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:33.612992 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397fd8d-a4af-4ad0-b6f7-22b226cab0eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:33.613331 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397fd8d-a4af-4ad0-b6f7-22b226cab0eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:33.616356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeebff7-f0e0-4b86-b952-430bb947c4c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31ef05df60474d159522233f809d4dc4, user_id=0b295d85c6074e40b6eaaed5d18bb5ed, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:33.619315 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeebff7-f0e0-4b86-b952-430bb947c4c9 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:33.624269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397fd8d-a4af-4ad0-b6f7-22b226cab0eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:33.626014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397fd8d-a4af-4ad0-b6f7-22b226cab0eb service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:33.638345 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1151/2340] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:33 2022] PUT /identity/v3/projects/31ef05df60474d159522233f809d4dc4/users/0b295d85c6074e40b6eaaed5d18bb5ed/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:33.639197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1190/2341] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:33.649534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba7caa-e59e-4e10-9bcb-bc4b66b1c339 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:33.649843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba7caa-e59e-4e10-9bcb-bc4b66b1c339 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:33.650419 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba7caa-e59e-4e10-9bcb-bc4b66b1c339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:33.690659 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-b6ba7caa-e59e-4e10-9bcb-bc4b66b1c339 None None] MFA Rules not processed for user `0b295d85c6074e40b6eaaed5d18bb5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:33.692031 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b6ba7caa-e59e-4e10-9bcb-bc4b66b1c339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:33.748993 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397fd8d-a4af-4ad0-b6f7-22b226cab0eb service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:33.760609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397fd8d-a4af-4ad0-b6f7-22b226cab0eb service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:33.796916 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1152/2342] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:33.810423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba7caa-e59e-4e10-9bcb-bc4b66b1c339 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:33.811926 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b6ba7caa-e59e-4e10-9bcb-bc4b66b1c339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:33.850922 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:33.851666 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5255f-3ded-4c51-ac7d-6b84199bbd76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:33.852380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5255f-3ded-4c51-ac7d-6b84199bbd76 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:33.853128 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5255f-3ded-4c51-ac7d-6b84199bbd76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:33.853463 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5255f-3ded-4c51-ac7d-6b84199bbd76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:33.855401 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dbb5255f-3ded-4c51-ac7d-6b84199bbd76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:33.887410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba7caa-e59e-4e10-9bcb-bc4b66b1c339 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:33.891822 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad856352-b1b7-41c3-a90b-2bb8931be2bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:33.892415 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad856352-b1b7-41c3-a90b-2bb8931be2bf service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:33.892762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad856352-b1b7-41c3-a90b-2bb8931be2bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:33.893248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad856352-b1b7-41c3-a90b-2bb8931be2bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:33.903262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad856352-b1b7-41c3-a90b-2bb8931be2bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:33.904777 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad856352-b1b7-41c3-a90b-2bb8931be2bf service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:33.916378 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1153/2343] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:34.064271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5255f-3ded-4c51-ac7d-6b84199bbd76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:34.066344 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5255f-3ded-4c51-ac7d-6b84199bbd76 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:34.083380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1191/2344] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:36.156064 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e50f4-a212-41ca-8487-db929df8008d None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:36.156614 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e50f4-a212-41ca-8487-db929df8008d None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:36.156800 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e50f4-a212-41ca-8487-db929df8008d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:36.198217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-d56e50f4-a212-41ca-8487-db929df8008d None None] MFA Rules not processed for user `7511e2f8a2c24c92be08dc5056bac4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:36.199577 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-d56e50f4-a212-41ca-8487-db929df8008d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:36.286708 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1154/2345] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:41.014989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5255f-3ded-4c51-ac7d-6b84199bbd76 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:41.052525 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:41.236143 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5255f-3ded-4c51-ac7d-6b84199bbd76 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:41.253764 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e010e89-376a-4657-a94b-13ee3ed545a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:41.254941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e010e89-376a-4657-a94b-13ee3ed545a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:41.255740 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e010e89-376a-4657-a94b-13ee3ed545a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:41.256271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e010e89-376a-4657-a94b-13ee3ed545a1 admin admin] PATH_INFO: `/v3/users/816c60aa9adb469ca926fca0d9807608` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:41.266003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e010e89-376a-4657-a94b-13ee3ed545a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=816c60aa9adb469ca926fca0d9807608)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:41.278709 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e010e89-376a-4657-a94b-13ee3ed545a1 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:41.368504 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1e010e89-376a-4657-a94b-13ee3ed545a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '816c60aa9adb469ca926fca0d9807608'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:41.369128 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1e010e89-376a-4657-a94b-13ee3ed545a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '816c60aa9adb469ca926fca0d9807608'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:41.379595 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1e010e89-376a-4657-a94b-13ee3ed545a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '816c60aa9adb469ca926fca0d9807608'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:41.398639 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1e010e89-376a-4657-a94b-13ee3ed545a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '816c60aa9adb469ca926fca0d9807608'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:41.417077 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1e010e89-376a-4657-a94b-13ee3ed545a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '816c60aa9adb469ca926fca0d9807608'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:41.439871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1192/2346] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:41 2022] DELETE /identity/v3/users/816c60aa9adb469ca926fca0d9807608 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:41.444200 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dc4c9-0624-4373-8eff-6df52a176e8d None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:41.450682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dc4c9-0624-4373-8eff-6df52a176e8d None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:41.453998 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1dc4c9-0624-4373-8eff-6df52a176e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:41.481520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-fe1dc4c9-0624-4373-8eff-6df52a176e8d None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:41.482764 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-fe1dc4c9-0624-4373-8eff-6df52a176e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:41.551541 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1155/2347] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:41.564339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e010e89-376a-4657-a94b-13ee3ed545a1 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:41.566196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1e010e89-376a-4657-a94b-13ee3ed545a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:41.663014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e010e89-376a-4657-a94b-13ee3ed545a1 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:41.668339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383abaee-84e0-4ecf-8b97-05df322a65ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:41.669063 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383abaee-84e0-4ecf-8b97-05df322a65ea service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:41.669407 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383abaee-84e0-4ecf-8b97-05df322a65ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:41.670203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383abaee-84e0-4ecf-8b97-05df322a65ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:41.680499 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383abaee-84e0-4ecf-8b97-05df322a65ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:41.683293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383abaee-84e0-4ecf-8b97-05df322a65ea service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:41.699474 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1193/2348] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:42.474727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dc4c9-0624-4373-8eff-6df52a176e8d None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:42.476814 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-fe1dc4c9-0624-4373-8eff-6df52a176e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:42.511799 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1dc4c9-0624-4373-8eff-6df52a176e8d None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:42.538250 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4dac1-9073-415f-83a4-2fa86964e6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:42.538981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4dac1-9073-415f-83a4-2fa86964e6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:42.539267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4dac1-9073-415f-83a4-2fa86964e6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:42.539570 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4dac1-9073-415f-83a4-2fa86964e6d4 admin admin] PATH_INFO: `/v3/projects/6aac2308850e44fda909a926d90a6339` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:42.540837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4dac1-9073-415f-83a4-2fa86964e6d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aac2308850e44fda909a926d90a6339)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:42.543467 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4dac1-9073-415f-83a4-2fa86964e6d4 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:42.626534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fcb4dac1-9073-415f-83a4-2fa86964e6d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aac2308850e44fda909a926d90a6339', 'request_id': 'req-fcb4dac1-9073-415f-83a4-2fa86964e6d4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:42.645640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fcb4dac1-9073-415f-83a4-2fa86964e6d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aac2308850e44fda909a926d90a6339', 'request_id': 'req-fcb4dac1-9073-415f-83a4-2fa86964e6d4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:42.669836 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fcb4dac1-9073-415f-83a4-2fa86964e6d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aac2308850e44fda909a926d90a6339', 'request_id': 'req-fcb4dac1-9073-415f-83a4-2fa86964e6d4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:42.695286 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:42.705125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fcb4dac1-9073-415f-83a4-2fa86964e6d4 admin admin] The token cache is being invalidate because project 6aac2308850e44fda909a926d90a6339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:42.705542 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fcb4dac1-9073-415f-83a4-2fa86964e6d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:42.706404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fcb4dac1-9073-415f-83a4-2fa86964e6d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:42.708273 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1156/2349] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:42 2022] DELETE /identity/v3/projects/6aac2308850e44fda909a926d90a6339 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:42.712599 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383abaee-84e0-4ecf-8b97-05df322a65ea service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:42.730005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383abaee-84e0-4ecf-8b97-05df322a65ea service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:42.847909 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:42.903141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1631eec-84de-409e-b014-4d52c9ab0c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:42.903941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1631eec-84de-409e-b014-4d52c9ab0c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:42.904319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1631eec-84de-409e-b014-4d52c9ab0c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:42.905496 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1631eec-84de-409e-b014-4d52c9ab0c5f admin admin] PATH_INFO: `/v3/users/4a2e2919cc854c949fa8546884fb1a7f` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:42.907486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1631eec-84de-409e-b014-4d52c9ab0c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a2e2919cc854c949fa8546884fb1a7f)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:42.911268 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1631eec-84de-409e-b014-4d52c9ab0c5f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:43.051696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e1631eec-84de-409e-b014-4d52c9ab0c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a2e2919cc854c949fa8546884fb1a7f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:43.051696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e1631eec-84de-409e-b014-4d52c9ab0c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a2e2919cc854c949fa8546884fb1a7f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:43.066128 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e1631eec-84de-409e-b014-4d52c9ab0c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a2e2919cc854c949fa8546884fb1a7f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:43.097674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e1631eec-84de-409e-b014-4d52c9ab0c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a2e2919cc854c949fa8546884fb1a7f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:43.129181 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e1631eec-84de-409e-b014-4d52c9ab0c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a2e2919cc854c949fa8546884fb1a7f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:43.151887 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1194/2350] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:42 2022] DELETE /identity/v3/users/4a2e2919cc854c949fa8546884fb1a7f => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:43.469652 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4dac1-9073-415f-83a4-2fa86964e6d4 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:43.471458 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-fcb4dac1-9073-415f-83a4-2fa86964e6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:43.494755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4dac1-9073-415f-83a4-2fa86964e6d4 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:43.568152 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f09ad7-5a06-42e2-bb5a-d8103ea62a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:43.568899 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f09ad7-5a06-42e2-bb5a-d8103ea62a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:43.569213 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f09ad7-5a06-42e2-bb5a-d8103ea62a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:43.569528 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f09ad7-5a06-42e2-bb5a-d8103ea62a04 admin admin] PATH_INFO: `/v3/projects/083978ba8c404e46988186457bfa6d53` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:43.570862 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f09ad7-5a06-42e2-bb5a-d8103ea62a04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=083978ba8c404e46988186457bfa6d53)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:43.573216 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f09ad7-5a06-42e2-bb5a-d8103ea62a04 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:43.626226 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-79f09ad7-5a06-42e2-bb5a-d8103ea62a04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '083978ba8c404e46988186457bfa6d53', 'request_id': 'req-79f09ad7-5a06-42e2-bb5a-d8103ea62a04'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:43.633633 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-79f09ad7-5a06-42e2-bb5a-d8103ea62a04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '083978ba8c404e46988186457bfa6d53', 'request_id': 'req-79f09ad7-5a06-42e2-bb5a-d8103ea62a04'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:43.640391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-79f09ad7-5a06-42e2-bb5a-d8103ea62a04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '083978ba8c404e46988186457bfa6d53', 'request_id': 'req-79f09ad7-5a06-42e2-bb5a-d8103ea62a04'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:43.654515 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-79f09ad7-5a06-42e2-bb5a-d8103ea62a04 admin admin] The token cache is being invalidate because project 083978ba8c404e46988186457bfa6d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:43.654808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-79f09ad7-5a06-42e2-bb5a-d8103ea62a04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:43.655468 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-79f09ad7-5a06-42e2-bb5a-d8103ea62a04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:43.657246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1157/2351] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:43 2022] DELETE /identity/v3/projects/083978ba8c404e46988186457bfa6d53 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:43.662151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ba947-6edb-45de-9723-31d7b9191d54 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:43.662438 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ba947-6edb-45de-9723-31d7b9191d54 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:43.662728 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ba947-6edb-45de-9723-31d7b9191d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:43.683096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d46ba947-6edb-45de-9723-31d7b9191d54 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:43.684446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d46ba947-6edb-45de-9723-31d7b9191d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:43.708230 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08451b-6fd8-45ff-bac5-5e8274e05b15 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:43.708736 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08451b-6fd8-45ff-bac5-5e8274e05b15 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:43.709047 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08451b-6fd8-45ff-bac5-5e8274e05b15 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:43.710754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1158/2352] 10.222.0.85 () {54 vars in 921 bytes} [Tue Aug 2 10:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:12:43.737590 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31c263-2c46-4f6e-9d6a-06202098ceca None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:43.738304 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31c263-2c46-4f6e-9d6a-06202098ceca None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:43.738893 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31c263-2c46-4f6e-9d6a-06202098ceca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:43.748742 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1195/2353] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:12:43.757995 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e183a-8a42-4997-9e08-c689997be6d4 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:43.758287 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e183a-8a42-4997-9e08-c689997be6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:43.758586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e183a-8a42-4997-9e08-c689997be6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:43.777563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-1f31c263-2c46-4f6e-9d6a-06202098ceca None None] MFA Rules not processed for user `a2a420cc676e4f2bb2766826a1de3b41`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:43.779482 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-fe9e183a-8a42-4997-9e08-c689997be6d4 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:43.780777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fe9e183a-8a42-4997-9e08-c689997be6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:43.784070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-1f31c263-2c46-4f6e-9d6a-06202098ceca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:43.794560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1196/2354] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:12:43.794560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e183a-8a42-4997-9e08-c689997be6d4 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:43.795984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fe9e183a-8a42-4997-9e08-c689997be6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:43.809773 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e183a-8a42-4997-9e08-c689997be6d4 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:43.814680 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cbb71-1c0e-48ac-87af-ad48d79a2aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:43.815931 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cbb71-1c0e-48ac-87af-ad48d79a2aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:43.816276 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cbb71-1c0e-48ac-87af-ad48d79a2aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:43.816659 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111cbb71-1c0e-48ac-87af-ad48d79a2aba admin admin] PATH_INFO: `/v3/users/59d6ef9e10c343b2a91474f5955fceb6` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:43.817933 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cbb71-1c0e-48ac-87af-ad48d79a2aba admin admin] RBAC: Authorizing `identity:delete_user(user_id=59d6ef9e10c343b2a91474f5955fceb6)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:43.819846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111cbb71-1c0e-48ac-87af-ad48d79a2aba admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:43.869978 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1159/2355] 10.222.0.85 () {58 vars in 1018 bytes} [Tue Aug 2 10:12:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:12:43.871105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31c263-2c46-4f6e-9d6a-06202098ceca None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:43.871510 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:43.877452 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-111cbb71-1c0e-48ac-87af-ad48d79a2aba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59d6ef9e10c343b2a91474f5955fceb6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:43.879303 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-111cbb71-1c0e-48ac-87af-ad48d79a2aba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59d6ef9e10c343b2a91474f5955fceb6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:43.887629 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31c263-2c46-4f6e-9d6a-06202098ceca None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:43.895027 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fb2e9-400a-4801-89d7-f941bc410174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:43.896101 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fb2e9-400a-4801-89d7-f941bc410174 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:43.896545 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fb2e9-400a-4801-89d7-f941bc410174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:43.897236 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fb2e9-400a-4801-89d7-f941bc410174 admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:43.904781 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-111cbb71-1c0e-48ac-87af-ad48d79a2aba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59d6ef9e10c343b2a91474f5955fceb6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:43.905377 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fb2e9-400a-4801-89d7-f941bc410174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:12:43.907853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fb2e9-400a-4801-89d7-f941bc410174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:43.910193 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fb2e9-400a-4801-89d7-f941bc410174 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:43.918856 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-111cbb71-1c0e-48ac-87af-ad48d79a2aba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59d6ef9e10c343b2a91474f5955fceb6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:43.929927 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-111cbb71-1c0e-48ac-87af-ad48d79a2aba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59d6ef9e10c343b2a91474f5955fceb6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:43.935352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1160/2356] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:12:43.936365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fb2e9-400a-4801-89d7-f941bc410174 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:43.937365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1197/2357] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:43 2022] DELETE /identity/v3/users/59d6ef9e10c343b2a91474f5955fceb6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:43.938572 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-9f7fb2e9-400a-4801-89d7-f941bc410174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:43.941999 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cbb71-1c0e-48ac-87af-ad48d79a2aba admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:43.944066 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-111cbb71-1c0e-48ac-87af-ad48d79a2aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:43.958195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fb2e9-400a-4801-89d7-f941bc410174 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:43.976563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:44.037958 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111cbb71-1c0e-48ac-87af-ad48d79a2aba admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:44.043526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c722b4-5048-44ad-aa56-4a25a0732286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:44.044183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c722b4-5048-44ad-aa56-4a25a0732286 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:44.044537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c722b4-5048-44ad-aa56-4a25a0732286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:44.044812 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c722b4-5048-44ad-aa56-4a25a0732286 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:44.045517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c722b4-5048-44ad-aa56-4a25a0732286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:44.047948 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c722b4-5048-44ad-aa56-4a25a0732286 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:44.081505 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc429724-271c-49b6-874f-a0b8c726c752 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2a420cc676e4f2bb2766826a1de3b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:44.082141 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc429724-271c-49b6-874f-a0b8c726c752 service placement] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:44.082427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc429724-271c-49b6-874f-a0b8c726c752 service placement] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:44.082711 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc429724-271c-49b6-874f-a0b8c726c752 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:44.091543 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-cc429724-271c-49b6-874f-a0b8c726c752 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:44.092606 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1198/2358] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:43 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:44.099033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c722b4-5048-44ad-aa56-4a25a0732286 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:44.123588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc429724-271c-49b6-874f-a0b8c726c752 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:44.128036 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc429724-271c-49b6-874f-a0b8c726c752 service placement] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:44.147735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1161/2359] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:44.211233 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c722b4-5048-44ad-aa56-4a25a0732286 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:44.235286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc68daf-7dc0-46f8-942e-7fe60b200cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:44.236183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc68daf-7dc0-46f8-942e-7fe60b200cdc admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:44.236483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc68daf-7dc0-46f8-942e-7fe60b200cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:44.237539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc68daf-7dc0-46f8-942e-7fe60b200cdc admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:44.238271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc68daf-7dc0-46f8-942e-7fe60b200cdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:44.244040 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc68daf-7dc0-46f8-942e-7fe60b200cdc admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:44.293716 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1199/2360] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:44 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:44.298320 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc429724-271c-49b6-874f-a0b8c726c752 service placement] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:44.311458 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc429724-271c-49b6-874f-a0b8c726c752 service placement] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:44.317645 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d9468-7dfa-4d26-90b9-46e862343e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:44.318380 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d9468-7dfa-4d26-90b9-46e862343e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:44.318694 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d9468-7dfa-4d26-90b9-46e862343e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:44.319000 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33d9468-7dfa-4d26-90b9-46e862343e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:44.319971 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d9468-7dfa-4d26-90b9-46e862343e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:44.321775 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33d9468-7dfa-4d26-90b9-46e862343e3c admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:44.336158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1162/2361] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:44.340595 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc68daf-7dc0-46f8-942e-7fe60b200cdc admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:44.354142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc68daf-7dc0-46f8-942e-7fe60b200cdc admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:44.360991 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590fe58-9ebf-4aa1-a79e-5ddb05d248c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:44.361661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590fe58-9ebf-4aa1-a79e-5ddb05d248c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:44.363483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590fe58-9ebf-4aa1-a79e-5ddb05d248c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:44.363932 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590fe58-9ebf-4aa1-a79e-5ddb05d248c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:44.364729 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590fe58-9ebf-4aa1-a79e-5ddb05d248c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:44.370535 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590fe58-9ebf-4aa1-a79e-5ddb05d248c8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:44.373918 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d9468-7dfa-4d26-90b9-46e862343e3c admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:44.382468 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-d33d9468-7dfa-4d26-90b9-46e862343e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:44.399076 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1200/2362] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:44.399921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590fe58-9ebf-4aa1-a79e-5ddb05d248c8 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:44.401228 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33d9468-7dfa-4d26-90b9-46e862343e3c admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:44.409924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ec94c-60bf-4679-87ef-20914d6ca8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:44.410703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ec94c-60bf-4679-87ef-20914d6ca8d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:44.410996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ec94c-60bf-4679-87ef-20914d6ca8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:44.411373 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ec94c-60bf-4679-87ef-20914d6ca8d2 admin admin] PATH_INFO: `/v3/projects/698968b5cefe492ebc27941a82301499` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:44.412927 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ec94c-60bf-4679-87ef-20914d6ca8d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=698968b5cefe492ebc27941a82301499)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:44.413483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590fe58-9ebf-4aa1-a79e-5ddb05d248c8 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:44.416427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ec94c-60bf-4679-87ef-20914d6ca8d2 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:44.419825 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00be0ba-40e0-4380-b2a0-c30f4f38417e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:44.420849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00be0ba-40e0-4380-b2a0-c30f4f38417e admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:44.421362 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00be0ba-40e0-4380-b2a0-c30f4f38417e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:44.421923 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00be0ba-40e0-4380-b2a0-c30f4f38417e admin admin] PATH_INFO: `/v3/projects/6286601f19b0447bb58777f2a2d6c0f4/users/0d678ac2ab4e422eba29571da8b92069/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:44.448068 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00be0ba-40e0-4380-b2a0-c30f4f38417e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6286601f19b0447bb58777f2a2d6c0f4, user_id=0d678ac2ab4e422eba29571da8b92069, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:44.451211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00be0ba-40e0-4380-b2a0-c30f4f38417e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:44.464217 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:44.479852 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1201/2363] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:44 2022] PUT /identity/v3/projects/6286601f19b0447bb58777f2a2d6c0f4/users/0d678ac2ab4e422eba29571da8b92069/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:44.490859 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20c3ed-3dd8-42eb-8654-d26e1bac1fed None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:44.491136 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20c3ed-3dd8-42eb-8654-d26e1bac1fed None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:44.491777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20c3ed-3dd8-42eb-8654-d26e1bac1fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:44.514175 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-0d3ec94c-60bf-4679-87ef-20914d6ca8d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698968b5cefe492ebc27941a82301499', 'request_id': 'req-0d3ec94c-60bf-4679-87ef-20914d6ca8d2'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:44.524034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-0d3ec94c-60bf-4679-87ef-20914d6ca8d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698968b5cefe492ebc27941a82301499', 'request_id': 'req-0d3ec94c-60bf-4679-87ef-20914d6ca8d2'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:44.524242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9a20c3ed-3dd8-42eb-8654-d26e1bac1fed None None] MFA Rules not processed for user `0d678ac2ab4e422eba29571da8b92069`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:44.527199 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9a20c3ed-3dd8-42eb-8654-d26e1bac1fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:44.533091 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-0d3ec94c-60bf-4679-87ef-20914d6ca8d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698968b5cefe492ebc27941a82301499', 'request_id': 'req-0d3ec94c-60bf-4679-87ef-20914d6ca8d2'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:44.549546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-0d3ec94c-60bf-4679-87ef-20914d6ca8d2 admin admin] The token cache is being invalidate because project 698968b5cefe492ebc27941a82301499 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:44.549546 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-0d3ec94c-60bf-4679-87ef-20914d6ca8d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:44.551356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-0d3ec94c-60bf-4679-87ef-20914d6ca8d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:44.553612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1163/2364] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:44 2022] DELETE /identity/v3/projects/698968b5cefe492ebc27941a82301499 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:44.557858 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ec94c-60bf-4679-87ef-20914d6ca8d2 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:44.559265 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-0d3ec94c-60bf-4679-87ef-20914d6ca8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:44.630925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1202/2365] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:44.653571 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20c3ed-3dd8-42eb-8654-d26e1bac1fed None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:44.655541 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ec94c-60bf-4679-87ef-20914d6ca8d2 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:44.656019 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9a20c3ed-3dd8-42eb-8654-d26e1bac1fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:44.661410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f1bbe-d913-4e1a-8943-bdd898cea450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:44.662036 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f1bbe-d913-4e1a-8943-bdd898cea450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:44.662482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f1bbe-d913-4e1a-8943-bdd898cea450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:44.662665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f1bbe-d913-4e1a-8943-bdd898cea450 admin admin] PATH_INFO: `/v3/users/cf0ca1c2287940a7bd69c977a87b2aea` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:44.663803 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f1bbe-d913-4e1a-8943-bdd898cea450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf0ca1c2287940a7bd69c977a87b2aea)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:44.665757 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f1bbe-d913-4e1a-8943-bdd898cea450 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:44.683132 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:44.736246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-d00f1bbe-d913-4e1a-8943-bdd898cea450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf0ca1c2287940a7bd69c977a87b2aea'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:44.737493 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-d00f1bbe-d913-4e1a-8943-bdd898cea450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf0ca1c2287940a7bd69c977a87b2aea'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:44.740230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20c3ed-3dd8-42eb-8654-d26e1bac1fed None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:44.744723 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7909b-b915-4b74-b548-4d285b3072ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:44.745652 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7909b-b915-4b74-b548-4d285b3072ba service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:44.746203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7909b-b915-4b74-b548-4d285b3072ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:44.746408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7909b-b915-4b74-b548-4d285b3072ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:44.755824 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-d00f1bbe-d913-4e1a-8943-bdd898cea450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf0ca1c2287940a7bd69c977a87b2aea'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:44.759073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7909b-b915-4b74-b548-4d285b3072ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:44.760622 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7909b-b915-4b74-b548-4d285b3072ba service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:44.767329 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-d00f1bbe-d913-4e1a-8943-bdd898cea450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf0ca1c2287940a7bd69c977a87b2aea'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:44.768897 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-d00f1bbe-d913-4e1a-8943-bdd898cea450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf0ca1c2287940a7bd69c977a87b2aea'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:44.771566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1203/2366] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:44.784968 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1164/2367] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:44 2022] DELETE /identity/v3/users/cf0ca1c2287940a7bd69c977a87b2aea => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:44.998661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7909b-b915-4b74-b548-4d285b3072ba service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:45.033876 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7909b-b915-4b74-b548-4d285b3072ba service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:45.119259 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b4e01-ea1a-468d-9b5d-89d9819cd885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:45.119908 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b4e01-ea1a-468d-9b5d-89d9819cd885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:45.120186 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b4e01-ea1a-468d-9b5d-89d9819cd885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:45.120453 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b4e01-ea1a-468d-9b5d-89d9819cd885 admin admin] PATH_INFO: `/v3/projects/5cf0c046f84140718df2e7fcf6f54096` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:45.122082 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b4e01-ea1a-468d-9b5d-89d9819cd885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cf0c046f84140718df2e7fcf6f54096)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:45.124005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b4e01-ea1a-468d-9b5d-89d9819cd885 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:45.178980 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:45.201708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6e4b4e01-ea1a-468d-9b5d-89d9819cd885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cf0c046f84140718df2e7fcf6f54096', 'request_id': 'req-6e4b4e01-ea1a-468d-9b5d-89d9819cd885'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:45.202350 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6e4b4e01-ea1a-468d-9b5d-89d9819cd885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cf0c046f84140718df2e7fcf6f54096', 'request_id': 'req-6e4b4e01-ea1a-468d-9b5d-89d9819cd885'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:45.209301 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6e4b4e01-ea1a-468d-9b5d-89d9819cd885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cf0c046f84140718df2e7fcf6f54096', 'request_id': 'req-6e4b4e01-ea1a-468d-9b5d-89d9819cd885'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:45.223552 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6e4b4e01-ea1a-468d-9b5d-89d9819cd885 admin admin] The token cache is being invalidate because project 5cf0c046f84140718df2e7fcf6f54096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:45.223846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6e4b4e01-ea1a-468d-9b5d-89d9819cd885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:45.224491 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6e4b4e01-ea1a-468d-9b5d-89d9819cd885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:45.226009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1204/2368] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:44 2022] DELETE /identity/v3/projects/5cf0c046f84140718df2e7fcf6f54096 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:45.231014 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63264e-172e-4273-9a09-9d92b9732d60 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:45.231328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63264e-172e-4273-9a09-9d92b9732d60 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:45.231605 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63264e-172e-4273-9a09-9d92b9732d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:45.255580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-3b63264e-172e-4273-9a09-9d92b9732d60 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:45.256941 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-3b63264e-172e-4273-9a09-9d92b9732d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:45.340411 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1165/2369] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:45.350565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc319e6-8798-4d35-8a93-94280c2e1723 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:45.350852 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc319e6-8798-4d35-8a93-94280c2e1723 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:45.351130 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc319e6-8798-4d35-8a93-94280c2e1723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:45.373862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-bbc319e6-8798-4d35-8a93-94280c2e1723 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:45.375137 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bbc319e6-8798-4d35-8a93-94280c2e1723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:45.386657 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1205/2370] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:45.390874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63264e-172e-4273-9a09-9d92b9732d60 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:45.411479 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63264e-172e-4273-9a09-9d92b9732d60 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:45.419691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ac4fc-2a22-41ce-b35d-3357a4117673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:45.420764 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ac4fc-2a22-41ce-b35d-3357a4117673 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:45.421895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ac4fc-2a22-41ce-b35d-3357a4117673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:45.422557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438ac4fc-2a22-41ce-b35d-3357a4117673 admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:45.423067 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ac4fc-2a22-41ce-b35d-3357a4117673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:12:45.423387 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ac4fc-2a22-41ce-b35d-3357a4117673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:45.426111 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438ac4fc-2a22-41ce-b35d-3357a4117673 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:45.443041 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1166/2371] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:12:45.448200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc319e6-8798-4d35-8a93-94280c2e1723 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:45.461808 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc319e6-8798-4d35-8a93-94280c2e1723 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:45.468380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc4fe1-e03e-44de-8f05-a5108583f0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:45.469541 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc4fe1-e03e-44de-8f05-a5108583f0af admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:45.469923 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc4fe1-e03e-44de-8f05-a5108583f0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:45.471710 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc4fe1-e03e-44de-8f05-a5108583f0af admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:45.473084 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc4fe1-e03e-44de-8f05-a5108583f0af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:45.475760 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc4fe1-e03e-44de-8f05-a5108583f0af admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:45.526057 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1206/2372] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:45 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:45.527327 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ac4fc-2a22-41ce-b35d-3357a4117673 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:45.543631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438ac4fc-2a22-41ce-b35d-3357a4117673 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:45.650042 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3809aa3-a60b-4da9-85bf-9f8dbe387095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:45.652244 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3809aa3-a60b-4da9-85bf-9f8dbe387095 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:45.652878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3809aa3-a60b-4da9-85bf-9f8dbe387095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:45.653436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3809aa3-a60b-4da9-85bf-9f8dbe387095 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:45.654514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3809aa3-a60b-4da9-85bf-9f8dbe387095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:45.658350 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3809aa3-a60b-4da9-85bf-9f8dbe387095 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:45.697528 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1167/2373] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:45 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:45.703545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc4fe1-e03e-44de-8f05-a5108583f0af admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:45.730223 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc4fe1-e03e-44de-8f05-a5108583f0af admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:45.741782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ead27-6364-484f-bc26-86324175114c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:45.742502 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ead27-6364-484f-bc26-86324175114c admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:45.742800 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ead27-6364-484f-bc26-86324175114c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:45.743135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ead27-6364-484f-bc26-86324175114c admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:45.744324 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ead27-6364-484f-bc26-86324175114c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:45.745707 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ead27-6364-484f-bc26-86324175114c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:45.769309 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1207/2374] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:45.771665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3809aa3-a60b-4da9-85bf-9f8dbe387095 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:45.812208 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3809aa3-a60b-4da9-85bf-9f8dbe387095 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:45.821918 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74149917-f4c3-4210-9bae-f8ef672ba842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:45.823001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74149917-f4c3-4210-9bae-f8ef672ba842 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:45.823318 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74149917-f4c3-4210-9bae-f8ef672ba842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:45.823707 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74149917-f4c3-4210-9bae-f8ef672ba842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:45.825994 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74149917-f4c3-4210-9bae-f8ef672ba842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:45.826755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74149917-f4c3-4210-9bae-f8ef672ba842 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:45.834945 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:45.848510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1168/2375] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:45.851849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ead27-6364-484f-bc26-86324175114c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:45.870117 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ead27-6364-484f-bc26-86324175114c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:45.876802 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83957f6d-2dad-4ef5-9b75-36f68f3793e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:45.878629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83957f6d-2dad-4ef5-9b75-36f68f3793e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:45.878962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83957f6d-2dad-4ef5-9b75-36f68f3793e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:45.879361 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83957f6d-2dad-4ef5-9b75-36f68f3793e8 admin admin] PATH_INFO: `/v3/projects/bb59601be26f4af78360550ab447ef7b/users/651dd7e6057544e0b33493fb26dd1424/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:45.901619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83957f6d-2dad-4ef5-9b75-36f68f3793e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb59601be26f4af78360550ab447ef7b, user_id=651dd7e6057544e0b33493fb26dd1424, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:45.904887 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83957f6d-2dad-4ef5-9b75-36f68f3793e8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:45.929134 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1208/2376] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:45 2022] PUT /identity/v3/projects/bb59601be26f4af78360550ab447ef7b/users/651dd7e6057544e0b33493fb26dd1424/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:45.940807 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69881c0c-8c6d-44ca-992b-1d8a1f3881ae None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:45.941387 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69881c0c-8c6d-44ca-992b-1d8a1f3881ae None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:45.941988 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69881c0c-8c6d-44ca-992b-1d8a1f3881ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:45.980587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-69881c0c-8c6d-44ca-992b-1d8a1f3881ae None None] MFA Rules not processed for user `651dd7e6057544e0b33493fb26dd1424`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:45.981948 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-69881c0c-8c6d-44ca-992b-1d8a1f3881ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:46.062231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1169/2377] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:46.073376 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83957f6d-2dad-4ef5-9b75-36f68f3793e8 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:46.075062 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-83957f6d-2dad-4ef5-9b75-36f68f3793e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:46.142002 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83957f6d-2dad-4ef5-9b75-36f68f3793e8 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:46.147349 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c48728-1319-45cf-bb91-ab19207b27cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:46.147911 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c48728-1319-45cf-bb91-ab19207b27cd service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:46.148216 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c48728-1319-45cf-bb91-ab19207b27cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:46.148582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c48728-1319-45cf-bb91-ab19207b27cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:46.159741 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c48728-1319-45cf-bb91-ab19207b27cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:46.161385 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c48728-1319-45cf-bb91-ab19207b27cd service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:46.170794 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1209/2378] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:46.618029 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69881c0c-8c6d-44ca-992b-1d8a1f3881ae None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:46.619733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-69881c0c-8c6d-44ca-992b-1d8a1f3881ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:46.697018 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69881c0c-8c6d-44ca-992b-1d8a1f3881ae None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:46.701628 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ef58f-f5e9-40a5-8325-37822c926538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:46.702264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ef58f-f5e9-40a5-8325-37822c926538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:46.702544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ef58f-f5e9-40a5-8325-37822c926538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:46.702816 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ef58f-f5e9-40a5-8325-37822c926538 admin admin] PATH_INFO: `/v3/users/0b295d85c6074e40b6eaaed5d18bb5ed` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:46.703996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ef58f-f5e9-40a5-8325-37822c926538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b295d85c6074e40b6eaaed5d18bb5ed)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:46.706633 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ef58f-f5e9-40a5-8325-37822c926538 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:46.755572 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-243ef58f-f5e9-40a5-8325-37822c926538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b295d85c6074e40b6eaaed5d18bb5ed'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:46.756248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-243ef58f-f5e9-40a5-8325-37822c926538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b295d85c6074e40b6eaaed5d18bb5ed'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:46.769729 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-243ef58f-f5e9-40a5-8325-37822c926538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b295d85c6074e40b6eaaed5d18bb5ed'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:46.778447 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-243ef58f-f5e9-40a5-8325-37822c926538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b295d85c6074e40b6eaaed5d18bb5ed'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:46.779361 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-243ef58f-f5e9-40a5-8325-37822c926538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b295d85c6074e40b6eaaed5d18bb5ed'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:46.795125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1170/2379] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:46 2022] DELETE /identity/v3/users/0b295d85c6074e40b6eaaed5d18bb5ed => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:46.800962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90697063-e1c1-4cf1-bdd9-e652cc6da0c8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:46.803306 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90697063-e1c1-4cf1-bdd9-e652cc6da0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:46.803306 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90697063-e1c1-4cf1-bdd9-e652cc6da0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:46.825552 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-90697063-e1c1-4cf1-bdd9-e652cc6da0c8 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:46.825909 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-90697063-e1c1-4cf1-bdd9-e652cc6da0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:46.827018 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ef58f-f5e9-40a5-8325-37822c926538 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:46.829203 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-243ef58f-f5e9-40a5-8325-37822c926538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:46.845549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:46.899088 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:46.908604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1210/2380] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:46.922106 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90697063-e1c1-4cf1-bdd9-e652cc6da0c8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:46.924852 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-90697063-e1c1-4cf1-bdd9-e652cc6da0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:46.931810 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ef58f-f5e9-40a5-8325-37822c926538 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:46.938791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f3349-ec7b-46cd-bffa-27a06dee6113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:46.940728 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f3349-ec7b-46cd-bffa-27a06dee6113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:46.941637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f3349-ec7b-46cd-bffa-27a06dee6113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:46.942172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f3349-ec7b-46cd-bffa-27a06dee6113 admin admin] PATH_INFO: `/v3/users/decfa5c8e33e4e4693dc10cec148a393` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:46.943719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f3349-ec7b-46cd-bffa-27a06dee6113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=decfa5c8e33e4e4693dc10cec148a393)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:46.946677 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f3349-ec7b-46cd-bffa-27a06dee6113 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:46.991305 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90697063-e1c1-4cf1-bdd9-e652cc6da0c8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:46.995233 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d74ed2-5b63-4c13-99f1-ddd7d16276cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:46.995846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d74ed2-5b63-4c13-99f1-ddd7d16276cc service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:46.996265 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d74ed2-5b63-4c13-99f1-ddd7d16276cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:46.996533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d74ed2-5b63-4c13-99f1-ddd7d16276cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:47.008771 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d74ed2-5b63-4c13-99f1-ddd7d16276cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:47.010335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-aa6f3349-ec7b-46cd-bffa-27a06dee6113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'decfa5c8e33e4e4693dc10cec148a393'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:47.010704 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d74ed2-5b63-4c13-99f1-ddd7d16276cc service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:47.011315 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-aa6f3349-ec7b-46cd-bffa-27a06dee6113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'decfa5c8e33e4e4693dc10cec148a393'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:47.022618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1211/2381] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:12:47.025427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-aa6f3349-ec7b-46cd-bffa-27a06dee6113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'decfa5c8e33e4e4693dc10cec148a393'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:47.035921 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-aa6f3349-ec7b-46cd-bffa-27a06dee6113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'decfa5c8e33e4e4693dc10cec148a393'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:47.037283 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-aa6f3349-ec7b-46cd-bffa-27a06dee6113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'decfa5c8e33e4e4693dc10cec148a393'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:47.059800 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1171/2382] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:46 2022] DELETE /identity/v3/users/decfa5c8e33e4e4693dc10cec148a393 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:47.070878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74501b-616b-4fd4-831d-02f62b26e177 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:47.071288 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74501b-616b-4fd4-831d-02f62b26e177 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:47.071419 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74501b-616b-4fd4-831d-02f62b26e177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:47.096710 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6b74501b-616b-4fd4-831d-02f62b26e177 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:47.097942 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6b74501b-616b-4fd4-831d-02f62b26e177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:47.197756 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1212/2383] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:47.204723 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f3349-ec7b-46cd-bffa-27a06dee6113 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:47.207806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-aa6f3349-ec7b-46cd-bffa-27a06dee6113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:47.280199 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f3349-ec7b-46cd-bffa-27a06dee6113 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:47.285386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eee3de-a3ad-4a9c-857c-04b4178a075f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:47.286383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eee3de-a3ad-4a9c-857c-04b4178a075f service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:47.286674 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eee3de-a3ad-4a9c-857c-04b4178a075f service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:47.286999 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eee3de-a3ad-4a9c-857c-04b4178a075f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:47.303848 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eee3de-a3ad-4a9c-857c-04b4178a075f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:47.306801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eee3de-a3ad-4a9c-857c-04b4178a075f service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:47.319763 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1172/2384] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:12:47.362327 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74501b-616b-4fd4-831d-02f62b26e177 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:47.363834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6b74501b-616b-4fd4-831d-02f62b26e177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:47.382802 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74501b-616b-4fd4-831d-02f62b26e177 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:47.388808 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6774e-ac82-4d1c-9ea4-ec3303bcbd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:47.389794 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6774e-ac82-4d1c-9ea4-ec3303bcbd91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:47.390141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6774e-ac82-4d1c-9ea4-ec3303bcbd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:47.390592 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6774e-ac82-4d1c-9ea4-ec3303bcbd91 admin admin] PATH_INFO: `/v3/projects/31ef05df60474d159522233f809d4dc4` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:47.392113 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6774e-ac82-4d1c-9ea4-ec3303bcbd91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31ef05df60474d159522233f809d4dc4)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:47.394260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6774e-ac82-4d1c-9ea4-ec3303bcbd91 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:47.476388 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-19b6774e-ac82-4d1c-9ea4-ec3303bcbd91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31ef05df60474d159522233f809d4dc4', 'request_id': 'req-19b6774e-ac82-4d1c-9ea4-ec3303bcbd91'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:47.487875 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-19b6774e-ac82-4d1c-9ea4-ec3303bcbd91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31ef05df60474d159522233f809d4dc4', 'request_id': 'req-19b6774e-ac82-4d1c-9ea4-ec3303bcbd91'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:47.494864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-19b6774e-ac82-4d1c-9ea4-ec3303bcbd91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31ef05df60474d159522233f809d4dc4', 'request_id': 'req-19b6774e-ac82-4d1c-9ea4-ec3303bcbd91'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:47.542224 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-19b6774e-ac82-4d1c-9ea4-ec3303bcbd91 admin admin] The token cache is being invalidate because project 31ef05df60474d159522233f809d4dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:47.545739 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-19b6774e-ac82-4d1c-9ea4-ec3303bcbd91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:47.548214 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-19b6774e-ac82-4d1c-9ea4-ec3303bcbd91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:47.552126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1213/2385] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:47 2022] DELETE /identity/v3/projects/31ef05df60474d159522233f809d4dc4 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:47.558290 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d954a-4ef0-4b27-8764-1ed47800d21a None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:47.558579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d954a-4ef0-4b27-8764-1ed47800d21a None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:47.558855 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d954a-4ef0-4b27-8764-1ed47800d21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:47.643577 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-169d954a-4ef0-4b27-8764-1ed47800d21a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:47.649954 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-169d954a-4ef0-4b27-8764-1ed47800d21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:47.739117 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:47.775164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6774e-ac82-4d1c-9ea4-ec3303bcbd91 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:47.777433 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-19b6774e-ac82-4d1c-9ea4-ec3303bcbd91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:47.861381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:47.879494 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1173/2386] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:47.883804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32550b-8101-4304-bdd4-17a938234cef None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:47.884392 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32550b-8101-4304-bdd4-17a938234cef None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:47.885135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32550b-8101-4304-bdd4-17a938234cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:47.932210 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-4d32550b-8101-4304-bdd4-17a938234cef None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:47.936310 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4d32550b-8101-4304-bdd4-17a938234cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:47.957083 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6774e-ac82-4d1c-9ea4-ec3303bcbd91 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:47.967337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1174/2387] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:47.968932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32550b-8101-4304-bdd4-17a938234cef None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:47.982644 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bd2f3-9276-43ae-9f55-d9cab70a9ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:47.983709 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bd2f3-9276-43ae-9f55-d9cab70a9ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:47.983994 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bd2f3-9276-43ae-9f55-d9cab70a9ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:47.984385 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bd2f3-9276-43ae-9f55-d9cab70a9ce6 admin admin] PATH_INFO: `/v3/projects/dd501ec0c1334707a5e896593e08640a` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:47.987147 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bd2f3-9276-43ae-9f55-d9cab70a9ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd501ec0c1334707a5e896593e08640a)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:47.989162 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900bd2f3-9276-43ae-9f55-d9cab70a9ce6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:47.996780 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32550b-8101-4304-bdd4-17a938234cef None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:48.011200 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315c46b-26b1-4fd7-a450-454e498b6191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:48.011904 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315c46b-26b1-4fd7-a450-454e498b6191 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:48.012197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315c46b-26b1-4fd7-a450-454e498b6191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:48.012492 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315c46b-26b1-4fd7-a450-454e498b6191 admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:48.013563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315c46b-26b1-4fd7-a450-454e498b6191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:12:48.013962 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315c46b-26b1-4fd7-a450-454e498b6191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:48.017322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315c46b-26b1-4fd7-a450-454e498b6191 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:48.050980 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1175/2388] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:12:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:12:48.055596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315c46b-26b1-4fd7-a450-454e498b6191 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:48.075289 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315c46b-26b1-4fd7-a450-454e498b6191 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:48.088747 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ec5e3-4766-48cd-8b6f-6d626cd22074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:48.089382 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ec5e3-4766-48cd-8b6f-6d626cd22074 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:48.089668 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ec5e3-4766-48cd-8b6f-6d626cd22074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:48.089973 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ec5e3-4766-48cd-8b6f-6d626cd22074 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:48.090922 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ec5e3-4766-48cd-8b6f-6d626cd22074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:48.093274 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ec5e3-4766-48cd-8b6f-6d626cd22074 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:48.112928 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-900bd2f3-9276-43ae-9f55-d9cab70a9ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd501ec0c1334707a5e896593e08640a', 'request_id': 'req-900bd2f3-9276-43ae-9f55-d9cab70a9ce6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:48.126322 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-900bd2f3-9276-43ae-9f55-d9cab70a9ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd501ec0c1334707a5e896593e08640a', 'request_id': 'req-900bd2f3-9276-43ae-9f55-d9cab70a9ce6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:48.139615 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-900bd2f3-9276-43ae-9f55-d9cab70a9ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd501ec0c1334707a5e896593e08640a', 'request_id': 'req-900bd2f3-9276-43ae-9f55-d9cab70a9ce6'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:48.163398 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1176/2389] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:48 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:48.165586 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ec5e3-4766-48cd-8b6f-6d626cd22074 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:48.168566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-900bd2f3-9276-43ae-9f55-d9cab70a9ce6 admin admin] The token cache is being invalidate because project dd501ec0c1334707a5e896593e08640a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:48.170557 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-900bd2f3-9276-43ae-9f55-d9cab70a9ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:48.171544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-900bd2f3-9276-43ae-9f55-d9cab70a9ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:48.179096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1214/2390] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:47 2022] DELETE /identity/v3/projects/dd501ec0c1334707a5e896593e08640a => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:48.184086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a56e6-a84e-4349-9d36-ab7a9d531a1a None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:48.184377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a56e6-a84e-4349-9d36-ab7a9d531a1a None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:48.184769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a56e6-a84e-4349-9d36-ab7a9d531a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:48.216288 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c96a56e6-a84e-4349-9d36-ab7a9d531a1a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:48.218003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c96a56e6-a84e-4349-9d36-ab7a9d531a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:48.278749 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ec5e3-4766-48cd-8b6f-6d626cd22074 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:48.285093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88605876-05e0-4869-96e2-f2f2f963201e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:48.285817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88605876-05e0-4869-96e2-f2f2f963201e admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:48.285817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88605876-05e0-4869-96e2-f2f2f963201e admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:48.285817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88605876-05e0-4869-96e2-f2f2f963201e admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:48.285817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88605876-05e0-4869-96e2-f2f2f963201e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:48.293650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88605876-05e0-4869-96e2-f2f2f963201e admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:48.339218 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1177/2391] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:48 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:48.343709 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88605876-05e0-4869-96e2-f2f2f963201e admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:48.346543 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-88605876-05e0-4869-96e2-f2f2f963201e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:48.363596 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88605876-05e0-4869-96e2-f2f2f963201e admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:48.369109 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1215/2392] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:48.376233 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb9c36-fe59-46d0-bf56-b5b8aaeca3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:48.376968 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb9c36-fe59-46d0-bf56-b5b8aaeca3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:48.377393 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb9c36-fe59-46d0-bf56-b5b8aaeca3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:48.377786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb9c36-fe59-46d0-bf56-b5b8aaeca3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:48.378878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb9c36-fe59-46d0-bf56-b5b8aaeca3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:48.379190 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0659da8-1166-4eb7-bf21-a09a0b448111 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:48.379778 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0659da8-1166-4eb7-bf21-a09a0b448111 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:48.381181 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0659da8-1166-4eb7-bf21-a09a0b448111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:48.381752 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb9c36-fe59-46d0-bf56-b5b8aaeca3a5 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:48.401489 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1178/2393] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:48.406201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb9c36-fe59-46d0-bf56-b5b8aaeca3a5 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:48.418993 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb9c36-fe59-46d0-bf56-b5b8aaeca3a5 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:48.432160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c0659da8-1166-4eb7-bf21-a09a0b448111 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:48.433635 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c0659da8-1166-4eb7-bf21-a09a0b448111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:48.433799 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11982b88-7799-4b72-8a1b-6456eea32222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:48.434520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11982b88-7799-4b72-8a1b-6456eea32222 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:48.434944 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11982b88-7799-4b72-8a1b-6456eea32222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:48.435340 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11982b88-7799-4b72-8a1b-6456eea32222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:48.436023 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11982b88-7799-4b72-8a1b-6456eea32222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:48.439903 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11982b88-7799-4b72-8a1b-6456eea32222 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:48.448225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1216/2394] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:48.452433 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0659da8-1166-4eb7-bf21-a09a0b448111 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:48.456540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1179/2395] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:48.458192 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11982b88-7799-4b72-8a1b-6456eea32222 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:48.470639 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11982b88-7799-4b72-8a1b-6456eea32222 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:48.471056 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0659da8-1166-4eb7-bf21-a09a0b448111 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:48.488597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccee418-bb2a-483a-938f-c3cf2570d287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:48.488597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccee418-bb2a-483a-938f-c3cf2570d287 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:48.488597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccee418-bb2a-483a-938f-c3cf2570d287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:48.488597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccee418-bb2a-483a-938f-c3cf2570d287 admin admin] PATH_INFO: `/v3/projects/273c1a0c72974d8e985e0756cec4047f/users/b225a7ff45084cc8b1047b3ef31cc6a9/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:48.489106 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0cb85-dd51-4816-a625-b6b3526cc17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:48.489106 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0cb85-dd51-4816-a625-b6b3526cc17d admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:48.489106 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0cb85-dd51-4816-a625-b6b3526cc17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:48.489106 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0cb85-dd51-4816-a625-b6b3526cc17d admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:48.489385 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0cb85-dd51-4816-a625-b6b3526cc17d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:12:48.489385 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0cb85-dd51-4816-a625-b6b3526cc17d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:48.489385 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0cb85-dd51-4816-a625-b6b3526cc17d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:48.509900 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1217/2396] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:12:48.510892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0cb85-dd51-4816-a625-b6b3526cc17d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:48.518374 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccee418-bb2a-483a-938f-c3cf2570d287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=273c1a0c72974d8e985e0756cec4047f, user_id=b225a7ff45084cc8b1047b3ef31cc6a9, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:48.522023 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccee418-bb2a-483a-938f-c3cf2570d287 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:48.522211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0cb85-dd51-4816-a625-b6b3526cc17d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:48.527042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7002073-491d-4878-b1c1-4f7643df495a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:48.527709 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7002073-491d-4878-b1c1-4f7643df495a admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:48.528068 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7002073-491d-4878-b1c1-4f7643df495a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:48.528339 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7002073-491d-4878-b1c1-4f7643df495a admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:48.529135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7002073-491d-4878-b1c1-4f7643df495a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:48.531250 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7002073-491d-4878-b1c1-4f7643df495a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:48.540301 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1180/2397] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:48 2022] PUT /identity/v3/projects/273c1a0c72974d8e985e0756cec4047f/users/b225a7ff45084cc8b1047b3ef31cc6a9/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:48.546573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba807016-d7fc-439b-b1be-f1a48b3c2468 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:48.547115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba807016-d7fc-439b-b1be-f1a48b3c2468 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:48.547599 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba807016-d7fc-439b-b1be-f1a48b3c2468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:48.574382 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1218/2398] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:48 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:48.581773 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7002073-491d-4878-b1c1-4f7643df495a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:48.587186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-ba807016-d7fc-439b-b1be-f1a48b3c2468 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:48.589652 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ba807016-d7fc-439b-b1be-f1a48b3c2468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:48.622584 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:48.651263 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:48.717629 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1181/2399] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:48.737815 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba807016-d7fc-439b-b1be-f1a48b3c2468 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:48.739302 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ba807016-d7fc-439b-b1be-f1a48b3c2468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:48.755803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7002073-491d-4878-b1c1-4f7643df495a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:48.766343 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf7007-1a4f-4f37-9912-fc46b42ab344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:48.767295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf7007-1a4f-4f37-9912-fc46b42ab344 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:48.768264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf7007-1a4f-4f37-9912-fc46b42ab344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:48.768786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf7007-1a4f-4f37-9912-fc46b42ab344 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:48.769827 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf7007-1a4f-4f37-9912-fc46b42ab344 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:48.774161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf7007-1a4f-4f37-9912-fc46b42ab344 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:48.806851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1219/2400] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:48 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:12:48.811688 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf7007-1a4f-4f37-9912-fc46b42ab344 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:48.818400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba807016-d7fc-439b-b1be-f1a48b3c2468 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:48.824281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6544e9-00e8-41fe-8c1a-38d8bad1979b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:48.825272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6544e9-00e8-41fe-8c1a-38d8bad1979b service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:48.825719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6544e9-00e8-41fe-8c1a-38d8bad1979b service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:48.826240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6544e9-00e8-41fe-8c1a-38d8bad1979b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:48.826499 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf7007-1a4f-4f37-9912-fc46b42ab344 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:48.832909 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd32a24-561c-4a25-9a82-0366e78b1574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:48.833530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd32a24-561c-4a25-9a82-0366e78b1574 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:48.834220 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd32a24-561c-4a25-9a82-0366e78b1574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:48.834507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd32a24-561c-4a25-9a82-0366e78b1574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:48.836045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd32a24-561c-4a25-9a82-0366e78b1574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:48.837737 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd32a24-561c-4a25-9a82-0366e78b1574 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:48.843411 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6544e9-00e8-41fe-8c1a-38d8bad1979b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:48.846407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6544e9-00e8-41fe-8c1a-38d8bad1979b service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:48.852493 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1220/2401] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:12:48.856445 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd32a24-561c-4a25-9a82-0366e78b1574 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:48.864931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1182/2402] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:48.870762 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd32a24-561c-4a25-9a82-0366e78b1574 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:48.879257 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21494fea-164e-4930-9d38-864ef606da43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:48.880568 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21494fea-164e-4930-9d38-864ef606da43 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:48.881045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21494fea-164e-4930-9d38-864ef606da43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:48.881507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21494fea-164e-4930-9d38-864ef606da43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:48.882775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21494fea-164e-4930-9d38-864ef606da43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:48.885256 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21494fea-164e-4930-9d38-864ef606da43 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:48.899545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1221/2403] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:12:48.904273 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6544e9-00e8-41fe-8c1a-38d8bad1979b service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:48.918399 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6544e9-00e8-41fe-8c1a-38d8bad1979b service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:48.923371 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5430f5c-7024-431b-a0a4-da2252e3c89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:48.924078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5430f5c-7024-431b-a0a4-da2252e3c89c admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:48.924584 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5430f5c-7024-431b-a0a4-da2252e3c89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:48.924958 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5430f5c-7024-431b-a0a4-da2252e3c89c admin admin] PATH_INFO: `/v3/projects/607f7186aca74b5db1fde23139678dd8/users/b45234fe1bb44d7c8017f35f13cf8249/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:48.947273 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5430f5c-7024-431b-a0a4-da2252e3c89c admin admin] RBAC: Authorizing `identity:create_grant(project_id=607f7186aca74b5db1fde23139678dd8, user_id=b45234fe1bb44d7c8017f35f13cf8249, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:48.947273 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5430f5c-7024-431b-a0a4-da2252e3c89c admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:48.977600 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1183/2404] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:48 2022] PUT /identity/v3/projects/607f7186aca74b5db1fde23139678dd8/users/b45234fe1bb44d7c8017f35f13cf8249/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:48.991086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6287bdd-9cbf-4475-b842-469787a54e0c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:48.991368 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6287bdd-9cbf-4475-b842-469787a54e0c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:48.991659 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6287bdd-9cbf-4475-b842-469787a54e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:49.020952 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-c6287bdd-9cbf-4475-b842-469787a54e0c None None] MFA Rules not processed for user `b45234fe1bb44d7c8017f35f13cf8249`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:49.022178 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c6287bdd-9cbf-4475-b842-469787a54e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:49.136344 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1222/2405] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:49.152811 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5430f5c-7024-431b-a0a4-da2252e3c89c admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:49.157863 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-d5430f5c-7024-431b-a0a4-da2252e3c89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:49.241984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5430f5c-7024-431b-a0a4-da2252e3c89c admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:49.246083 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69addfff-4a14-42c1-8b25-8cf40346f21e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:49.246704 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69addfff-4a14-42c1-8b25-8cf40346f21e service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:49.247130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69addfff-4a14-42c1-8b25-8cf40346f21e service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:49.247448 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69addfff-4a14-42c1-8b25-8cf40346f21e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:49.258016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69addfff-4a14-42c1-8b25-8cf40346f21e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:49.259452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69addfff-4a14-42c1-8b25-8cf40346f21e service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:49.269831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1184/2406] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:49.965335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6287bdd-9cbf-4475-b842-469787a54e0c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:49.967964 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c6287bdd-9cbf-4475-b842-469787a54e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:50.073939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6287bdd-9cbf-4475-b842-469787a54e0c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:50.079381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf349711-8cef-402a-889d-1cb6ec67965d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:50.080045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf349711-8cef-402a-889d-1cb6ec67965d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:50.080524 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf349711-8cef-402a-889d-1cb6ec67965d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:50.081512 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf349711-8cef-402a-889d-1cb6ec67965d admin admin] PATH_INFO: `/v3/users/651dd7e6057544e0b33493fb26dd1424` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:50.082842 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf349711-8cef-402a-889d-1cb6ec67965d admin admin] RBAC: Authorizing `identity:delete_user(user_id=651dd7e6057544e0b33493fb26dd1424)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:50.084911 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf349711-8cef-402a-889d-1cb6ec67965d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:50.103853 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:50.188261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bf349711-8cef-402a-889d-1cb6ec67965d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '651dd7e6057544e0b33493fb26dd1424'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:50.189107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bf349711-8cef-402a-889d-1cb6ec67965d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '651dd7e6057544e0b33493fb26dd1424'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:50.198865 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bf349711-8cef-402a-889d-1cb6ec67965d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '651dd7e6057544e0b33493fb26dd1424'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:50.226941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bf349711-8cef-402a-889d-1cb6ec67965d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '651dd7e6057544e0b33493fb26dd1424'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:50.240630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bf349711-8cef-402a-889d-1cb6ec67965d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '651dd7e6057544e0b33493fb26dd1424'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:50.252932 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1223/2407] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:49 2022] DELETE /identity/v3/users/651dd7e6057544e0b33493fb26dd1424 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:50.258261 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67060b2-dd37-40fb-b4ff-47b78f8ddb4a None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:50.259050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67060b2-dd37-40fb-b4ff-47b78f8ddb4a None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:50.259475 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67060b2-dd37-40fb-b4ff-47b78f8ddb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:50.289422 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-f67060b2-dd37-40fb-b4ff-47b78f8ddb4a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:50.292442 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f67060b2-dd37-40fb-b4ff-47b78f8ddb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:50.388159 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:50.410719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1185/2408] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:50.417906 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf349711-8cef-402a-889d-1cb6ec67965d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:50.419344 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-bf349711-8cef-402a-889d-1cb6ec67965d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:50.490089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf349711-8cef-402a-889d-1cb6ec67965d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:50.494648 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7580dcc-749e-41ac-91d7-643baa9044e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:50.495490 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7580dcc-749e-41ac-91d7-643baa9044e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:50.495791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7580dcc-749e-41ac-91d7-643baa9044e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:50.496202 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7580dcc-749e-41ac-91d7-643baa9044e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:50.518862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7580dcc-749e-41ac-91d7-643baa9044e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:50.520596 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7580dcc-749e-41ac-91d7-643baa9044e8 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:50.545600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1224/2409] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:50.761375 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67060b2-dd37-40fb-b4ff-47b78f8ddb4a None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:50.762750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f67060b2-dd37-40fb-b4ff-47b78f8ddb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:50.787723 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67060b2-dd37-40fb-b4ff-47b78f8ddb4a None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:50.800870 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5705a30-9843-4295-9d61-04b8a0f61b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:50.801543 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5705a30-9843-4295-9d61-04b8a0f61b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:50.801826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5705a30-9843-4295-9d61-04b8a0f61b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:50.802100 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5705a30-9843-4295-9d61-04b8a0f61b5b admin admin] PATH_INFO: `/v3/users/e6c30c9f2a894eb290e072aeba399bd0` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:50.804088 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5705a30-9843-4295-9d61-04b8a0f61b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c30c9f2a894eb290e072aeba399bd0)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:50.806075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5705a30-9843-4295-9d61-04b8a0f61b5b admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:50.908406 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a5705a30-9843-4295-9d61-04b8a0f61b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c30c9f2a894eb290e072aeba399bd0'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:50.909999 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a5705a30-9843-4295-9d61-04b8a0f61b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c30c9f2a894eb290e072aeba399bd0'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:50.928105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a5705a30-9843-4295-9d61-04b8a0f61b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c30c9f2a894eb290e072aeba399bd0'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:50.938106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a5705a30-9843-4295-9d61-04b8a0f61b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c30c9f2a894eb290e072aeba399bd0'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:50.939059 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a5705a30-9843-4295-9d61-04b8a0f61b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c30c9f2a894eb290e072aeba399bd0'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:50.960500 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1186/2410] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:50 2022] DELETE /identity/v3/users/e6c30c9f2a894eb290e072aeba399bd0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:50.969709 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0023e67-2416-49f8-8192-bc3e324adf0d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:50.971809 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0023e67-2416-49f8-8192-bc3e324adf0d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:50.973519 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0023e67-2416-49f8-8192-bc3e324adf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:51.043457 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5705a30-9843-4295-9d61-04b8a0f61b5b admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:51.046257 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a5705a30-9843-4295-9d61-04b8a0f61b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:51.055414 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e0023e67-2416-49f8-8192-bc3e324adf0d None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:51.058241 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e0023e67-2416-49f8-8192-bc3e324adf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:51.283203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1225/2411] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:51.283550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5705a30-9843-4295-9d61-04b8a0f61b5b admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:51.308779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0023e67-2416-49f8-8192-bc3e324adf0d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:51.313614 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e0023e67-2416-49f8-8192-bc3e324adf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:51.319070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0726a-5cbf-4c03-88d1-7675717ab578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:51.322277 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0726a-5cbf-4c03-88d1-7675717ab578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:51.322718 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0726a-5cbf-4c03-88d1-7675717ab578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:51.323135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0726a-5cbf-4c03-88d1-7675717ab578 admin admin] PATH_INFO: `/v3/users/0d678ac2ab4e422eba29571da8b92069` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:51.341724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0726a-5cbf-4c03-88d1-7675717ab578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d678ac2ab4e422eba29571da8b92069)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:51.345739 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0726a-5cbf-4c03-88d1-7675717ab578 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:51.384930 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:51.454299 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-2fa0726a-5cbf-4c03-88d1-7675717ab578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d678ac2ab4e422eba29571da8b92069'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:51.454777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0023e67-2416-49f8-8192-bc3e324adf0d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:51.454973 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-2fa0726a-5cbf-4c03-88d1-7675717ab578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d678ac2ab4e422eba29571da8b92069'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:51.461200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53097b5a-ee56-433e-bdb8-a96cb594ce7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:51.462798 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53097b5a-ee56-433e-bdb8-a96cb594ce7c service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:51.463319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53097b5a-ee56-433e-bdb8-a96cb594ce7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:51.463912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53097b5a-ee56-433e-bdb8-a96cb594ce7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:51.476643 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53097b5a-ee56-433e-bdb8-a96cb594ce7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:51.478668 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-2fa0726a-5cbf-4c03-88d1-7675717ab578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d678ac2ab4e422eba29571da8b92069'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:51.479859 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53097b5a-ee56-433e-bdb8-a96cb594ce7c service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:51.485088 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:51.494218 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-2fa0726a-5cbf-4c03-88d1-7675717ab578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d678ac2ab4e422eba29571da8b92069'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:51.495475 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-2fa0726a-5cbf-4c03-88d1-7675717ab578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d678ac2ab4e422eba29571da8b92069'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:51.497649 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1226/2412] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:51.511586 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1187/2413] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:51 2022] DELETE /identity/v3/users/0d678ac2ab4e422eba29571da8b92069 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:51.516587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eaa52-e0d8-4454-8e97-6200fe1064d3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:51.516922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eaa52-e0d8-4454-8e97-6200fe1064d3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:51.517161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eaa52-e0d8-4454-8e97-6200fe1064d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:51.535125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0726a-5cbf-4c03-88d1-7675717ab578 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:51.538517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2fa0726a-5cbf-4c03-88d1-7675717ab578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:51.561465 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-726eaa52-e0d8-4454-8e97-6200fe1064d3 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:51.562717 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-726eaa52-e0d8-4454-8e97-6200fe1064d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:51.713951 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0726a-5cbf-4c03-88d1-7675717ab578 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:51.725496 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1227/2414] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:51.729073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e5e74-b1e5-429f-8860-2b576d9acf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:51.730744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e5e74-b1e5-429f-8860-2b576d9acf07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:51.731362 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e5e74-b1e5-429f-8860-2b576d9acf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:51.733161 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e5e74-b1e5-429f-8860-2b576d9acf07 admin admin] PATH_INFO: `/v3/projects/bb59601be26f4af78360550ab447ef7b` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:51.737682 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e5e74-b1e5-429f-8860-2b576d9acf07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb59601be26f4af78360550ab447ef7b)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:51.744503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e5e74-b1e5-429f-8860-2b576d9acf07 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:51.745335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eaa52-e0d8-4454-8e97-6200fe1064d3 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:51.747661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-726eaa52-e0d8-4454-8e97-6200fe1064d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:51.843049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c25e5e74-b1e5-429f-8860-2b576d9acf07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb59601be26f4af78360550ab447ef7b', 'request_id': 'req-c25e5e74-b1e5-429f-8860-2b576d9acf07'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:51.854484 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c25e5e74-b1e5-429f-8860-2b576d9acf07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb59601be26f4af78360550ab447ef7b', 'request_id': 'req-c25e5e74-b1e5-429f-8860-2b576d9acf07'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:51.866679 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eaa52-e0d8-4454-8e97-6200fe1064d3 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:51.872404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c25e5e74-b1e5-429f-8860-2b576d9acf07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb59601be26f4af78360550ab447ef7b', 'request_id': 'req-c25e5e74-b1e5-429f-8860-2b576d9acf07'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:51.905466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c25e5e74-b1e5-429f-8860-2b576d9acf07 admin admin] The token cache is being invalidate because project bb59601be26f4af78360550ab447ef7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:51.906266 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c25e5e74-b1e5-429f-8860-2b576d9acf07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:51.907369 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c25e5e74-b1e5-429f-8860-2b576d9acf07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:51.910837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1188/2415] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:51 2022] DELETE /identity/v3/projects/bb59601be26f4af78360550ab447ef7b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:51.923074 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d296e-b9fc-41f2-a2b6-c8dcec3edc89 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:51.923583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d296e-b9fc-41f2-a2b6-c8dcec3edc89 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:51.925017 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d296e-b9fc-41f2-a2b6-c8dcec3edc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:51.974204 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-5f3d296e-b9fc-41f2-a2b6-c8dcec3edc89 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:51.977605 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-5f3d296e-b9fc-41f2-a2b6-c8dcec3edc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:51.989978 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae563321-ec22-4e16-9f63-5a1ca84a4dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:51.990882 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae563321-ec22-4e16-9f63-5a1ca84a4dff service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:51.991175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae563321-ec22-4e16-9f63-5a1ca84a4dff service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:51.991657 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae563321-ec22-4e16-9f63-5a1ca84a4dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:51.995067 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ae563321-ec22-4e16-9f63-5a1ca84a4dff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:52.060429 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:52.102294 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae563321-ec22-4e16-9f63-5a1ca84a4dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:52.105694 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae563321-ec22-4e16-9f63-5a1ca84a4dff service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:52.133413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1228/2416] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:12:52.148624 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1189/2417] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:52.161147 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed31258-5044-42ee-921c-b4c3ebc2419b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:52.161147 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed31258-5044-42ee-921c-b4c3ebc2419b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:52.162840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed31258-5044-42ee-921c-b4c3ebc2419b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:52.171288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d296e-b9fc-41f2-a2b6-c8dcec3edc89 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:52.181311 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-5f3d296e-b9fc-41f2-a2b6-c8dcec3edc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:52.211861 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d296e-b9fc-41f2-a2b6-c8dcec3edc89 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:52.213556 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-aed31258-5044-42ee-921c-b4c3ebc2419b None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:52.214823 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-aed31258-5044-42ee-921c-b4c3ebc2419b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:52.224214 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc730b-11c0-482f-9b6c-7b6c49509624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:52.224652 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc730b-11c0-482f-9b6c-7b6c49509624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:52.224943 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc730b-11c0-482f-9b6c-7b6c49509624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:52.225227 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc730b-11c0-482f-9b6c-7b6c49509624 admin admin] PATH_INFO: `/v3/projects/8e788321ea1a4a5ea54b560bf88c1d4a` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:52.226853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc730b-11c0-482f-9b6c-7b6c49509624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e788321ea1a4a5ea54b560bf88c1d4a)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:52.229755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc730b-11c0-482f-9b6c-7b6c49509624 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:52.237367 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1229/2418] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:52.241683 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed31258-5044-42ee-921c-b4c3ebc2419b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:52.262012 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:52.263997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed31258-5044-42ee-921c-b4c3ebc2419b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:52.278718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d0385-24b7-4890-b409-1ad043a1acad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:52.279425 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d0385-24b7-4890-b409-1ad043a1acad admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:52.279425 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d0385-24b7-4890-b409-1ad043a1acad admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:52.279792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d0385-24b7-4890-b409-1ad043a1acad admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:52.280922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d0385-24b7-4890-b409-1ad043a1acad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:12:52.281242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d0385-24b7-4890-b409-1ad043a1acad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:52.282858 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d0385-24b7-4890-b409-1ad043a1acad admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:52.298837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1230/2419] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 10:12:52.304580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d0385-24b7-4890-b409-1ad043a1acad admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:52.326351 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d0385-24b7-4890-b409-1ad043a1acad admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:52.344982 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-6bdc730b-11c0-482f-9b6c-7b6c49509624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e788321ea1a4a5ea54b560bf88c1d4a', 'request_id': 'req-6bdc730b-11c0-482f-9b6c-7b6c49509624'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:52.354662 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-6bdc730b-11c0-482f-9b6c-7b6c49509624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e788321ea1a4a5ea54b560bf88c1d4a', 'request_id': 'req-6bdc730b-11c0-482f-9b6c-7b6c49509624'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:52.365074 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-6bdc730b-11c0-482f-9b6c-7b6c49509624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e788321ea1a4a5ea54b560bf88c1d4a', 'request_id': 'req-6bdc730b-11c0-482f-9b6c-7b6c49509624'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:52.413826 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef65c83-aed7-42dd-a94f-7b203a842b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:52.417276 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-6bdc730b-11c0-482f-9b6c-7b6c49509624 admin admin] The token cache is being invalidate because project 8e788321ea1a4a5ea54b560bf88c1d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:52.417738 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-6bdc730b-11c0-482f-9b6c-7b6c49509624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:52.418016 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef65c83-aed7-42dd-a94f-7b203a842b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:52.418357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef65c83-aed7-42dd-a94f-7b203a842b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:52.418642 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef65c83-aed7-42dd-a94f-7b203a842b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:52.419343 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef65c83-aed7-42dd-a94f-7b203a842b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:52.419940 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-6bdc730b-11c0-482f-9b6c-7b6c49509624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:52.423067 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1190/2420] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:52 2022] DELETE /identity/v3/projects/8e788321ea1a4a5ea54b560bf88c1d4a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:52.428398 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7984454-4367-4894-860c-7c6a40819c69 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:52.429908 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef65c83-aed7-42dd-a94f-7b203a842b7d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:52.430017 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7984454-4367-4894-860c-7c6a40819c69 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:52.430017 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7984454-4367-4894-860c-7c6a40819c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:52.489825 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1231/2421] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:52 2022] POST /identity/v3/projects => generated 391 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:52.495066 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef65c83-aed7-42dd-a94f-7b203a842b7d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:52.504674 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8ef65c83-aed7-42dd-a94f-7b203a842b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:52.505645 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-a7984454-4367-4894-860c-7c6a40819c69 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:52.510624 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a7984454-4367-4894-860c-7c6a40819c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:52.695595 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef65c83-aed7-42dd-a94f-7b203a842b7d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:52.700971 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb29ab2-9a32-4fa2-8432-c6676849b652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:52.701613 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb29ab2-9a32-4fa2-8432-c6676849b652 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:52.701897 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb29ab2-9a32-4fa2-8432-c6676849b652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:52.702173 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb29ab2-9a32-4fa2-8432-c6676849b652 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:52.702872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb29ab2-9a32-4fa2-8432-c6676849b652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:52.705081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb29ab2-9a32-4fa2-8432-c6676849b652 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:52.705972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1191/2422] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:12:52.714834 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71e3e6-d494-4b89-96bf-61634d7e0ad2 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:52.715094 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71e3e6-d494-4b89-96bf-61634d7e0ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:52.715353 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71e3e6-d494-4b89-96bf-61634d7e0ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:52.745931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-4c71e3e6-d494-4b89-96bf-61634d7e0ad2 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:52.747023 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4c71e3e6-d494-4b89-96bf-61634d7e0ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:52.750028 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1232/2423] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:52 2022] POST /identity/v3/users => generated 296 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:52.755405 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb29ab2-9a32-4fa2-8432-c6676849b652 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:52.772571 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb29ab2-9a32-4fa2-8432-c6676849b652 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:52.773379 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1192/2424] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:12:52.774988 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71e3e6-d494-4b89-96bf-61634d7e0ad2 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:52.778260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92862608-46bd-42ae-9a70-81096e41f688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:52.778951 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92862608-46bd-42ae-9a70-81096e41f688 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:52.779282 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92862608-46bd-42ae-9a70-81096e41f688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:52.779562 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92862608-46bd-42ae-9a70-81096e41f688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:52.780384 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92862608-46bd-42ae-9a70-81096e41f688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:52.782146 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92862608-46bd-42ae-9a70-81096e41f688 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:52.792927 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71e3e6-d494-4b89-96bf-61634d7e0ad2 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:52.801320 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb941a-3e8c-4eb3-a331-9123df49d6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:52.802642 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb941a-3e8c-4eb3-a331-9123df49d6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:52.802950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb941a-3e8c-4eb3-a331-9123df49d6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:52.803221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb941a-3e8c-4eb3-a331-9123df49d6a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:52.803986 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb941a-3e8c-4eb3-a331-9123df49d6a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:12:52.804300 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb941a-3e8c-4eb3-a331-9123df49d6a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:52.806233 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb941a-3e8c-4eb3-a331-9123df49d6a7 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:52.808667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1233/2425] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:52.809548 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92862608-46bd-42ae-9a70-81096e41f688 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:52.821200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92862608-46bd-42ae-9a70-81096e41f688 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:52.825871 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1193/2426] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:12:52.827545 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb941a-3e8c-4eb3-a331-9123df49d6a7 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:52.830600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d43ea-1598-4556-88af-cd1468a771b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:52.831480 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d43ea-1598-4556-88af-cd1468a771b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:52.831704 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d43ea-1598-4556-88af-cd1468a771b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:52.832011 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d43ea-1598-4556-88af-cd1468a771b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:52.832800 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d43ea-1598-4556-88af-cd1468a771b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:52.834777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d43ea-1598-4556-88af-cd1468a771b0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:52.840106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb941a-3e8c-4eb3-a331-9123df49d6a7 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:52.845456 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b58b3-bee0-4229-a7ea-39853a39c598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:52.846231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b58b3-bee0-4229-a7ea-39853a39c598 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:52.846510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b58b3-bee0-4229-a7ea-39853a39c598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:52.846832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b58b3-bee0-4229-a7ea-39853a39c598 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:52.847481 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1234/2427] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:52.848127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b58b3-bee0-4229-a7ea-39853a39c598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:52.850475 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b58b3-bee0-4229-a7ea-39853a39c598 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:52.852525 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d43ea-1598-4556-88af-cd1468a771b0 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:52.866189 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d43ea-1598-4556-88af-cd1468a771b0 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:52.872563 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1664063-4a07-4276-9c78-cb0452e5b843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:52.873258 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1664063-4a07-4276-9c78-cb0452e5b843 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:52.873598 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1664063-4a07-4276-9c78-cb0452e5b843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:52.873928 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1664063-4a07-4276-9c78-cb0452e5b843 admin admin] PATH_INFO: `/v3/projects/8176ce6ad86e4cbf83d7015b841dd5d3/users/14c060b0e3554f10b9e87542cdd027aa/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:52.895741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1194/2428] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:52 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:12:52.895927 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1664063-4a07-4276-9c78-cb0452e5b843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8176ce6ad86e4cbf83d7015b841dd5d3, user_id=14c060b0e3554f10b9e87542cdd027aa, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:52.897038 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b58b3-bee0-4229-a7ea-39853a39c598 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:52.898622 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1664063-4a07-4276-9c78-cb0452e5b843 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:52.901249 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:52.920084 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1235/2429] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:52 2022] PUT /identity/v3/projects/8176ce6ad86e4cbf83d7015b841dd5d3/users/14c060b0e3554f10b9e87542cdd027aa/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:52.937580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb1303-32e3-4a29-8c61-1aaa0bf140fa None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:52.937820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb1303-32e3-4a29-8c61-1aaa0bf140fa None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:52.938076 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb1303-32e3-4a29-8c61-1aaa0bf140fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:52.981312 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-76eb1303-32e3-4a29-8c61-1aaa0bf140fa None None] MFA Rules not processed for user `14c060b0e3554f10b9e87542cdd027aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:52.983977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-76eb1303-32e3-4a29-8c61-1aaa0bf140fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:52.996269 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b58b3-bee0-4229-a7ea-39853a39c598 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:53.002946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:53.092192 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9c7c5-b428-4779-9c08-0dc851acc8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:53.092856 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9c7c5-b428-4779-9c08-0dc851acc8f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:53.093144 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9c7c5-b428-4779-9c08-0dc851acc8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:53.093420 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9c7c5-b428-4779-9c08-0dc851acc8f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:53.094164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9c7c5-b428-4779-9c08-0dc851acc8f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:53.097108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe9c7c5-b428-4779-9c08-0dc851acc8f2 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:53.099620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1236/2430] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:52 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:53.107833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb1303-32e3-4a29-8c61-1aaa0bf140fa None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:53.109351 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-76eb1303-32e3-4a29-8c61-1aaa0bf140fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:53.134130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1195/2431] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:52 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:53.137195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9c7c5-b428-4779-9c08-0dc851acc8f2 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:53.149471 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9c7c5-b428-4779-9c08-0dc851acc8f2 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:53.155061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22357c-7ad9-4208-aa6f-737f17bf8df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:53.155795 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22357c-7ad9-4208-aa6f-737f17bf8df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:53.156166 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22357c-7ad9-4208-aa6f-737f17bf8df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:53.156723 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22357c-7ad9-4208-aa6f-737f17bf8df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:53.157401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22357c-7ad9-4208-aa6f-737f17bf8df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:53.162985 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22357c-7ad9-4208-aa6f-737f17bf8df6 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:53.188823 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1196/2432] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:53.193075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22357c-7ad9-4208-aa6f-737f17bf8df6 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:53.197961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb1303-32e3-4a29-8c61-1aaa0bf140fa None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:53.202448 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e8c30-5f5b-400c-b8ae-1daa5d1c1570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:53.203085 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e8c30-5f5b-400c-b8ae-1daa5d1c1570 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:53.203516 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e8c30-5f5b-400c-b8ae-1daa5d1c1570 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:53.203798 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e8c30-5f5b-400c-b8ae-1daa5d1c1570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:53.214987 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22357c-7ad9-4208-aa6f-737f17bf8df6 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:53.216650 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e8c30-5f5b-400c-b8ae-1daa5d1c1570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:53.219624 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e8c30-5f5b-400c-b8ae-1daa5d1c1570 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:53.222103 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c1173-048d-4022-a756-a7d41538226d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:53.222865 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c1173-048d-4022-a756-a7d41538226d admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:53.223229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c1173-048d-4022-a756-a7d41538226d admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:53.223582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c1173-048d-4022-a756-a7d41538226d admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:53.224853 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c1173-048d-4022-a756-a7d41538226d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:53.226367 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c1173-048d-4022-a756-a7d41538226d admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:53.243219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1237/2433] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:12:53.260730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e8c30-5f5b-400c-b8ae-1daa5d1c1570 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:53.261468 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1197/2434] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:53.276933 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e8c30-5f5b-400c-b8ae-1daa5d1c1570 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:53.297439 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1641bc4-30d3-4613-92ef-c706d521db6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:53.297905 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1641bc4-30d3-4613-92ef-c706d521db6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:53.298183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1641bc4-30d3-4613-92ef-c706d521db6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:53.298461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1641bc4-30d3-4613-92ef-c706d521db6d admin admin] PATH_INFO: `/v3/projects/7d82cae2f9064c61abe935ac24f1243e/users/773ebfa3530c4a818cdd435497d2c15e/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:53.326002 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1641bc4-30d3-4613-92ef-c706d521db6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d82cae2f9064c61abe935ac24f1243e, user_id=773ebfa3530c4a818cdd435497d2c15e, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:53.329977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1641bc4-30d3-4613-92ef-c706d521db6d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:53.370482 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1238/2435] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:53 2022] PUT /identity/v3/projects/7d82cae2f9064c61abe935ac24f1243e/users/773ebfa3530c4a818cdd435497d2c15e/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:53.373022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789901-78c1-44b6-ab64-6319daf8f083 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:53.373528 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789901-78c1-44b6-ab64-6319daf8f083 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:53.373631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789901-78c1-44b6-ab64-6319daf8f083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:53.428667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1641bc4-30d3-4613-92ef-c706d521db6d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:53.430656 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a1641bc4-30d3-4613-92ef-c706d521db6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:53.441423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-1b789901-78c1-44b6-ab64-6319daf8f083 None None] MFA Rules not processed for user `773ebfa3530c4a818cdd435497d2c15e`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:53.443135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-1b789901-78c1-44b6-ab64-6319daf8f083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:53.590859 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1641bc4-30d3-4613-92ef-c706d521db6d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:53.605843 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57803f-b15c-42c8-a64a-f6e9ec002a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:53.606518 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57803f-b15c-42c8-a64a-f6e9ec002a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:53.606800 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57803f-b15c-42c8-a64a-f6e9ec002a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:53.607074 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57803f-b15c-42c8-a64a-f6e9ec002a1e admin admin] PATH_INFO: `/v3/projects/6286601f19b0447bb58777f2a2d6c0f4` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:53.610438 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57803f-b15c-42c8-a64a-f6e9ec002a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6286601f19b0447bb58777f2a2d6c0f4)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:53.614198 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc57803f-b15c-42c8-a64a-f6e9ec002a1e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:53.617687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:53.631511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1198/2436] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:53.636193 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b789901-78c1-44b6-ab64-6319daf8f083 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:53.638846 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-1b789901-78c1-44b6-ab64-6319daf8f083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:53.741468 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bc57803f-b15c-42c8-a64a-f6e9ec002a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6286601f19b0447bb58777f2a2d6c0f4', 'request_id': 'req-bc57803f-b15c-42c8-a64a-f6e9ec002a1e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:53.758668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bc57803f-b15c-42c8-a64a-f6e9ec002a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6286601f19b0447bb58777f2a2d6c0f4', 'request_id': 'req-bc57803f-b15c-42c8-a64a-f6e9ec002a1e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:53.788295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bc57803f-b15c-42c8-a64a-f6e9ec002a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6286601f19b0447bb58777f2a2d6c0f4', 'request_id': 'req-bc57803f-b15c-42c8-a64a-f6e9ec002a1e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:53.801446 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b789901-78c1-44b6-ab64-6319daf8f083 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:53.816226 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bc57803f-b15c-42c8-a64a-f6e9ec002a1e admin admin] The token cache is being invalidate because project 6286601f19b0447bb58777f2a2d6c0f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:53.816566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bc57803f-b15c-42c8-a64a-f6e9ec002a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:53.818574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bc57803f-b15c-42c8-a64a-f6e9ec002a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:53.823565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1239/2437] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:53 2022] DELETE /identity/v3/projects/6286601f19b0447bb58777f2a2d6c0f4 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:12:53.838832 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07353c69-c4f2-4c5c-8251-5afa2c3c1db5 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:53.839129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07353c69-c4f2-4c5c-8251-5afa2c3c1db5 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:53.839411 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07353c69-c4f2-4c5c-8251-5afa2c3c1db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:53.861256 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:53.927811 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-07353c69-c4f2-4c5c-8251-5afa2c3c1db5 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:53.929265 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-07353c69-c4f2-4c5c-8251-5afa2c3c1db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:53.984702 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d3c0d-6f76-4f79-8a5d-a87d866669b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:53.985358 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d3c0d-6f76-4f79-8a5d-a87d866669b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:53.985902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d3c0d-6f76-4f79-8a5d-a87d866669b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:53.986195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4d3c0d-6f76-4f79-8a5d-a87d866669b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:53.992969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-9a4d3c0d-6f76-4f79-8a5d-a87d866669b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:54.049413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1240/2438] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:54.058326 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9829a-4f5a-461c-b71f-4bc2e5ff886c None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:54.058616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9829a-4f5a-461c-b71f-4bc2e5ff886c None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:54.059029 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9829a-4f5a-461c-b71f-4bc2e5ff886c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:54.091930 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1ff9829a-4f5a-461c-b71f-4bc2e5ff886c None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:54.093630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1ff9829a-4f5a-461c-b71f-4bc2e5ff886c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:54.105032 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1241/2439] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:54.109663 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9829a-4f5a-461c-b71f-4bc2e5ff886c None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:54.129147 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9829a-4f5a-461c-b71f-4bc2e5ff886c None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:54.140516 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07540299-42b9-4786-ac23-94b1f45bec01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:54.141243 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07540299-42b9-4786-ac23-94b1f45bec01 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:54.141528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07540299-42b9-4786-ac23-94b1f45bec01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:54.141872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07540299-42b9-4786-ac23-94b1f45bec01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:54.143440 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07540299-42b9-4786-ac23-94b1f45bec01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:12:54.143984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07540299-42b9-4786-ac23-94b1f45bec01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:54.146484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07540299-42b9-4786-ac23-94b1f45bec01 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:54.155587 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d3c0d-6f76-4f79-8a5d-a87d866669b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:54.157363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4d3c0d-6f76-4f79-8a5d-a87d866669b2 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:54.184823 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1199/2440] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:12:54.184923 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1242/2441] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:12:54.186399 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d3c0d-6f76-4f79-8a5d-a87d866669b2 service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:54.204965 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4d3c0d-6f76-4f79-8a5d-a87d866669b2 service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:54.214392 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd35fa2-9787-4052-95f8-ae082978b0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:54.214992 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd35fa2-9787-4052-95f8-ae082978b0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:54.215296 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd35fa2-9787-4052-95f8-ae082978b0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:54.215576 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd35fa2-9787-4052-95f8-ae082978b0c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:54.216267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd35fa2-9787-4052-95f8-ae082978b0c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:54.219235 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd35fa2-9787-4052-95f8-ae082978b0c2 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:54.263331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1200/2442] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:54 2022] POST /identity/v3/projects => generated 361 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:12:54.265581 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07540299-42b9-4786-ac23-94b1f45bec01 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:54.278506 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07540299-42b9-4786-ac23-94b1f45bec01 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:54.383591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f78806-3b24-439f-9e14-579809025d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:54.384330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f78806-3b24-439f-9e14-579809025d4b admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:54.385004 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f78806-3b24-439f-9e14-579809025d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:54.385350 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f78806-3b24-439f-9e14-579809025d4b admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:54.386113 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f78806-3b24-439f-9e14-579809025d4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:54.388606 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f78806-3b24-439f-9e14-579809025d4b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:54.434115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd35fa2-9787-4052-95f8-ae082978b0c2 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:54.434725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1243/2443] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:54 2022] POST /identity/v3/users => generated 281 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:12:54.484256 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd35fa2-9787-4052-95f8-ae082978b0c2 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:54.496604 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a60904-0a4b-4a55-9a7d-fc53a0fe45a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:54.497626 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a60904-0a4b-4a55-9a7d-fc53a0fe45a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:54.498519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a60904-0a4b-4a55-9a7d-fc53a0fe45a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:54.499012 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a60904-0a4b-4a55-9a7d-fc53a0fe45a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:54.499957 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a60904-0a4b-4a55-9a7d-fc53a0fe45a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:54.501999 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a60904-0a4b-4a55-9a7d-fc53a0fe45a2 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:54.517916 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1201/2444] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:54.522973 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f78806-3b24-439f-9e14-579809025d4b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:54.531264 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:54.542209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f78806-3b24-439f-9e14-579809025d4b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:54.557524 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41371d9-2e56-43a2-849f-8e546b76ab37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:54.558312 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41371d9-2e56-43a2-849f-8e546b76ab37 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:54.558594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41371d9-2e56-43a2-849f-8e546b76ab37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:54.559006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41371d9-2e56-43a2-849f-8e546b76ab37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:54.559708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41371d9-2e56-43a2-849f-8e546b76ab37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:54.561993 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41371d9-2e56-43a2-849f-8e546b76ab37 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:54.581755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1244/2445] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:54.584122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a60904-0a4b-4a55-9a7d-fc53a0fe45a2 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:54.599498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a60904-0a4b-4a55-9a7d-fc53a0fe45a2 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:54.611620 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc7f60-40fc-4322-a7f0-524ce0cb9291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:54.612616 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc7f60-40fc-4322-a7f0-524ce0cb9291 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:54.612891 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc7f60-40fc-4322-a7f0-524ce0cb9291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:54.613217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc7f60-40fc-4322-a7f0-524ce0cb9291 admin admin] PATH_INFO: `/v3/projects/60cf572521fb41f78631fcc6ba3a1fd5/users/bf771b950b564e469cb159422d2a000e/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:54.638709 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc7f60-40fc-4322-a7f0-524ce0cb9291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60cf572521fb41f78631fcc6ba3a1fd5, user_id=bf771b950b564e469cb159422d2a000e, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:54.644169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc7f60-40fc-4322-a7f0-524ce0cb9291 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:54.677709 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1202/2446] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:54 2022] PUT /identity/v3/projects/60cf572521fb41f78631fcc6ba3a1fd5/users/bf771b950b564e469cb159422d2a000e/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:54.680772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f633d7a-a754-40ed-b4c4-6ac7a1e83537 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:54.681197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f633d7a-a754-40ed-b4c4-6ac7a1e83537 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:54.681478 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f633d7a-a754-40ed-b4c4-6ac7a1e83537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:54.770021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6f633d7a-a754-40ed-b4c4-6ac7a1e83537 None None] MFA Rules not processed for user `bf771b950b564e469cb159422d2a000e`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:54.771637 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6f633d7a-a754-40ed-b4c4-6ac7a1e83537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:54.866791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1245/2447] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:54.906513 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc7f60-40fc-4322-a7f0-524ce0cb9291 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:54.909448 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-d5bc7f60-40fc-4322-a7f0-524ce0cb9291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:55.015811 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc7f60-40fc-4322-a7f0-524ce0cb9291 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:55.030608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb667988-6b59-4187-a745-8b13474d619b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:55.031256 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb667988-6b59-4187-a745-8b13474d619b service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:55.032200 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb667988-6b59-4187-a745-8b13474d619b service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:55.032503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb667988-6b59-4187-a745-8b13474d619b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:55.057100 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb667988-6b59-4187-a745-8b13474d619b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:55.061261 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb667988-6b59-4187-a745-8b13474d619b service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:55.078804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1203/2448] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:55.093782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f633d7a-a754-40ed-b4c4-6ac7a1e83537 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:55.273957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f633d7a-a754-40ed-b4c4-6ac7a1e83537 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:55.279773 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a5103-84bc-482a-8989-8a4288ea6da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:55.280670 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a5103-84bc-482a-8989-8a4288ea6da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:55.281120 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a5103-84bc-482a-8989-8a4288ea6da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:55.281536 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a5103-84bc-482a-8989-8a4288ea6da4 admin admin] PATH_INFO: `/v3/users/bf771b950b564e469cb159422d2a000e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:55.289774 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a5103-84bc-482a-8989-8a4288ea6da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf771b950b564e469cb159422d2a000e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:55.291776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a5103-84bc-482a-8989-8a4288ea6da4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:55.407080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e32a5103-84bc-482a-8989-8a4288ea6da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf771b950b564e469cb159422d2a000e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:55.407945 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e32a5103-84bc-482a-8989-8a4288ea6da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf771b950b564e469cb159422d2a000e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:55.420041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e32a5103-84bc-482a-8989-8a4288ea6da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf771b950b564e469cb159422d2a000e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:55.438290 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e32a5103-84bc-482a-8989-8a4288ea6da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf771b950b564e469cb159422d2a000e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:55.454506 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e32a5103-84bc-482a-8989-8a4288ea6da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf771b950b564e469cb159422d2a000e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:55.460897 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:55.474772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1246/2449] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:12:55 2022] DELETE /identity/v3/users/bf771b950b564e469cb159422d2a000e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:55.479196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7df552-49ef-44b7-9efd-bb0d3e672817 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:55.479701 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7df552-49ef-44b7-9efd-bb0d3e672817 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:55.479810 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7df552-49ef-44b7-9efd-bb0d3e672817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:55.518481 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-6e7df552-49ef-44b7-9efd-bb0d3e672817 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:55.520378 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-6e7df552-49ef-44b7-9efd-bb0d3e672817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:55.551233 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:55.624335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1204/2450] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:55.637012 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a5103-84bc-482a-8989-8a4288ea6da4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:55.638621 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e32a5103-84bc-482a-8989-8a4288ea6da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:55.722561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a5103-84bc-482a-8989-8a4288ea6da4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:55.726768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59256aa-4e34-48f6-b927-9d7527762fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:55.727419 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59256aa-4e34-48f6-b927-9d7527762fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:55.727889 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59256aa-4e34-48f6-b927-9d7527762fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:55.728171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59256aa-4e34-48f6-b927-9d7527762fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:55.770522 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59256aa-4e34-48f6-b927-9d7527762fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:55.771996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59256aa-4e34-48f6-b927-9d7527762fc2 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:55.794124 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1247/2451] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:12:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:12:56.005552 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ca9c9-6a1d-41a7-899f-d8e2e180b2df None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:56.006160 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ca9c9-6a1d-41a7-899f-d8e2e180b2df None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:56.006438 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ca9c9-6a1d-41a7-899f-d8e2e180b2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:56.068196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-f21ca9c9-6a1d-41a7-899f-d8e2e180b2df None None] MFA Rules not processed for user `773ebfa3530c4a818cdd435497d2c15e`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:56.073597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f21ca9c9-6a1d-41a7-899f-d8e2e180b2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:56.235883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1205/2452] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:56.401285 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59256aa-4e34-48f6-b927-9d7527762fc2 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:56.403616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c59256aa-4e34-48f6-b927-9d7527762fc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:56.444418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59256aa-4e34-48f6-b927-9d7527762fc2 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:56.461165 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada51fe-4b27-4fe4-9788-2283c7fbd945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:56.462599 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada51fe-4b27-4fe4-9788-2283c7fbd945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:56.462599 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada51fe-4b27-4fe4-9788-2283c7fbd945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:56.462781 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada51fe-4b27-4fe4-9788-2283c7fbd945 admin admin] PATH_INFO: `/v3/projects/60cf572521fb41f78631fcc6ba3a1fd5` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:56.465276 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada51fe-4b27-4fe4-9788-2283c7fbd945 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60cf572521fb41f78631fcc6ba3a1fd5)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:56.478717 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada51fe-4b27-4fe4-9788-2283c7fbd945 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:56.573806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1ada51fe-4b27-4fe4-9788-2283c7fbd945 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60cf572521fb41f78631fcc6ba3a1fd5', 'request_id': 'req-1ada51fe-4b27-4fe4-9788-2283c7fbd945'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:56.589117 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1ada51fe-4b27-4fe4-9788-2283c7fbd945 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60cf572521fb41f78631fcc6ba3a1fd5', 'request_id': 'req-1ada51fe-4b27-4fe4-9788-2283c7fbd945'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:56.601312 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1ada51fe-4b27-4fe4-9788-2283c7fbd945 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60cf572521fb41f78631fcc6ba3a1fd5', 'request_id': 'req-1ada51fe-4b27-4fe4-9788-2283c7fbd945'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:56.624610 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1ada51fe-4b27-4fe4-9788-2283c7fbd945 admin admin] The token cache is being invalidate because project 60cf572521fb41f78631fcc6ba3a1fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:12:56.624912 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1ada51fe-4b27-4fe4-9788-2283c7fbd945 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:56.625705 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1ada51fe-4b27-4fe4-9788-2283c7fbd945 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:12:56.627424 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1248/2453] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:12:56 2022] DELETE /identity/v3/projects/60cf572521fb41f78631fcc6ba3a1fd5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:57.160423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db0629-f8ab-4915-a81c-c11f54fd784a None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:57.162541 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db0629-f8ab-4915-a81c-c11f54fd784a None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:57.163561 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db0629-f8ab-4915-a81c-c11f54fd784a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:57.265948 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-69db0629-f8ab-4915-a81c-c11f54fd784a None None] MFA Rules not processed for user `b225a7ff45084cc8b1047b3ef31cc6a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:12:57.268172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-69db0629-f8ab-4915-a81c-c11f54fd784a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:57.441774 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada51fe-4b27-4fe4-9788-2283c7fbd945 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:57.444898 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1206/2454] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:12:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:12:57.445043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1ada51fe-4b27-4fe4-9788-2283c7fbd945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:12:57.568870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada51fe-4b27-4fe4-9788-2283c7fbd945 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:57.588782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691103be-82ee-479d-8748-e86035214198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:57.589733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691103be-82ee-479d-8748-e86035214198 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:57.590372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691103be-82ee-479d-8748-e86035214198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:57.590666 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691103be-82ee-479d-8748-e86035214198 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:57.591769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691103be-82ee-479d-8748-e86035214198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:57.595268 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691103be-82ee-479d-8748-e86035214198 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:57.652231 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1249/2455] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:12:57 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:12:57.656334 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db0629-f8ab-4915-a81c-c11f54fd784a None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:57.670678 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db0629-f8ab-4915-a81c-c11f54fd784a None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:57.769515 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:57.778821 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f40575-2b30-46ae-956a-f4d92640518f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:57.779555 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f40575-2b30-46ae-956a-f4d92640518f admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:57.780349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f40575-2b30-46ae-956a-f4d92640518f admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:57.780349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f40575-2b30-46ae-956a-f4d92640518f admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:57.781413 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f40575-2b30-46ae-956a-f4d92640518f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:57.785444 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f40575-2b30-46ae-956a-f4d92640518f admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:57.819753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1207/2456] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:12:57 2022] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:12:57.823396 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691103be-82ee-479d-8748-e86035214198 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:57.837257 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691103be-82ee-479d-8748-e86035214198 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:57.843286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fed80-8d17-4c17-87c3-b2f0b6662461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:57.843995 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fed80-8d17-4c17-87c3-b2f0b6662461 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:57.844365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fed80-8d17-4c17-87c3-b2f0b6662461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:57.844765 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fed80-8d17-4c17-87c3-b2f0b6662461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:57.845559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9fed80-8d17-4c17-87c3-b2f0b6662461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:57.847788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9fed80-8d17-4c17-87c3-b2f0b6662461 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:57.854837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:12:57.877009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1250/2457] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:57.877981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f40575-2b30-46ae-956a-f4d92640518f admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:57.891130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f40575-2b30-46ae-956a-f4d92640518f admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:57.898158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939074a-447b-4409-878c-3a13ec81fc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:57.899077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939074a-447b-4409-878c-3a13ec81fc7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:57.899360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939074a-447b-4409-878c-3a13ec81fc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:57.899656 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c939074a-447b-4409-878c-3a13ec81fc7e admin admin] PATH_INFO: `/v3/projects/cb304ad8a18047d984633cdea16bbc43/users/5a12f80bd13c49cbac02b9b799117963/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:57.926292 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939074a-447b-4409-878c-3a13ec81fc7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb304ad8a18047d984633cdea16bbc43, user_id=5a12f80bd13c49cbac02b9b799117963, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:57.937524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c939074a-447b-4409-878c-3a13ec81fc7e admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:57.982902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1208/2458] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:57 2022] PUT /identity/v3/projects/cb304ad8a18047d984633cdea16bbc43/users/5a12f80bd13c49cbac02b9b799117963/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:12:57.983993 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fed80-8d17-4c17-87c3-b2f0b6662461 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:58.009052 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9fed80-8d17-4c17-87c3-b2f0b6662461 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:58.140392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6596977-9956-4c0e-a026-e139a5f6ec1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:58.141309 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6596977-9956-4c0e-a026-e139a5f6ec1c admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:58.141704 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6596977-9956-4c0e-a026-e139a5f6ec1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:58.142120 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6596977-9956-4c0e-a026-e139a5f6ec1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:58.144544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6596977-9956-4c0e-a026-e139a5f6ec1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:58.147150 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6596977-9956-4c0e-a026-e139a5f6ec1c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:58.173338 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939074a-447b-4409-878c-3a13ec81fc7e admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:12:58.174118 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1251/2459] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:12:58.190637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c939074a-447b-4409-878c-3a13ec81fc7e admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:12:58.198121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f6f90-6527-47ec-8168-0fd975e7f08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:12:58.199214 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f6f90-6527-47ec-8168-0fd975e7f08b admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:12:58.199586 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f6f90-6527-47ec-8168-0fd975e7f08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:12:58.200004 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f6f90-6527-47ec-8168-0fd975e7f08b admin admin] PATH_INFO: `/v3/projects/cb304ad8a18047d984633cdea16bbc43/users/5a12f80bd13c49cbac02b9b799117963/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:12:58.203359 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f6f90-6527-47ec-8168-0fd975e7f08b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb304ad8a18047d984633cdea16bbc43, user_id=5a12f80bd13c49cbac02b9b799117963, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:12:58.209458 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f6f90-6527-47ec-8168-0fd975e7f08b admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:12:58.227605 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1209/2460] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:12:58 2022] PUT /identity/v3/projects/cb304ad8a18047d984633cdea16bbc43/users/5a12f80bd13c49cbac02b9b799117963/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:13:03.769679 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6596977-9956-4c0e-a026-e139a5f6ec1c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:03.772492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-c6596977-9956-4c0e-a026-e139a5f6ec1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:03.788974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6596977-9956-4c0e-a026-e139a5f6ec1c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:03.903532 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06d93d-efcb-43ba-bb6e-eb4b6b72e7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:03.905540 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06d93d-efcb-43ba-bb6e-eb4b6b72e7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:03.905981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06d93d-efcb-43ba-bb6e-eb4b6b72e7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:03.906406 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06d93d-efcb-43ba-bb6e-eb4b6b72e7f4 admin admin] PATH_INFO: `/v3/users/b45234fe1bb44d7c8017f35f13cf8249` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:03.907869 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06d93d-efcb-43ba-bb6e-eb4b6b72e7f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b45234fe1bb44d7c8017f35f13cf8249)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:03.911109 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06d93d-efcb-43ba-bb6e-eb4b6b72e7f4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:04.016587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9a06d93d-efcb-43ba-bb6e-eb4b6b72e7f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b45234fe1bb44d7c8017f35f13cf8249'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:04.018139 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9a06d93d-efcb-43ba-bb6e-eb4b6b72e7f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b45234fe1bb44d7c8017f35f13cf8249'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:04.043476 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9a06d93d-efcb-43ba-bb6e-eb4b6b72e7f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b45234fe1bb44d7c8017f35f13cf8249'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:04.076732 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9a06d93d-efcb-43ba-bb6e-eb4b6b72e7f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b45234fe1bb44d7c8017f35f13cf8249'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:04.092011 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9a06d93d-efcb-43ba-bb6e-eb4b6b72e7f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b45234fe1bb44d7c8017f35f13cf8249'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:04.107947 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1252/2461] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:13:03 2022] DELETE /identity/v3/users/b45234fe1bb44d7c8017f35f13cf8249 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:13:04.109770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be96cf1-144e-4c91-808c-f057ccd4ff56 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:04.110545 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be96cf1-144e-4c91-808c-f057ccd4ff56 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:04.111884 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be96cf1-144e-4c91-808c-f057ccd4ff56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:04.134360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-1be96cf1-144e-4c91-808c-f057ccd4ff56 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:04.135876 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-1be96cf1-144e-4c91-808c-f057ccd4ff56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:04.274622 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1210/2462] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:13:04.286828 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06d93d-efcb-43ba-bb6e-eb4b6b72e7f4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:04.291076 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9a06d93d-efcb-43ba-bb6e-eb4b6b72e7f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:04.334802 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:04.411354 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06d93d-efcb-43ba-bb6e-eb4b6b72e7f4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:04.415488 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf34c58-0f76-4c05-86be-989251f36089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:04.416213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf34c58-0f76-4c05-86be-989251f36089 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:04.416595 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf34c58-0f76-4c05-86be-989251f36089 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:04.416940 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf34c58-0f76-4c05-86be-989251f36089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:04.429608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf34c58-0f76-4c05-86be-989251f36089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:04.431251 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf34c58-0f76-4c05-86be-989251f36089 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:04.446420 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1253/2463] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:13:05.039479 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be96cf1-144e-4c91-808c-f057ccd4ff56 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:05.041807 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-1be96cf1-144e-4c91-808c-f057ccd4ff56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:05.064131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be96cf1-144e-4c91-808c-f057ccd4ff56 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:05.092474 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5df589-1a04-4b9d-900d-dc953fe12b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:05.093181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5df589-1a04-4b9d-900d-dc953fe12b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:05.093470 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5df589-1a04-4b9d-900d-dc953fe12b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:05.093751 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5df589-1a04-4b9d-900d-dc953fe12b05 admin admin] PATH_INFO: `/v3/projects/607f7186aca74b5db1fde23139678dd8` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:05.095062 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5df589-1a04-4b9d-900d-dc953fe12b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=607f7186aca74b5db1fde23139678dd8)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:05.098298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5df589-1a04-4b9d-900d-dc953fe12b05 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:05.175987 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fb5df589-1a04-4b9d-900d-dc953fe12b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '607f7186aca74b5db1fde23139678dd8', 'request_id': 'req-fb5df589-1a04-4b9d-900d-dc953fe12b05'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:05.199137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fb5df589-1a04-4b9d-900d-dc953fe12b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '607f7186aca74b5db1fde23139678dd8', 'request_id': 'req-fb5df589-1a04-4b9d-900d-dc953fe12b05'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:05.216495 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fb5df589-1a04-4b9d-900d-dc953fe12b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '607f7186aca74b5db1fde23139678dd8', 'request_id': 'req-fb5df589-1a04-4b9d-900d-dc953fe12b05'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:05.237824 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fb5df589-1a04-4b9d-900d-dc953fe12b05 admin admin] The token cache is being invalidate because project 607f7186aca74b5db1fde23139678dd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:13:05.238125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fb5df589-1a04-4b9d-900d-dc953fe12b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:05.238900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-fb5df589-1a04-4b9d-900d-dc953fe12b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:05.244576 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1211/2464] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:13:05 2022] DELETE /identity/v3/projects/607f7186aca74b5db1fde23139678dd8 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:13:05.246200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3b991-36ef-4a9f-a277-ccba8d686c39 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:05.246695 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3b991-36ef-4a9f-a277-ccba8d686c39 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:05.247567 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3b991-36ef-4a9f-a277-ccba8d686c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:05.289350 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a2d3b991-36ef-4a9f-a277-ccba8d686c39 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:05.291745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a2d3b991-36ef-4a9f-a277-ccba8d686c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:05.389901 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1254/2465] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:13:05.391611 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ca3cd-c908-4255-a882-45d55622801d None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:05.393012 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ca3cd-c908-4255-a882-45d55622801d None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:05.393571 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208ca3cd-c908-4255-a882-45d55622801d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:05.432104 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-208ca3cd-c908-4255-a882-45d55622801d None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:05.433461 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-208ca3cd-c908-4255-a882-45d55622801d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:05.433799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3b991-36ef-4a9f-a277-ccba8d686c39 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:05.435277 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a2d3b991-36ef-4a9f-a277-ccba8d686c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:05.445825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1212/2466] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:13:05.446751 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ca3cd-c908-4255-a882-45d55622801d None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:05.457243 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208ca3cd-c908-4255-a882-45d55622801d None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:05.462468 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3b991-36ef-4a9f-a277-ccba8d686c39 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:05.463967 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69f7d2-9f74-46e9-9c86-2f173d6c5dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:05.464753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69f7d2-9f74-46e9-9c86-2f173d6c5dce admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:05.465030 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69f7d2-9f74-46e9-9c86-2f173d6c5dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:05.465470 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b69f7d2-9f74-46e9-9c86-2f173d6c5dce admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:05.466617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69f7d2-9f74-46e9-9c86-2f173d6c5dce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:13:05.467074 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69f7d2-9f74-46e9-9c86-2f173d6c5dce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:05.469716 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b69f7d2-9f74-46e9-9c86-2f173d6c5dce admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:05.473777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f706692-c5e4-40d6-a07f-f7a39f17fd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:05.474919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f706692-c5e4-40d6-a07f-f7a39f17fd38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:05.475455 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f706692-c5e4-40d6-a07f-f7a39f17fd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:05.475985 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f706692-c5e4-40d6-a07f-f7a39f17fd38 admin admin] PATH_INFO: `/v3/users/14c060b0e3554f10b9e87542cdd027aa` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:05.478295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f706692-c5e4-40d6-a07f-f7a39f17fd38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c060b0e3554f10b9e87542cdd027aa)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:05.481830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f706692-c5e4-40d6-a07f-f7a39f17fd38 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:05.493138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1213/2467] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:13:05.499116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69f7d2-9f74-46e9-9c86-2f173d6c5dce admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:05.524715 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b69f7d2-9f74-46e9-9c86-2f173d6c5dce admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:05.535539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f68b16-22f5-4376-976a-43b20a16be93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:05.536333 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f68b16-22f5-4376-976a-43b20a16be93 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:05.536749 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f68b16-22f5-4376-976a-43b20a16be93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:05.537128 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f68b16-22f5-4376-976a-43b20a16be93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:05.538052 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f68b16-22f5-4376-976a-43b20a16be93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:05.541797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f68b16-22f5-4376-976a-43b20a16be93 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:05.559548 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:05.590317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6f706692-c5e4-40d6-a07f-f7a39f17fd38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c060b0e3554f10b9e87542cdd027aa'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:05.593016 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6f706692-c5e4-40d6-a07f-f7a39f17fd38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c060b0e3554f10b9e87542cdd027aa'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:05.605891 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1214/2468] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:13:05 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:13:05.612949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f68b16-22f5-4376-976a-43b20a16be93 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:05.614844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6f706692-c5e4-40d6-a07f-f7a39f17fd38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c060b0e3554f10b9e87542cdd027aa'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:05.657356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6f706692-c5e4-40d6-a07f-f7a39f17fd38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c060b0e3554f10b9e87542cdd027aa'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:05.677714 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6f706692-c5e4-40d6-a07f-f7a39f17fd38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c060b0e3554f10b9e87542cdd027aa'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:05.686212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1255/2469] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:13:05 2022] DELETE /identity/v3/users/14c060b0e3554f10b9e87542cdd027aa => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:13:05.691262 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f8ac7-dcbb-4ba1-8132-ee252b10d6bd None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:05.691878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f8ac7-dcbb-4ba1-8132-ee252b10d6bd None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:05.692317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f8ac7-dcbb-4ba1-8132-ee252b10d6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:05.717780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-565f8ac7-dcbb-4ba1-8132-ee252b10d6bd None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:05.719223 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-565f8ac7-dcbb-4ba1-8132-ee252b10d6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:05.784429 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:05.837419 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f68b16-22f5-4376-976a-43b20a16be93 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:05.891133 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1256/2470] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:13:05.902511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f8ac7-dcbb-4ba1-8132-ee252b10d6bd None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:05.907461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-565f8ac7-dcbb-4ba1-8132-ee252b10d6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:05.961585 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29a1c1-4fe9-4d69-9219-f5e7cddc0a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:05.962395 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29a1c1-4fe9-4d69-9219-f5e7cddc0a40 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:05.962696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29a1c1-4fe9-4d69-9219-f5e7cddc0a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:05.962979 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29a1c1-4fe9-4d69-9219-f5e7cddc0a40 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:05.963913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29a1c1-4fe9-4d69-9219-f5e7cddc0a40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:05.966096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29a1c1-4fe9-4d69-9219-f5e7cddc0a40 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:06.009719 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1215/2471] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:13:05 2022] POST /identity/v3/users => generated 287 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:13:06.011241 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29a1c1-4fe9-4d69-9219-f5e7cddc0a40 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:06.013429 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ac29a1c1-4fe9-4d69-9219-f5e7cddc0a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:06.028225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29a1c1-4fe9-4d69-9219-f5e7cddc0a40 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:06.037666 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b2d4a-998e-4639-a2d6-19d35239ccd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:06.039188 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b2d4a-998e-4639-a2d6-19d35239ccd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:06.039917 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b2d4a-998e-4639-a2d6-19d35239ccd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:06.040648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b2d4a-998e-4639-a2d6-19d35239ccd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:06.042449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b2d4a-998e-4639-a2d6-19d35239ccd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:06.047837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b2d4a-998e-4639-a2d6-19d35239ccd5 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:06.049790 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f8ac7-dcbb-4ba1-8132-ee252b10d6bd None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:06.057206 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a77c3f-1793-49a6-a62a-164c7c5e2910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:06.058239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a77c3f-1793-49a6-a62a-164c7c5e2910 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:06.058725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a77c3f-1793-49a6-a62a-164c7c5e2910 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:06.059200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a77c3f-1793-49a6-a62a-164c7c5e2910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:06.073580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1216/2472] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:13:06.075134 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a77c3f-1793-49a6-a62a-164c7c5e2910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:06.077802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b2d4a-998e-4639-a2d6-19d35239ccd5 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:06.079369 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a77c3f-1793-49a6-a62a-164c7c5e2910 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:06.095314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b2d4a-998e-4639-a2d6-19d35239ccd5 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:06.104583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d3976-dfe4-4a81-ae23-d8691903eddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:06.105832 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d3976-dfe4-4a81-ae23-d8691903eddd admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:06.107137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d3976-dfe4-4a81-ae23-d8691903eddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:06.107137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d3976-dfe4-4a81-ae23-d8691903eddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:06.108910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d3976-dfe4-4a81-ae23-d8691903eddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:06.112238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1257/2473] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:13:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:13:06.112932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d3976-dfe4-4a81-ae23-d8691903eddd admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:06.148517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1217/2474] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:13:06.151732 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a77c3f-1793-49a6-a62a-164c7c5e2910 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:06.184363 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a77c3f-1793-49a6-a62a-164c7c5e2910 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:06.195336 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7e1cc-d6c8-4b0a-8d87-d7eb336fc019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:06.196748 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7e1cc-d6c8-4b0a-8d87-d7eb336fc019 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:06.198246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7e1cc-d6c8-4b0a-8d87-d7eb336fc019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:06.198866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de7e1cc-d6c8-4b0a-8d87-d7eb336fc019 admin admin] PATH_INFO: `/v3/projects/fbddf94725704ea8a895ce19f40268bd/users/88547678e63c4f6690f8be0195af81ca/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:06.244140 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7e1cc-d6c8-4b0a-8d87-d7eb336fc019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbddf94725704ea8a895ce19f40268bd, user_id=88547678e63c4f6690f8be0195af81ca, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:06.248257 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de7e1cc-d6c8-4b0a-8d87-d7eb336fc019 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:06.292564 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1258/2475] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:13:06 2022] PUT /identity/v3/projects/fbddf94725704ea8a895ce19f40268bd/users/88547678e63c4f6690f8be0195af81ca/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:13:06.316292 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a26fd7-40f5-498c-a825-08c818d8cc0b None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:06.316950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a26fd7-40f5-498c-a825-08c818d8cc0b None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:06.318601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a26fd7-40f5-498c-a825-08c818d8cc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:06.354686 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-10a26fd7-40f5-498c-a825-08c818d8cc0b None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:06.356836 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-10a26fd7-40f5-498c-a825-08c818d8cc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:06.511084 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1218/2476] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:13:06.566641 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7e1cc-d6c8-4b0a-8d87-d7eb336fc019 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:06.703502 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de7e1cc-d6c8-4b0a-8d87-d7eb336fc019 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:06.716421 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75148003-4ad5-4509-bc35-39304d1c2293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:06.717480 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75148003-4ad5-4509-bc35-39304d1c2293 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:06.717966 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75148003-4ad5-4509-bc35-39304d1c2293 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:06.718459 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75148003-4ad5-4509-bc35-39304d1c2293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:06.734498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75148003-4ad5-4509-bc35-39304d1c2293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:06.737625 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75148003-4ad5-4509-bc35-39304d1c2293 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:06.774356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1259/2477] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:13:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:13:07.279698 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a26fd7-40f5-498c-a825-08c818d8cc0b None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:07.281536 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-10a26fd7-40f5-498c-a825-08c818d8cc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:07.292847 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:07.298019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a26fd7-40f5-498c-a825-08c818d8cc0b None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:07.326919 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a98dec-ea8d-4931-b5cc-90fe570a466d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:07.327606 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a98dec-ea8d-4931-b5cc-90fe570a466d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:07.327855 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a98dec-ea8d-4931-b5cc-90fe570a466d admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:07.330314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a98dec-ea8d-4931-b5cc-90fe570a466d admin admin] PATH_INFO: `/v3/projects/8176ce6ad86e4cbf83d7015b841dd5d3` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:07.333340 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a98dec-ea8d-4931-b5cc-90fe570a466d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8176ce6ad86e4cbf83d7015b841dd5d3)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:07.335325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a98dec-ea8d-4931-b5cc-90fe570a466d admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:07.443067 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e8a98dec-ea8d-4931-b5cc-90fe570a466d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8176ce6ad86e4cbf83d7015b841dd5d3', 'request_id': 'req-e8a98dec-ea8d-4931-b5cc-90fe570a466d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:07.456379 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e8a98dec-ea8d-4931-b5cc-90fe570a466d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8176ce6ad86e4cbf83d7015b841dd5d3', 'request_id': 'req-e8a98dec-ea8d-4931-b5cc-90fe570a466d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:07.471447 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e8a98dec-ea8d-4931-b5cc-90fe570a466d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8176ce6ad86e4cbf83d7015b841dd5d3', 'request_id': 'req-e8a98dec-ea8d-4931-b5cc-90fe570a466d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:07.502707 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e8a98dec-ea8d-4931-b5cc-90fe570a466d admin admin] The token cache is being invalidate because project 8176ce6ad86e4cbf83d7015b841dd5d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:13:07.503339 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e8a98dec-ea8d-4931-b5cc-90fe570a466d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:07.506024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e8a98dec-ea8d-4931-b5cc-90fe570a466d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:07.511780 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1219/2478] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:13:07 2022] DELETE /identity/v3/projects/8176ce6ad86e4cbf83d7015b841dd5d3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:13:07.514852 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc1437-55a9-459f-bbfc-760cef52bc29 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:07.516087 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc1437-55a9-459f-bbfc-760cef52bc29 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:07.516736 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc1437-55a9-459f-bbfc-760cef52bc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:07.549359 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6bfc1437-55a9-459f-bbfc-760cef52bc29 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:07.551575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6bfc1437-55a9-459f-bbfc-760cef52bc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:07.571909 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa45042-41ae-4a33-8a5e-d17601b7639d None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:07.572743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa45042-41ae-4a33-8a5e-d17601b7639d None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:07.573459 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa45042-41ae-4a33-8a5e-d17601b7639d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:07.649298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-9fa45042-41ae-4a33-8a5e-d17601b7639d None None] MFA Rules not processed for user `5a12f80bd13c49cbac02b9b799117963`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:07.652859 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-9fa45042-41ae-4a33-8a5e-d17601b7639d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:07.696008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:07.728609 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1260/2479] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:13:07.737129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3fad6-b28a-4d77-8449-75fd5d60fed4 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:07.737781 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3fad6-b28a-4d77-8449-75fd5d60fed4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:07.737781 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3fad6-b28a-4d77-8449-75fd5d60fed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:07.763408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-acb3fad6-b28a-4d77-8449-75fd5d60fed4 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:07.765664 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-acb3fad6-b28a-4d77-8449-75fd5d60fed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:07.786889 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1261/2480] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:13:07.792765 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3fad6-b28a-4d77-8449-75fd5d60fed4 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:07.794902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1220/2481] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:13:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:13:07.812359 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa45042-41ae-4a33-8a5e-d17601b7639d None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:07.814057 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-9fa45042-41ae-4a33-8a5e-d17601b7639d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:07.836396 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3fad6-b28a-4d77-8449-75fd5d60fed4 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:07.848886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136711aa-2884-41fc-bcd7-7a76396a5c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:07.851027 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136711aa-2884-41fc-bcd7-7a76396a5c6d admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:07.851248 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136711aa-2884-41fc-bcd7-7a76396a5c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:07.852374 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136711aa-2884-41fc-bcd7-7a76396a5c6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:07.855166 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136711aa-2884-41fc-bcd7-7a76396a5c6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:13:07.855890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136711aa-2884-41fc-bcd7-7a76396a5c6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:07.863303 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136711aa-2884-41fc-bcd7-7a76396a5c6d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:07.886069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1262/2482] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:13:07.889807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136711aa-2884-41fc-bcd7-7a76396a5c6d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:07.917786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136711aa-2884-41fc-bcd7-7a76396a5c6d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:07.937081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab668950-fc46-4c22-bd5c-52ddc97bfefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:07.938428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab668950-fc46-4c22-bd5c-52ddc97bfefd admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:07.940355 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab668950-fc46-4c22-bd5c-52ddc97bfefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:07.940677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab668950-fc46-4c22-bd5c-52ddc97bfefd admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:07.944290 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab668950-fc46-4c22-bd5c-52ddc97bfefd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:07.946536 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab668950-fc46-4c22-bd5c-52ddc97bfefd admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:07.980867 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa45042-41ae-4a33-8a5e-d17601b7639d None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:07.988830 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be4572-76a9-4b13-bf5c-bf44daa38b73 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0af63c36df2c4ceaa2df4d3ac59542bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:07.989949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be4572-76a9-4b13-bf5c-bf44daa38b73 service glance] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:07.990548 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be4572-76a9-4b13-bf5c-bf44daa38b73 service glance] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:07.991072 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be4572-76a9-4b13-bf5c-bf44daa38b73 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:07.994146 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-66be4572-76a9-4b13-bf5c-bf44daa38b73 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:08.021380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1263/2483] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:13:07 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:13:08.025100 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab668950-fc46-4c22-bd5c-52ddc97bfefd admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:08.108611 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:08.162196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab668950-fc46-4c22-bd5c-52ddc97bfefd admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:08.171725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b7e51-e6cf-4d6b-8fc3-107685d04a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:08.172931 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b7e51-e6cf-4d6b-8fc3-107685d04a87 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:08.173314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b7e51-e6cf-4d6b-8fc3-107685d04a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:08.173716 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b7e51-e6cf-4d6b-8fc3-107685d04a87 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:08.174743 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b7e51-e6cf-4d6b-8fc3-107685d04a87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:08.177956 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b7e51-e6cf-4d6b-8fc3-107685d04a87 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:08.202472 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be4572-76a9-4b13-bf5c-bf44daa38b73 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:08.204272 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be4572-76a9-4b13-bf5c-bf44daa38b73 service glance] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:08.214825 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1264/2484] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:13:08 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:13:08.225032 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b7e51-e6cf-4d6b-8fc3-107685d04a87 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:08.226959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1221/2485] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:13:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:13:08.251085 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b7e51-e6cf-4d6b-8fc3-107685d04a87 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:08.265378 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ea9b8-96bd-4865-97d3-28033f00003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:08.266021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ea9b8-96bd-4865-97d3-28033f00003b admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:08.266303 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ea9b8-96bd-4865-97d3-28033f00003b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:08.275635 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ea9b8-96bd-4865-97d3-28033f00003b admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:08.276861 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ea9b8-96bd-4865-97d3-28033f00003b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:08.279582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ea9b8-96bd-4865-97d3-28033f00003b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:08.298133 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1265/2486] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:13:08.302589 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be4572-76a9-4b13-bf5c-bf44daa38b73 service glance] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:08.319771 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be4572-76a9-4b13-bf5c-bf44daa38b73 service glance] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:08.354992 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85838b2c-ec7f-4213-8269-01c4a79a56b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:08.357258 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85838b2c-ec7f-4213-8269-01c4a79a56b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:08.358073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85838b2c-ec7f-4213-8269-01c4a79a56b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:08.358831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85838b2c-ec7f-4213-8269-01c4a79a56b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:08.360339 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85838b2c-ec7f-4213-8269-01c4a79a56b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:08.365780 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85838b2c-ec7f-4213-8269-01c4a79a56b5 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:08.391143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1222/2487] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:13:08.394328 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ea9b8-96bd-4865-97d3-28033f00003b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:08.412031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ea9b8-96bd-4865-97d3-28033f00003b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:08.419871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e3983-3464-4f97-be32-ca62fd2200f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:08.421022 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e3983-3464-4f97-be32-ca62fd2200f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:08.422090 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e3983-3464-4f97-be32-ca62fd2200f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:08.422384 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e3983-3464-4f97-be32-ca62fd2200f4 admin admin] PATH_INFO: `/v3/projects/cd6c299fb9c94e3eaaa7635b9d1b8564/users/020e96151bb442f7920aad3181706145/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:08.458444 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e3983-3464-4f97-be32-ca62fd2200f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6c299fb9c94e3eaaa7635b9d1b8564, user_id=020e96151bb442f7920aad3181706145, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:08.467998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e3983-3464-4f97-be32-ca62fd2200f4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:08.499055 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1266/2488] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:13:08 2022] PUT /identity/v3/projects/cd6c299fb9c94e3eaaa7635b9d1b8564/users/020e96151bb442f7920aad3181706145/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:13:08.504703 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a58b50-9b85-46be-9a16-40b0f8c0a3b8 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:08.505078 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a58b50-9b85-46be-9a16-40b0f8c0a3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:08.505338 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a58b50-9b85-46be-9a16-40b0f8c0a3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:08.545834 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-c7a58b50-9b85-46be-9a16-40b0f8c0a3b8 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:08.549904 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-c7a58b50-9b85-46be-9a16-40b0f8c0a3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:08.556007 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3cbc2-84e6-454f-9cd4-a2bffbafd1e6 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:08.556594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3cbc2-84e6-454f-9cd4-a2bffbafd1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:08.556730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3cbc2-84e6-454f-9cd4-a2bffbafd1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:08.583003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-71e3cbc2-84e6-454f-9cd4-a2bffbafd1e6 None None] MFA Rules not processed for user `f43a16e2dcab4872963222c557853d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:08.584932 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-71e3cbc2-84e6-454f-9cd4-a2bffbafd1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:08.675586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1267/2489] 10.222.0.85 () {58 vars in 1009 bytes} [Tue Aug 2 10:13:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:13:08.677334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccacdc-efd1-457f-bf88-fca2a754bf83 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:08.677716 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccacdc-efd1-457f-bf88-fca2a754bf83 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:08.678089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccacdc-efd1-457f-bf88-fca2a754bf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:08.728881 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1223/2490] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:13:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:13:08.742310 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a58b50-9b85-46be-9a16-40b0f8c0a3b8 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:08.743954 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-c7a58b50-9b85-46be-9a16-40b0f8c0a3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:08.760867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:08.782672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8cccacdc-efd1-457f-bf88-fca2a754bf83 None None] MFA Rules not processed for user `88547678e63c4f6690f8be0195af81ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:08.785186 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8cccacdc-efd1-457f-bf88-fca2a754bf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:08.876224 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a58b50-9b85-46be-9a16-40b0f8c0a3b8 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:08.881812 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ef1c1-276b-4f48-a856-971250f89691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:08.883271 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ef1c1-276b-4f48-a856-971250f89691 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:08.883669 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ef1c1-276b-4f48-a856-971250f89691 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:08.884377 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ef1c1-276b-4f48-a856-971250f89691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:08.897665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ef1c1-276b-4f48-a856-971250f89691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:08.899290 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ef1c1-276b-4f48-a856-971250f89691 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:08.915065 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1224/2491] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:13:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:13:08.916094 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ef1c1-276b-4f48-a856-971250f89691 service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:08.922579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-546ef1c1-276b-4f48-a856-971250f89691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:08.932811 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1268/2492] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:13:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:13:08.946577 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccacdc-efd1-457f-bf88-fca2a754bf83 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:08.950455 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8cccacdc-efd1-457f-bf88-fca2a754bf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:09.061930 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:09.072342 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ef1c1-276b-4f48-a856-971250f89691 service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:09.078666 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a217f9-8c1e-4272-b5b5-a9aff91b573e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cfed2469a7419f8fcbe09d25cb896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:09.080670 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a217f9-8c1e-4272-b5b5-a9aff91b573e service swift] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:09.081421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a217f9-8c1e-4272-b5b5-a9aff91b573e service swift] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:09.081421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a217f9-8c1e-4272-b5b5-a9aff91b573e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:09.099437 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a217f9-8c1e-4272-b5b5-a9aff91b573e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:09.102233 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a217f9-8c1e-4272-b5b5-a9aff91b573e service swift] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:09.122184 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1225/2493] 10.222.0.85 () {60 vars in 1384 bytes} [Tue Aug 2 10:13:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 10:13:09.148774 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccacdc-efd1-457f-bf88-fca2a754bf83 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:09.166396 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa899ccc-50c2-4e4b-9f94-d6cd17b010b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:09.167459 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa899ccc-50c2-4e4b-9f94-d6cd17b010b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:09.168044 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa899ccc-50c2-4e4b-9f94-d6cd17b010b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:09.168448 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa899ccc-50c2-4e4b-9f94-d6cd17b010b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:09.188180 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa899ccc-50c2-4e4b-9f94-d6cd17b010b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:09.190863 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa899ccc-50c2-4e4b-9f94-d6cd17b010b6 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:09.213062 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1269/2494] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:13:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:13:11.565544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b302-95c2-4656-a689-e086bedefd76 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:11.566604 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b302-95c2-4656-a689-e086bedefd76 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:11.566897 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b302-95c2-4656-a689-e086bedefd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:11.629982 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-0022b302-95c2-4656-a689-e086bedefd76 None None] MFA Rules not processed for user `88547678e63c4f6690f8be0195af81ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:11.630839 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-0022b302-95c2-4656-a689-e086bedefd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:11.648173 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1226/2495] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:13:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:13:19.201226 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=53 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:19.824031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a849a3-7d87-4910-81c8-fa6493a4548b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:19.824321 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a849a3-7d87-4910-81c8-fa6493a4548b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:19.824630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a849a3-7d87-4910-81c8-fa6493a4548b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:19.867788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-14a849a3-7d87-4910-81c8-fa6493a4548b None None] MFA Rules not processed for user `f43a16e2dcab4872963222c557853d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:19.869443 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-14a849a3-7d87-4910-81c8-fa6493a4548b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:19.883413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1270/2496] 10.222.0.85 () {58 vars in 1009 bytes} [Tue Aug 2 10:13:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:13:19.906624 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b302-95c2-4656-a689-e086bedefd76 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:19.934209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b302-95c2-4656-a689-e086bedefd76 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:19.949301 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ed489-92d1-4294-a9f6-5a94951a06d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cfed2469a7419f8fcbe09d25cb896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:19.949940 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ed489-92d1-4294-a9f6-5a94951a06d5 service swift] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:19.950223 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ed489-92d1-4294-a9f6-5a94951a06d5 service swift] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:19.950493 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ed489-92d1-4294-a9f6-5a94951a06d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:19.985513 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ed489-92d1-4294-a9f6-5a94951a06d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:19.988002 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ed489-92d1-4294-a9f6-5a94951a06d5 service swift] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:20.007804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1227/2497] 10.222.0.85 () {60 vars in 1384 bytes} [Tue Aug 2 10:13:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 10:13:21.026113 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff7f2f-3fe8-4a2b-a061-ce50f037ab34 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:21.026703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff7f2f-3fe8-4a2b-a061-ce50f037ab34 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:21.026703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff7f2f-3fe8-4a2b-a061-ce50f037ab34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:21.058271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9eff7f2f-3fe8-4a2b-a061-ce50f037ab34 None None] MFA Rules not processed for user `020e96151bb442f7920aad3181706145`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:21.059508 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9eff7f2f-3fe8-4a2b-a061-ce50f037ab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:21.123245 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ee26e-9e14-442d-9d89-d1329a26d40d None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:21.124165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ee26e-9e14-442d-9d89-d1329a26d40d None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:21.124765 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ee26e-9e14-442d-9d89-d1329a26d40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:21.149341 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-820ee26e-9e14-442d-9d89-d1329a26d40d None None] MFA Rules not processed for user `f43a16e2dcab4872963222c557853d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:21.151212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-820ee26e-9e14-442d-9d89-d1329a26d40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:21.165355 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1228/2498] 10.222.0.85 () {58 vars in 967 bytes} [Tue Aug 2 10:13:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:13:21.176517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1271/2499] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:13:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:13:21.178497 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ee26e-9e14-442d-9d89-d1329a26d40d None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:21.181188 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff7f2f-3fe8-4a2b-a061-ce50f037ab34 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:21.196496 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff7f2f-3fe8-4a2b-a061-ce50f037ab34 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:21.204163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e387e-9935-4e13-96d8-e7aa7766cbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:21.204976 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e387e-9935-4e13-96d8-e7aa7766cbf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:21.205281 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e387e-9935-4e13-96d8-e7aa7766cbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:21.205556 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e387e-9935-4e13-96d8-e7aa7766cbf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:21.206246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e387e-9935-4e13-96d8-e7aa7766cbf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:21.208386 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e387e-9935-4e13-96d8-e7aa7766cbf2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:21.222339 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ee26e-9e14-442d-9d89-d1329a26d40d None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:21.231847 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515a03e-3928-4299-bdde-ce4db99baeba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cfed2469a7419f8fcbe09d25cb896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:21.237509 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515a03e-3928-4299-bdde-ce4db99baeba service swift] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:21.237941 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515a03e-3928-4299-bdde-ce4db99baeba service swift] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:21.238361 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515a03e-3928-4299-bdde-ce4db99baeba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:21.246629 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1272/2500] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:13:21 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:13:21.247788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e387e-9935-4e13-96d8-e7aa7766cbf2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:21.253332 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515a03e-3928-4299-bdde-ce4db99baeba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:21.256166 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515a03e-3928-4299-bdde-ce4db99baeba service swift] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:21.271327 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1229/2501] 10.222.0.85 () {60 vars in 1384 bytes} [Tue Aug 2 10:13:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 10:13:21.345025 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e387e-9935-4e13-96d8-e7aa7766cbf2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:21.353337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52ea24-b721-4535-ace4-fadc62dd9ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:21.354247 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52ea24-b721-4535-ace4-fadc62dd9ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:21.354813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52ea24-b721-4535-ace4-fadc62dd9ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:21.355242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52ea24-b721-4535-ace4-fadc62dd9ba8 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:21.356272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52ea24-b721-4535-ace4-fadc62dd9ba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:21.360497 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52ea24-b721-4535-ace4-fadc62dd9ba8 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:21.420367 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1273/2502] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:13:21 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:13:21.421977 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515a03e-3928-4299-bdde-ce4db99baeba service swift] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:21.451671 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515a03e-3928-4299-bdde-ce4db99baeba service swift] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:21.459807 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833766e0-c2ce-4f12-8777-bfaa18b93417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:21.460747 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833766e0-c2ce-4f12-8777-bfaa18b93417 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:21.461459 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833766e0-c2ce-4f12-8777-bfaa18b93417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:21.461874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833766e0-c2ce-4f12-8777-bfaa18b93417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:21.463127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833766e0-c2ce-4f12-8777-bfaa18b93417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:21.465804 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833766e0-c2ce-4f12-8777-bfaa18b93417 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:21.487018 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1230/2503] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:13:21.491700 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52ea24-b721-4535-ace4-fadc62dd9ba8 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:21.507569 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52ea24-b721-4535-ace4-fadc62dd9ba8 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:21.520659 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec5ebb-c9f7-4c2d-97f8-c5834930a569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:21.521368 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec5ebb-c9f7-4c2d-97f8-c5834930a569 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:21.521636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec5ebb-c9f7-4c2d-97f8-c5834930a569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:21.521909 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec5ebb-c9f7-4c2d-97f8-c5834930a569 admin admin] PATH_INFO: `/v3/projects/972f21294d2248e292c12fc80d5155ed/users/ede5d51e4b0e4687a6284abe9329bd43/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:21.539711 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec5ebb-c9f7-4c2d-97f8-c5834930a569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972f21294d2248e292c12fc80d5155ed, user_id=ede5d51e4b0e4687a6284abe9329bd43, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:21.542709 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec5ebb-c9f7-4c2d-97f8-c5834930a569 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:21.564864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1274/2504] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:13:21 2022] PUT /identity/v3/projects/972f21294d2248e292c12fc80d5155ed/users/ede5d51e4b0e4687a6284abe9329bd43/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:13:21.566393 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833766e0-c2ce-4f12-8777-bfaa18b93417 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:21.595650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833766e0-c2ce-4f12-8777-bfaa18b93417 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:21.834329 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a80f2-481c-4620-8d0f-0c22de594905 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:21.834725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a80f2-481c-4620-8d0f-0c22de594905 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:21.835175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a80f2-481c-4620-8d0f-0c22de594905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:21.889872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f673fc6-e41b-45a7-8672-0aef9456050f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:21.891000 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f673fc6-e41b-45a7-8672-0aef9456050f admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:21.891395 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f673fc6-e41b-45a7-8672-0aef9456050f admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:21.891778 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f673fc6-e41b-45a7-8672-0aef9456050f admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:21.892919 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f673fc6-e41b-45a7-8672-0aef9456050f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:21.896171 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f673fc6-e41b-45a7-8672-0aef9456050f admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:21.897139 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-964a80f2-481c-4620-8d0f-0c22de594905 None None] MFA Rules not processed for user `f43a16e2dcab4872963222c557853d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:21.898401 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-964a80f2-481c-4620-8d0f-0c22de594905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:21.914109 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1231/2505] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:13:21.919094 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f673fc6-e41b-45a7-8672-0aef9456050f admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:21.943068 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f673fc6-e41b-45a7-8672-0aef9456050f admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:21.956112 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:21.971775 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ca856-6325-4b79-a8c1-d8bf8c560722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:21.972648 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ca856-6325-4b79-a8c1-d8bf8c560722 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:21.975895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ca856-6325-4b79-a8c1-d8bf8c560722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:21.976252 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ca856-6325-4b79-a8c1-d8bf8c560722 admin admin] PATH_INFO: `/v3/projects/972f21294d2248e292c12fc80d5155ed/users/ede5d51e4b0e4687a6284abe9329bd43/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:21.987655 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ca856-6325-4b79-a8c1-d8bf8c560722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=972f21294d2248e292c12fc80d5155ed, user_id=ede5d51e4b0e4687a6284abe9329bd43, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:22.005242 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ca856-6325-4b79-a8c1-d8bf8c560722 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:22.014386 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1275/2506] 10.222.0.85 () {58 vars in 1009 bytes} [Tue Aug 2 10:13:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:13:22.040187 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1232/2507] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:13:21 2022] PUT /identity/v3/projects/972f21294d2248e292c12fc80d5155ed/users/ede5d51e4b0e4687a6284abe9329bd43/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:13:22.070432 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a80f2-481c-4620-8d0f-0c22de594905 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:22.248064 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a80f2-481c-4620-8d0f-0c22de594905 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:22.322215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5fead-eef9-4fbb-89bc-c9ee74f5f5d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cfed2469a7419f8fcbe09d25cb896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:22.323175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5fead-eef9-4fbb-89bc-c9ee74f5f5d7 service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:22.323604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5fead-eef9-4fbb-89bc-c9ee74f5f5d7 service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:22.324043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5fead-eef9-4fbb-89bc-c9ee74f5f5d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:22.404376 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5fead-eef9-4fbb-89bc-c9ee74f5f5d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:22.406003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5fead-eef9-4fbb-89bc-c9ee74f5f5d7 service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:22.424202 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1276/2508] 10.222.0.85 () {60 vars in 1384 bytes} [Tue Aug 2 10:13:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 10:13:23.520631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95144b9b-b37c-4d8f-a995-c733f8f48e9c None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:23.521579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95144b9b-b37c-4d8f-a995-c733f8f48e9c None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:23.522013 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95144b9b-b37c-4d8f-a995-c733f8f48e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:23.562288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-95144b9b-b37c-4d8f-a995-c733f8f48e9c None None] MFA Rules not processed for user `f43a16e2dcab4872963222c557853d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:23.563538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-95144b9b-b37c-4d8f-a995-c733f8f48e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:23.593607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1233/2509] 10.222.0.85 () {58 vars in 967 bytes} [Tue Aug 2 10:13:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:13:23.621154 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5fead-eef9-4fbb-89bc-c9ee74f5f5d7 service swift] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:23.634901 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5fead-eef9-4fbb-89bc-c9ee74f5f5d7 service swift] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:23.644944 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d37a7-8554-4fbc-a13c-eccb419c141a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cfed2469a7419f8fcbe09d25cb896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:23.647035 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d37a7-8554-4fbc-a13c-eccb419c141a service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:23.647477 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d37a7-8554-4fbc-a13c-eccb419c141a service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:23.648452 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d37a7-8554-4fbc-a13c-eccb419c141a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:23.665088 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d37a7-8554-4fbc-a13c-eccb419c141a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:23.667411 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d37a7-8554-4fbc-a13c-eccb419c141a service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:23.680033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1277/2510] 10.222.0.85 () {60 vars in 1384 bytes} [Tue Aug 2 10:13:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 10:13:27.077866 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95144b9b-b37c-4d8f-a995-c733f8f48e9c None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:27.079769 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-95144b9b-b37c-4d8f-a995-c733f8f48e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:27.217056 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95144b9b-b37c-4d8f-a995-c733f8f48e9c None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:27.224807 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e20c5-a963-49ea-9b3e-2ede89a1a432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:27.225611 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e20c5-a963-49ea-9b3e-2ede89a1a432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:27.226022 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e20c5-a963-49ea-9b3e-2ede89a1a432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:27.226454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e20c5-a963-49ea-9b3e-2ede89a1a432 admin admin] PATH_INFO: `/v3/users/773ebfa3530c4a818cdd435497d2c15e` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:27.228093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e20c5-a963-49ea-9b3e-2ede89a1a432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=773ebfa3530c4a818cdd435497d2c15e)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:27.233089 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e20c5-a963-49ea-9b3e-2ede89a1a432 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:27.272227 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:27.331291 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c00e20c5-a963-49ea-9b3e-2ede89a1a432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '773ebfa3530c4a818cdd435497d2c15e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:27.332725 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c00e20c5-a963-49ea-9b3e-2ede89a1a432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '773ebfa3530c4a818cdd435497d2c15e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:27.349800 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c00e20c5-a963-49ea-9b3e-2ede89a1a432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '773ebfa3530c4a818cdd435497d2c15e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:27.364747 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c00e20c5-a963-49ea-9b3e-2ede89a1a432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '773ebfa3530c4a818cdd435497d2c15e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:27.365730 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c00e20c5-a963-49ea-9b3e-2ede89a1a432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '773ebfa3530c4a818cdd435497d2c15e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:27.383240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1234/2511] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:13:27 2022] DELETE /identity/v3/users/773ebfa3530c4a818cdd435497d2c15e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:13:27.387486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a3a9f-acae-4c6e-8e86-9a19299790f1 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:27.387973 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a3a9f-acae-4c6e-8e86-9a19299790f1 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:27.388092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a3a9f-acae-4c6e-8e86-9a19299790f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:27.400198 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:27.420353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-170a3a9f-acae-4c6e-8e86-9a19299790f1 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:27.422259 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-170a3a9f-acae-4c6e-8e86-9a19299790f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:27.596348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1278/2512] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:13:27.627656 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e20c5-a963-49ea-9b3e-2ede89a1a432 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:27.629788 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-c00e20c5-a963-49ea-9b3e-2ede89a1a432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:27.754302 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e20c5-a963-49ea-9b3e-2ede89a1a432 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:27.771939 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ea377-80d5-45d2-b406-5ced5439c20c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:27.772621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ea377-80d5-45d2-b406-5ced5439c20c service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:27.772907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ea377-80d5-45d2-b406-5ced5439c20c service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:27.773188 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ea377-80d5-45d2-b406-5ced5439c20c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:27.794873 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ea377-80d5-45d2-b406-5ced5439c20c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:27.796340 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ea377-80d5-45d2-b406-5ced5439c20c service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:27.818674 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1235/2513] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:13:28.414143 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a3a9f-acae-4c6e-8e86-9a19299790f1 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:28.416791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-170a3a9f-acae-4c6e-8e86-9a19299790f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:28.436211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a3a9f-acae-4c6e-8e86-9a19299790f1 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:28.475572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53747d66-2e7d-45c9-b6c4-d0addb01f9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:28.476454 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53747d66-2e7d-45c9-b6c4-d0addb01f9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:28.476769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53747d66-2e7d-45c9-b6c4-d0addb01f9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:28.477268 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53747d66-2e7d-45c9-b6c4-d0addb01f9ae admin admin] PATH_INFO: `/v3/projects/7d82cae2f9064c61abe935ac24f1243e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:28.480159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53747d66-2e7d-45c9-b6c4-d0addb01f9ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d82cae2f9064c61abe935ac24f1243e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:28.482724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53747d66-2e7d-45c9-b6c4-d0addb01f9ae admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:28.600161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-53747d66-2e7d-45c9-b6c4-d0addb01f9ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d82cae2f9064c61abe935ac24f1243e', 'request_id': 'req-53747d66-2e7d-45c9-b6c4-d0addb01f9ae'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:28.610106 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-53747d66-2e7d-45c9-b6c4-d0addb01f9ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d82cae2f9064c61abe935ac24f1243e', 'request_id': 'req-53747d66-2e7d-45c9-b6c4-d0addb01f9ae'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:28.621180 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-53747d66-2e7d-45c9-b6c4-d0addb01f9ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d82cae2f9064c61abe935ac24f1243e', 'request_id': 'req-53747d66-2e7d-45c9-b6c4-d0addb01f9ae'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:28.646757 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-53747d66-2e7d-45c9-b6c4-d0addb01f9ae admin admin] The token cache is being invalidate because project 7d82cae2f9064c61abe935ac24f1243e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:13:28.647267 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-53747d66-2e7d-45c9-b6c4-d0addb01f9ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:28.648615 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-53747d66-2e7d-45c9-b6c4-d0addb01f9ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:13:28.666005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1279/2514] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:13:28 2022] DELETE /identity/v3/projects/7d82cae2f9064c61abe935ac24f1243e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:13:30.827047 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b05f48-91f6-47fe-86e3-dabfb83cad32 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:30.827614 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b05f48-91f6-47fe-86e3-dabfb83cad32 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:30.827614 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b05f48-91f6-47fe-86e3-dabfb83cad32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:30.850836 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-17b05f48-91f6-47fe-86e3-dabfb83cad32 None None] MFA Rules not processed for user `b225a7ff45084cc8b1047b3ef31cc6a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:30.852082 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-17b05f48-91f6-47fe-86e3-dabfb83cad32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:30.980969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1236/2515] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:13:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:13:32.077173 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c61d6-9d23-4132-9d3d-cc23318611aa None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:32.077721 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c61d6-9d23-4132-9d3d-cc23318611aa None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:32.077853 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c61d6-9d23-4132-9d3d-cc23318611aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:32.112541 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-847c61d6-9d23-4132-9d3d-cc23318611aa None None] MFA Rules not processed for user `ede5d51e4b0e4687a6284abe9329bd43`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:32.114151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-847c61d6-9d23-4132-9d3d-cc23318611aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:32.199828 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1280/2516] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:13:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:13:32.208189 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b05f48-91f6-47fe-86e3-dabfb83cad32 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:32.209847 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-17b05f48-91f6-47fe-86e3-dabfb83cad32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:32.271855 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:32.310813 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b05f48-91f6-47fe-86e3-dabfb83cad32 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:32.316411 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f2f53-ffe3-4f5f-8e12-00d63a194000 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:32.317065 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f2f53-ffe3-4f5f-8e12-00d63a194000 service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:32.317351 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f2f53-ffe3-4f5f-8e12-00d63a194000 service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:32.317629 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f2f53-ffe3-4f5f-8e12-00d63a194000 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:32.319584 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7a2f2f53-ffe3-4f5f-8e12-00d63a194000 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:32.384924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f2f53-ffe3-4f5f-8e12-00d63a194000 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:32.386620 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f2f53-ffe3-4f5f-8e12-00d63a194000 service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:32.396774 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1237/2517] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:13:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:13:33.912584 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148310c-f300-4c87-931a-332c67f9d148 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:33.913529 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148310c-f300-4c87-931a-332c67f9d148 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:33.914003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148310c-f300-4c87-931a-332c67f9d148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:33.936817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-2148310c-f300-4c87-931a-332c67f9d148 None None] MFA Rules not processed for user `f43a16e2dcab4872963222c557853d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:33.938478 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2148310c-f300-4c87-931a-332c67f9d148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:33.946220 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:34.033488 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1281/2518] 10.222.0.85 () {58 vars in 1009 bytes} [Tue Aug 2 10:13:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:13:34.046583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f2f53-ffe3-4f5f-8e12-00d63a194000 service nova] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:13:34.048408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7a2f2f53-ffe3-4f5f-8e12-00d63a194000 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:34.172522 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f2f53-ffe3-4f5f-8e12-00d63a194000 service nova] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:13:34.178796 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c782dd-60f6-4863-bc1a-ae8b3939a398 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cfed2469a7419f8fcbe09d25cb896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:13:34.179433 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c782dd-60f6-4863-bc1a-ae8b3939a398 service swift] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:34.179718 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c782dd-60f6-4863-bc1a-ae8b3939a398 service swift] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:34.179993 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c782dd-60f6-4863-bc1a-ae8b3939a398 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:34.191382 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c782dd-60f6-4863-bc1a-ae8b3939a398 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:13:34.193320 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c782dd-60f6-4863-bc1a-ae8b3939a398 service swift] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:13:34.205000 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1238/2519] 10.222.0.85 () {60 vars in 1384 bytes} [Tue Aug 2 10:13:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 10:13:34.250032 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcb99c-2b13-4069-8a72-1f48edadbf6f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:34.250330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcb99c-2b13-4069-8a72-1f48edadbf6f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:34.250612 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efcb99c-2b13-4069-8a72-1f48edadbf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:34.321968 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4efcb99c-2b13-4069-8a72-1f48edadbf6f None None] MFA Rules not processed for user `020e96151bb442f7920aad3181706145`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:34.323424 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4efcb99c-2b13-4069-8a72-1f48edadbf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:34.340825 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1282/2520] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:13:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:13:35.765181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccdc89-7da7-4ad2-bae1-ab038dd2b1ec None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:35.765646 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccdc89-7da7-4ad2-bae1-ab038dd2b1ec None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:35.765744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccdc89-7da7-4ad2-bae1-ab038dd2b1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:35.791981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-0cccdc89-7da7-4ad2-bae1-ab038dd2b1ec None None] MFA Rules not processed for user `88547678e63c4f6690f8be0195af81ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:35.794402 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-0cccdc89-7da7-4ad2-bae1-ab038dd2b1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:35.893448 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1239/2521] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:13:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:13:44.307961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=23 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:45.872388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=94 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:13:56.327069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c896a4-0614-4d5a-8f92-91c924a7393f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:13:56.327595 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c896a4-0614-4d5a-8f92-91c924a7393f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:13:56.327595 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c896a4-0614-4d5a-8f92-91c924a7393f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:13:56.349270 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-15c896a4-0614-4d5a-8f92-91c924a7393f None None] MFA Rules not processed for user `7511e2f8a2c24c92be08dc5056bac4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:13:56.350571 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-15c896a4-0614-4d5a-8f92-91c924a7393f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:13:56.413536 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1283/2522] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:13:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:14:02.639009 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccdc89-7da7-4ad2-bae1-ab038dd2b1ec None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:02.640711 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-0cccdc89-7da7-4ad2-bae1-ab038dd2b1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:02.707127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cccdc89-7da7-4ad2-bae1-ab038dd2b1ec None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:02.711318 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb93f7-32fd-48d9-8552-9688469c069d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:02.712036 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb93f7-32fd-48d9-8552-9688469c069d service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:02.712506 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb93f7-32fd-48d9-8552-9688469c069d service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:02.712958 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb93f7-32fd-48d9-8552-9688469c069d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:02.715068 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-65bb93f7-32fd-48d9-8552-9688469c069d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:02.808714 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb93f7-32fd-48d9-8552-9688469c069d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:02.810328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bb93f7-32fd-48d9-8552-9688469c069d service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:02.822351 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1240/2523] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:14:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:14:04.090041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82362c3e-9616-4dc4-8cf1-55ea17b050f7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:04.090560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82362c3e-9616-4dc4-8cf1-55ea17b050f7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:04.090560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82362c3e-9616-4dc4-8cf1-55ea17b050f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:04.115486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-82362c3e-9616-4dc4-8cf1-55ea17b050f7 None None] MFA Rules not processed for user `f43a16e2dcab4872963222c557853d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:14:04.116788 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-82362c3e-9616-4dc4-8cf1-55ea17b050f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:04.126758 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1284/2524] 10.222.0.85 () {58 vars in 1009 bytes} [Tue Aug 2 10:14:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:14:04.139940 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb93f7-32fd-48d9-8552-9688469c069d service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:04.152508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb93f7-32fd-48d9-8552-9688469c069d service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:04.158694 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ca255-1b0a-4be6-85e3-2f6c6e793736 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cfed2469a7419f8fcbe09d25cb896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:04.159411 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ca255-1b0a-4be6-85e3-2f6c6e793736 service swift] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:04.159757 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ca255-1b0a-4be6-85e3-2f6c6e793736 service swift] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:04.160146 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ca255-1b0a-4be6-85e3-2f6c6e793736 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:04.169124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ca255-1b0a-4be6-85e3-2f6c6e793736 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:04.170705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758ca255-1b0a-4be6-85e3-2f6c6e793736 service swift] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:04.179063 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1241/2525] 10.222.0.85 () {60 vars in 1384 bytes} [Tue Aug 2 10:14:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 10:14:06.597342 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82362c3e-9616-4dc4-8cf1-55ea17b050f7 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:06.611847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82362c3e-9616-4dc4-8cf1-55ea17b050f7 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:06.616017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41a128e-6d33-455a-8621-3c803cb57002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:06.616989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a128e-6d33-455a-8621-3c803cb57002 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:06.617515 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a128e-6d33-455a-8621-3c803cb57002 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:06.617968 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41a128e-6d33-455a-8621-3c803cb57002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:06.629951 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a128e-6d33-455a-8621-3c803cb57002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:06.631812 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41a128e-6d33-455a-8621-3c803cb57002 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:06.647364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1285/2526] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:14:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:14:12.883690 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ca255-1b0a-4be6-85e3-2f6c6e793736 service swift] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:12.885215 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-758ca255-1b0a-4be6-85e3-2f6c6e793736 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:12.982749 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ca255-1b0a-4be6-85e3-2f6c6e793736 service swift] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:12.989111 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987f875-dfaf-45bc-9027-46d74a5a3c33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2a420cc676e4f2bb2766826a1de3b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:12.990012 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987f875-dfaf-45bc-9027-46d74a5a3c33 service placement] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:12.990469 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987f875-dfaf-45bc-9027-46d74a5a3c33 service placement] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:12.990921 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987f875-dfaf-45bc-9027-46d74a5a3c33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:12.994122 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7987f875-dfaf-45bc-9027-46d74a5a3c33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:13.021956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987f875-dfaf-45bc-9027-46d74a5a3c33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:13.024382 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987f875-dfaf-45bc-9027-46d74a5a3c33 service placement] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:13.035592 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1242/2527] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:14:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:14:16.638519 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=34 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:14:21.892883 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659224a6-0550-4015-b050-a10e456bd5b6 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:21.893477 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659224a6-0550-4015-b050-a10e456bd5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:21.893477 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659224a6-0550-4015-b050-a10e456bd5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:21.912770 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-659224a6-0550-4015-b050-a10e456bd5b6 None None] MFA Rules not processed for user `f43a16e2dcab4872963222c557853d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:14:21.913969 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-659224a6-0550-4015-b050-a10e456bd5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:21.921171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1286/2528] 10.222.0.85 () {58 vars in 967 bytes} [Tue Aug 2 10:14:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:14:21.933878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987f875-dfaf-45bc-9027-46d74a5a3c33 service placement] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:21.946322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987f875-dfaf-45bc-9027-46d74a5a3c33 service placement] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:21.951337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d65de6-ae74-43d5-8f3c-672f90cdab2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cfed2469a7419f8fcbe09d25cb896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:21.951937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d65de6-ae74-43d5-8f3c-672f90cdab2b service swift] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:21.952219 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d65de6-ae74-43d5-8f3c-672f90cdab2b service swift] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:21.952523 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d65de6-ae74-43d5-8f3c-672f90cdab2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:21.961209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d65de6-ae74-43d5-8f3c-672f90cdab2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:21.962770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d65de6-ae74-43d5-8f3c-672f90cdab2b service swift] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:21.971758 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1243/2529] 10.222.0.85 () {60 vars in 1384 bytes} [Tue Aug 2 10:14:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 10:14:23.921160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659224a6-0550-4015-b050-a10e456bd5b6 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:23.922640 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-659224a6-0550-4015-b050-a10e456bd5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:24.004319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659224a6-0550-4015-b050-a10e456bd5b6 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:24.008968 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1a76a-517a-4dcd-b76f-7d602c654fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:24.009613 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1a76a-517a-4dcd-b76f-7d602c654fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:24.009896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1a76a-517a-4dcd-b76f-7d602c654fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:24.010169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1a76a-517a-4dcd-b76f-7d602c654fcd admin admin] PATH_INFO: `/v3/users/88547678e63c4f6690f8be0195af81ca` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:24.011338 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1a76a-517a-4dcd-b76f-7d602c654fcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=88547678e63c4f6690f8be0195af81ca)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:24.013301 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1a76a-517a-4dcd-b76f-7d602c654fcd admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:24.058559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-68c1a76a-517a-4dcd-b76f-7d602c654fcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88547678e63c4f6690f8be0195af81ca'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:24.059199 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-68c1a76a-517a-4dcd-b76f-7d602c654fcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88547678e63c4f6690f8be0195af81ca'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:24.066780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-68c1a76a-517a-4dcd-b76f-7d602c654fcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88547678e63c4f6690f8be0195af81ca'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:24.078447 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-68c1a76a-517a-4dcd-b76f-7d602c654fcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88547678e63c4f6690f8be0195af81ca'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:24.086532 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-68c1a76a-517a-4dcd-b76f-7d602c654fcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88547678e63c4f6690f8be0195af81ca'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:24.092615 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1287/2530] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:14:23 2022] DELETE /identity/v3/users/88547678e63c4f6690f8be0195af81ca => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:14:24.284038 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d65de6-ae74-43d5-8f3c-672f90cdab2b service swift] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:24.296541 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d65de6-ae74-43d5-8f3c-672f90cdab2b service swift] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:24.307459 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:14:24.358410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e01a5e-059f-4cae-ab88-046a285e3e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:24.358970 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e01a5e-059f-4cae-ab88-046a285e3e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:24.359252 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e01a5e-059f-4cae-ab88-046a285e3e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:24.359529 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e01a5e-059f-4cae-ab88-046a285e3e50 admin admin] PATH_INFO: `/v3/projects/fbddf94725704ea8a895ce19f40268bd` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:24.361552 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e01a5e-059f-4cae-ab88-046a285e3e50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbddf94725704ea8a895ce19f40268bd)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:24.363800 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e01a5e-059f-4cae-ab88-046a285e3e50 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:24.409712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-86e01a5e-059f-4cae-ab88-046a285e3e50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbddf94725704ea8a895ce19f40268bd', 'request_id': 'req-86e01a5e-059f-4cae-ab88-046a285e3e50'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:24.415172 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-86e01a5e-059f-4cae-ab88-046a285e3e50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbddf94725704ea8a895ce19f40268bd', 'request_id': 'req-86e01a5e-059f-4cae-ab88-046a285e3e50'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:24.421281 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-86e01a5e-059f-4cae-ab88-046a285e3e50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbddf94725704ea8a895ce19f40268bd', 'request_id': 'req-86e01a5e-059f-4cae-ab88-046a285e3e50'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:24.434801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-86e01a5e-059f-4cae-ab88-046a285e3e50 admin admin] The token cache is being invalidate because project fbddf94725704ea8a895ce19f40268bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:14:24.435099 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-86e01a5e-059f-4cae-ab88-046a285e3e50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:24.436287 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-86e01a5e-059f-4cae-ab88-046a285e3e50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:24.437825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1244/2531] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:14:24 2022] DELETE /identity/v3/projects/fbddf94725704ea8a895ce19f40268bd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:14:24.443456 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa6c47-243d-49f0-b8ab-5ef7e37333d8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:24.443752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa6c47-243d-49f0-b8ab-5ef7e37333d8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:24.444016 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa6c47-243d-49f0-b8ab-5ef7e37333d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:24.464005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4aaa6c47-243d-49f0-b8ab-5ef7e37333d8 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:14:24.465441 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4aaa6c47-243d-49f0-b8ab-5ef7e37333d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:24.525606 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1288/2532] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:14:24.534226 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768c2ac-6922-4e47-b5fb-2d0539f822c8 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:24.534544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768c2ac-6922-4e47-b5fb-2d0539f822c8 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:24.534827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768c2ac-6922-4e47-b5fb-2d0539f822c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:24.555631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-6768c2ac-6922-4e47-b5fb-2d0539f822c8 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:14:24.556999 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-6768c2ac-6922-4e47-b5fb-2d0539f822c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:24.566095 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1245/2533] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:14:24.570405 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa6c47-243d-49f0-b8ab-5ef7e37333d8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:24.580595 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa6c47-243d-49f0-b8ab-5ef7e37333d8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:24.585170 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec58c2d-13a3-49ad-b7be-2767025fb0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:24.585777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec58c2d-13a3-49ad-b7be-2767025fb0eb admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:24.586057 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec58c2d-13a3-49ad-b7be-2767025fb0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:24.586331 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec58c2d-13a3-49ad-b7be-2767025fb0eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:24.587025 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec58c2d-13a3-49ad-b7be-2767025fb0eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:14:24.587333 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec58c2d-13a3-49ad-b7be-2767025fb0eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:24.588994 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec58c2d-13a3-49ad-b7be-2767025fb0eb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:24.598442 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:14:24.602117 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1289/2534] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:14:24.608179 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768c2ac-6922-4e47-b5fb-2d0539f822c8 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:24.619998 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768c2ac-6922-4e47-b5fb-2d0539f822c8 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:24.626165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbd29f-4eac-4370-a26d-1f44c43fc172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:24.626935 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbd29f-4eac-4370-a26d-1f44c43fc172 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:24.627218 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbd29f-4eac-4370-a26d-1f44c43fc172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:24.627492 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbd29f-4eac-4370-a26d-1f44c43fc172 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:24.628165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbd29f-4eac-4370-a26d-1f44c43fc172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:24.630106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbd29f-4eac-4370-a26d-1f44c43fc172 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:24.659253 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1246/2535] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:14:24 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:14:24.663492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec58c2d-13a3-49ad-b7be-2767025fb0eb admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:24.674139 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec58c2d-13a3-49ad-b7be-2767025fb0eb admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:24.730040 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a1cc3-af6f-4349-8c8b-e9bc22781943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:24.730662 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a1cc3-af6f-4349-8c8b-e9bc22781943 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:24.730944 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a1cc3-af6f-4349-8c8b-e9bc22781943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:24.731218 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a1cc3-af6f-4349-8c8b-e9bc22781943 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:24.731884 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a1cc3-af6f-4349-8c8b-e9bc22781943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:24.733840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63a1cc3-af6f-4349-8c8b-e9bc22781943 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:24.755679 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1290/2536] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:14:24 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:14:24.759783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbd29f-4eac-4370-a26d-1f44c43fc172 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:24.770712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbd29f-4eac-4370-a26d-1f44c43fc172 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:24.775344 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba043d-409d-4a19-89ba-32abed39efb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:24.775945 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba043d-409d-4a19-89ba-32abed39efb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:24.776229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba043d-409d-4a19-89ba-32abed39efb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:24.776534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba043d-409d-4a19-89ba-32abed39efb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:24.777227 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba043d-409d-4a19-89ba-32abed39efb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:24.778817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffba043d-409d-4a19-89ba-32abed39efb4 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:24.789530 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1247/2537] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:14:24.793412 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a1cc3-af6f-4349-8c8b-e9bc22781943 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:24.804186 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63a1cc3-af6f-4349-8c8b-e9bc22781943 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:24.808974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea52ec1-4495-4de0-aefc-80dc64ace746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:24.809578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea52ec1-4495-4de0-aefc-80dc64ace746 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:24.809861 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea52ec1-4495-4de0-aefc-80dc64ace746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:24.810155 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea52ec1-4495-4de0-aefc-80dc64ace746 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:24.810835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea52ec1-4495-4de0-aefc-80dc64ace746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:24.812415 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea52ec1-4495-4de0-aefc-80dc64ace746 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:24.823102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1291/2538] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:14:24.827358 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba043d-409d-4a19-89ba-32abed39efb4 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:24.837793 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba043d-409d-4a19-89ba-32abed39efb4 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:24.842676 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3ca06-4566-43ae-8900-1270d2ad484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:24.843327 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3ca06-4566-43ae-8900-1270d2ad484e admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:24.843608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3ca06-4566-43ae-8900-1270d2ad484e admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:24.843880 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3ca06-4566-43ae-8900-1270d2ad484e admin admin] PATH_INFO: `/v3/projects/ce7eadfd5afb4249a2fcd923aaf56cd3/users/9c825c707aa64029a3f421ca0a082b26/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:24.858851 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3ca06-4566-43ae-8900-1270d2ad484e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7eadfd5afb4249a2fcd923aaf56cd3, user_id=9c825c707aa64029a3f421ca0a082b26, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:24.862588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3ca06-4566-43ae-8900-1270d2ad484e admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:24.875707 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1248/2539] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:14:24 2022] PUT /identity/v3/projects/ce7eadfd5afb4249a2fcd923aaf56cd3/users/9c825c707aa64029a3f421ca0a082b26/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:14:24.885824 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358b771-4b4f-4f33-9fdd-d614afd13a61 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:24.886114 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358b771-4b4f-4f33-9fdd-d614afd13a61 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:24.886389 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358b771-4b4f-4f33-9fdd-d614afd13a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:24.915159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9358b771-4b4f-4f33-9fdd-d614afd13a61 None None] MFA Rules not processed for user `9c825c707aa64029a3f421ca0a082b26`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:14:24.916372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9358b771-4b4f-4f33-9fdd-d614afd13a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:24.982250 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1292/2540] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:14:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:14:24.994435 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3ca06-4566-43ae-8900-1270d2ad484e admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:24.996128 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-0aa3ca06-4566-43ae-8900-1270d2ad484e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:25.040201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:14:25.055184 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3ca06-4566-43ae-8900-1270d2ad484e admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:25.058894 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5401c0-00ae-4218-af89-0d06a8fcb397 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:25.059510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5401c0-00ae-4218-af89-0d06a8fcb397 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:25.059797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5401c0-00ae-4218-af89-0d06a8fcb397 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:25.060080 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5401c0-00ae-4218-af89-0d06a8fcb397 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:25.068556 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5401c0-00ae-4218-af89-0d06a8fcb397 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:25.069987 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5401c0-00ae-4218-af89-0d06a8fcb397 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:25.079402 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1249/2541] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:14:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:14:27.631707 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358b771-4b4f-4f33-9fdd-d614afd13a61 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:27.697001 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358b771-4b4f-4f33-9fdd-d614afd13a61 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:27.701597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9737c-5547-4950-a3b9-fb08f0b3bab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:27.702234 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9737c-5547-4950-a3b9-fb08f0b3bab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:27.702521 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9737c-5547-4950-a3b9-fb08f0b3bab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:27.702789 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9737c-5547-4950-a3b9-fb08f0b3bab4 admin admin] PATH_INFO: `/v3/users/9c825c707aa64029a3f421ca0a082b26` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:27.703975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9737c-5547-4950-a3b9-fb08f0b3bab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c825c707aa64029a3f421ca0a082b26)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:27.705933 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9737c-5547-4950-a3b9-fb08f0b3bab4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:27.718207 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:14:27.756352 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-68b9737c-5547-4950-a3b9-fb08f0b3bab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c825c707aa64029a3f421ca0a082b26'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:27.757063 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-68b9737c-5547-4950-a3b9-fb08f0b3bab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c825c707aa64029a3f421ca0a082b26'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:27.764037 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-68b9737c-5547-4950-a3b9-fb08f0b3bab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c825c707aa64029a3f421ca0a082b26'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:27.776662 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-68b9737c-5547-4950-a3b9-fb08f0b3bab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c825c707aa64029a3f421ca0a082b26'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:27.784404 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-68b9737c-5547-4950-a3b9-fb08f0b3bab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c825c707aa64029a3f421ca0a082b26'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:27.790372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1293/2542] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:14:27 2022] DELETE /identity/v3/users/9c825c707aa64029a3f421ca0a082b26 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:14:27.794825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c87015-8da5-4a34-8f27-cf878d71a799 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:27.795412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c87015-8da5-4a34-8f27-cf878d71a799 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:27.795412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c87015-8da5-4a34-8f27-cf878d71a799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:27.815532 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-74c87015-8da5-4a34-8f27-cf878d71a799 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:14:27.816787 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-74c87015-8da5-4a34-8f27-cf878d71a799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:27.876483 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1250/2543] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:14:27.885974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9737c-5547-4950-a3b9-fb08f0b3bab4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:27.887348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-68b9737c-5547-4950-a3b9-fb08f0b3bab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:27.945063 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9737c-5547-4950-a3b9-fb08f0b3bab4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:27.948766 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704ca06-bc8f-4162-8254-142c5ebf6799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:27.949372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704ca06-bc8f-4162-8254-142c5ebf6799 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:27.949654 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704ca06-bc8f-4162-8254-142c5ebf6799 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:27.949928 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704ca06-bc8f-4162-8254-142c5ebf6799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:27.959716 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704ca06-bc8f-4162-8254-142c5ebf6799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:27.961184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704ca06-bc8f-4162-8254-142c5ebf6799 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:27.970632 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1294/2544] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:14:28.241320 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c87015-8da5-4a34-8f27-cf878d71a799 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:28.242774 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-74c87015-8da5-4a34-8f27-cf878d71a799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:28.263550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c87015-8da5-4a34-8f27-cf878d71a799 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:28.269431 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d08e4b-91a7-4d8b-9d9f-ddeb7e197690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:28.270088 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d08e4b-91a7-4d8b-9d9f-ddeb7e197690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:28.270463 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d08e4b-91a7-4d8b-9d9f-ddeb7e197690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:28.270636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d08e4b-91a7-4d8b-9d9f-ddeb7e197690 admin admin] PATH_INFO: `/v3/projects/ce7eadfd5afb4249a2fcd923aaf56cd3` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:28.271825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d08e4b-91a7-4d8b-9d9f-ddeb7e197690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce7eadfd5afb4249a2fcd923aaf56cd3)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:28.273796 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d08e4b-91a7-4d8b-9d9f-ddeb7e197690 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:28.324575 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-79d08e4b-91a7-4d8b-9d9f-ddeb7e197690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce7eadfd5afb4249a2fcd923aaf56cd3', 'request_id': 'req-79d08e4b-91a7-4d8b-9d9f-ddeb7e197690'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:28.331658 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-79d08e4b-91a7-4d8b-9d9f-ddeb7e197690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce7eadfd5afb4249a2fcd923aaf56cd3', 'request_id': 'req-79d08e4b-91a7-4d8b-9d9f-ddeb7e197690'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:28.338234 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-79d08e4b-91a7-4d8b-9d9f-ddeb7e197690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce7eadfd5afb4249a2fcd923aaf56cd3', 'request_id': 'req-79d08e4b-91a7-4d8b-9d9f-ddeb7e197690'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:28.351255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-79d08e4b-91a7-4d8b-9d9f-ddeb7e197690 admin admin] The token cache is being invalidate because project ce7eadfd5afb4249a2fcd923aaf56cd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:14:28.351664 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-79d08e4b-91a7-4d8b-9d9f-ddeb7e197690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:28.352176 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-79d08e4b-91a7-4d8b-9d9f-ddeb7e197690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:28.353706 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1251/2545] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:14:28 2022] DELETE /identity/v3/projects/ce7eadfd5afb4249a2fcd923aaf56cd3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:14:28.358872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b8ac1-280a-4257-bec0-445cfdabce9d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:28.359155 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b8ac1-280a-4257-bec0-445cfdabce9d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:28.359430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b8ac1-280a-4257-bec0-445cfdabce9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:28.380312 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-672b8ac1-280a-4257-bec0-445cfdabce9d None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:14:28.381605 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-672b8ac1-280a-4257-bec0-445cfdabce9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:28.443461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1295/2546] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:14:28.451179 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbd40c-03f2-4ee4-af89-185dfb6528c8 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:28.451469 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbd40c-03f2-4ee4-af89-185dfb6528c8 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:28.451749 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bbd40c-03f2-4ee4-af89-185dfb6528c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:28.471962 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-78bbd40c-03f2-4ee4-af89-185dfb6528c8 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:14:28.473220 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-78bbd40c-03f2-4ee4-af89-185dfb6528c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:28.481233 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1252/2547] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:14:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:14:28.485665 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b8ac1-280a-4257-bec0-445cfdabce9d None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:28.495814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b8ac1-280a-4257-bec0-445cfdabce9d None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:28.501032 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d0f5d-f841-46dd-b375-009ab2cc6ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:28.501647 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d0f5d-f841-46dd-b375-009ab2cc6ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:28.501922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d0f5d-f841-46dd-b375-009ab2cc6ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:28.502190 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d0f5d-f841-46dd-b375-009ab2cc6ef5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:28.502883 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d0f5d-f841-46dd-b375-009ab2cc6ef5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:14:28.503185 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d0f5d-f841-46dd-b375-009ab2cc6ef5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:28.504811 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2d0f5d-f841-46dd-b375-009ab2cc6ef5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:28.517843 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1296/2548] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:14:28.522274 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbd40c-03f2-4ee4-af89-185dfb6528c8 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:28.531669 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bbd40c-03f2-4ee4-af89-185dfb6528c8 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:28.536378 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f556cc-a973-446d-ba65-8463ee1121a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:28.537008 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f556cc-a973-446d-ba65-8463ee1121a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:28.537290 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f556cc-a973-446d-ba65-8463ee1121a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:28.537563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f556cc-a973-446d-ba65-8463ee1121a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:28.538223 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f556cc-a973-446d-ba65-8463ee1121a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:28.540112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f556cc-a973-446d-ba65-8463ee1121a3 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:28.567372 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1253/2549] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:14:28 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:14:28.571489 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d0f5d-f841-46dd-b375-009ab2cc6ef5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:28.582113 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d0f5d-f841-46dd-b375-009ab2cc6ef5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:28.594516 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:14:28.642252 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f173370-e6a7-4479-b5b6-b2cc4be79356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:28.642963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f173370-e6a7-4479-b5b6-b2cc4be79356 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:28.643148 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f173370-e6a7-4479-b5b6-b2cc4be79356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:28.643400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f173370-e6a7-4479-b5b6-b2cc4be79356 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:28.644080 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f173370-e6a7-4479-b5b6-b2cc4be79356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:28.646026 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f173370-e6a7-4479-b5b6-b2cc4be79356 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:28.672436 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1297/2550] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:14:28 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:14:28.676619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f556cc-a973-446d-ba65-8463ee1121a3 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:28.686725 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f556cc-a973-446d-ba65-8463ee1121a3 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:28.691956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46c778-db4b-4dc7-8035-53b0edff3efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:28.692634 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46c778-db4b-4dc7-8035-53b0edff3efe admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:28.692917 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46c778-db4b-4dc7-8035-53b0edff3efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:28.693190 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46c778-db4b-4dc7-8035-53b0edff3efe admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:28.693938 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46c778-db4b-4dc7-8035-53b0edff3efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:28.695467 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46c778-db4b-4dc7-8035-53b0edff3efe admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:28.705779 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1254/2551] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:14:28.709793 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f173370-e6a7-4479-b5b6-b2cc4be79356 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:28.720964 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f173370-e6a7-4479-b5b6-b2cc4be79356 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:28.725774 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33ba5d-d010-4dd9-b315-f238beabec44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:28.726379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33ba5d-d010-4dd9-b315-f238beabec44 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:28.726660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33ba5d-d010-4dd9-b315-f238beabec44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:28.726936 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33ba5d-d010-4dd9-b315-f238beabec44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:28.727628 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33ba5d-d010-4dd9-b315-f238beabec44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:28.729266 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c33ba5d-d010-4dd9-b315-f238beabec44 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:28.741402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1298/2552] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:14:28.745634 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46c778-db4b-4dc7-8035-53b0edff3efe admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:28.756242 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46c778-db4b-4dc7-8035-53b0edff3efe admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:28.760893 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabe2a1-6c09-4402-aacc-24b13126f37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:28.761544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabe2a1-6c09-4402-aacc-24b13126f37e admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:28.761826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabe2a1-6c09-4402-aacc-24b13126f37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:28.762105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabe2a1-6c09-4402-aacc-24b13126f37e admin admin] PATH_INFO: `/v3/projects/76273356e6f34dedb09d231e0aad89fa/users/c42770a0f10f441fbb3550a570fe46c9/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:28.777714 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabe2a1-6c09-4402-aacc-24b13126f37e admin admin] RBAC: Authorizing `identity:create_grant(project_id=76273356e6f34dedb09d231e0aad89fa, user_id=c42770a0f10f441fbb3550a570fe46c9, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:28.780573 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabe2a1-6c09-4402-aacc-24b13126f37e admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:28.794375 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1255/2553] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:14:28 2022] PUT /identity/v3/projects/76273356e6f34dedb09d231e0aad89fa/users/c42770a0f10f441fbb3550a570fe46c9/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:14:28.864770 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32982739-5f10-4926-87c2-99642342e3f3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:28.864955 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32982739-5f10-4926-87c2-99642342e3f3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:28.865236 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32982739-5f10-4926-87c2-99642342e3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:28.893368 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-32982739-5f10-4926-87c2-99642342e3f3 None None] MFA Rules not processed for user `c42770a0f10f441fbb3550a570fe46c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:14:28.894620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-32982739-5f10-4926-87c2-99642342e3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:28.959957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1299/2554] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:14:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:14:28.972035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabe2a1-6c09-4402-aacc-24b13126f37e admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:28.974484 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2dabe2a1-6c09-4402-aacc-24b13126f37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:28.981593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:14:29.037187 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabe2a1-6c09-4402-aacc-24b13126f37e admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:29.040884 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de897c4-bf61-40d4-9d73-d724e957310c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0af63c36df2c4ceaa2df4d3ac59542bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:29.041490 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de897c4-bf61-40d4-9d73-d724e957310c service glance] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:29.041775 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de897c4-bf61-40d4-9d73-d724e957310c service glance] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:29.042052 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de897c4-bf61-40d4-9d73-d724e957310c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:29.051119 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de897c4-bf61-40d4-9d73-d724e957310c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:29.052582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de897c4-bf61-40d4-9d73-d724e957310c service glance] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:29.061277 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1256/2555] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:14:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:14:38.957060 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=58,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:14:39.057405 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=25 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:14:53.747642 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32982739-5f10-4926-87c2-99642342e3f3 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:53.816407 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32982739-5f10-4926-87c2-99642342e3f3 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:53.821020 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b369882-9609-44f5-a84d-4b5b58bb1617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:53.821663 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b369882-9609-44f5-a84d-4b5b58bb1617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:53.821940 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b369882-9609-44f5-a84d-4b5b58bb1617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:53.822211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b369882-9609-44f5-a84d-4b5b58bb1617 admin admin] PATH_INFO: `/v3/users/c42770a0f10f441fbb3550a570fe46c9` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:53.823381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b369882-9609-44f5-a84d-4b5b58bb1617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c42770a0f10f441fbb3550a570fe46c9)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:53.825375 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b369882-9609-44f5-a84d-4b5b58bb1617 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:53.877514 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9b369882-9609-44f5-a84d-4b5b58bb1617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c42770a0f10f441fbb3550a570fe46c9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:53.878225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9b369882-9609-44f5-a84d-4b5b58bb1617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c42770a0f10f441fbb3550a570fe46c9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:53.885483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9b369882-9609-44f5-a84d-4b5b58bb1617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c42770a0f10f441fbb3550a570fe46c9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:53.899580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9b369882-9609-44f5-a84d-4b5b58bb1617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c42770a0f10f441fbb3550a570fe46c9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:53.906603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9b369882-9609-44f5-a84d-4b5b58bb1617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c42770a0f10f441fbb3550a570fe46c9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:53.913016 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1300/2556] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:14:53 2022] DELETE /identity/v3/users/c42770a0f10f441fbb3550a570fe46c9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:14:53.917819 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466e3e6-f64b-4dba-b2fb-cd1954c58765 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:53.918305 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466e3e6-f64b-4dba-b2fb-cd1954c58765 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:53.918430 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466e3e6-f64b-4dba-b2fb-cd1954c58765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:53.937291 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-b466e3e6-f64b-4dba-b2fb-cd1954c58765 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:14:53.939201 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b466e3e6-f64b-4dba-b2fb-cd1954c58765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:54.001019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1257/2557] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:14:54.011290 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b369882-9609-44f5-a84d-4b5b58bb1617 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:54.013309 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9b369882-9609-44f5-a84d-4b5b58bb1617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:54.072444 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b369882-9609-44f5-a84d-4b5b58bb1617 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:54.076653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fc2fa-37fb-450c-a237-c485007a7099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:54.077271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fc2fa-37fb-450c-a237-c485007a7099 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:54.077551 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fc2fa-37fb-450c-a237-c485007a7099 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:54.077827 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fc2fa-37fb-450c-a237-c485007a7099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:54.087873 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03fc2fa-37fb-450c-a237-c485007a7099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:54.089349 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03fc2fa-37fb-450c-a237-c485007a7099 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:54.099084 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1301/2558] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:14:54.370846 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466e3e6-f64b-4dba-b2fb-cd1954c58765 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:54.372582 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b466e3e6-f64b-4dba-b2fb-cd1954c58765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:54.392102 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466e3e6-f64b-4dba-b2fb-cd1954c58765 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:54.405299 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3cdc0-7ff8-4575-9dd3-3e6cbf798b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:54.405984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3cdc0-7ff8-4575-9dd3-3e6cbf798b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:54.406290 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3cdc0-7ff8-4575-9dd3-3e6cbf798b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:54.407348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3cdc0-7ff8-4575-9dd3-3e6cbf798b24 admin admin] PATH_INFO: `/v3/projects/76273356e6f34dedb09d231e0aad89fa` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:54.408733 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3cdc0-7ff8-4575-9dd3-3e6cbf798b24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76273356e6f34dedb09d231e0aad89fa)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:54.410724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3cdc0-7ff8-4575-9dd3-3e6cbf798b24 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:54.465560 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-02e3cdc0-7ff8-4575-9dd3-3e6cbf798b24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76273356e6f34dedb09d231e0aad89fa', 'request_id': 'req-02e3cdc0-7ff8-4575-9dd3-3e6cbf798b24'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:54.474389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-02e3cdc0-7ff8-4575-9dd3-3e6cbf798b24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76273356e6f34dedb09d231e0aad89fa', 'request_id': 'req-02e3cdc0-7ff8-4575-9dd3-3e6cbf798b24'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:54.480893 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-02e3cdc0-7ff8-4575-9dd3-3e6cbf798b24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76273356e6f34dedb09d231e0aad89fa', 'request_id': 'req-02e3cdc0-7ff8-4575-9dd3-3e6cbf798b24'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:54.494231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-02e3cdc0-7ff8-4575-9dd3-3e6cbf798b24 admin admin] The token cache is being invalidate because project 76273356e6f34dedb09d231e0aad89fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:14:54.494520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-02e3cdc0-7ff8-4575-9dd3-3e6cbf798b24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:54.495142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-02e3cdc0-7ff8-4575-9dd3-3e6cbf798b24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:14:54.496727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1258/2559] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:14:54 2022] DELETE /identity/v3/projects/76273356e6f34dedb09d231e0aad89fa => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:14:54.502292 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100423d-350f-476b-b7f7-0cea01d0b526 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:54.502598 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100423d-350f-476b-b7f7-0cea01d0b526 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:54.502865 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100423d-350f-476b-b7f7-0cea01d0b526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:54.524558 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0100423d-350f-476b-b7f7-0cea01d0b526 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:14:54.525851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0100423d-350f-476b-b7f7-0cea01d0b526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:54.543511 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:14:54.587958 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1302/2560] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:14:54.596800 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398ce07-de9b-4a53-85ec-d85fca242543 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:54.597166 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398ce07-de9b-4a53-85ec-d85fca242543 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:54.597472 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398ce07-de9b-4a53-85ec-d85fca242543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:54.626897 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-7398ce07-de9b-4a53-85ec-d85fca242543 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:14:54.628194 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7398ce07-de9b-4a53-85ec-d85fca242543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:54.637158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1259/2561] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:14:54.642087 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100423d-350f-476b-b7f7-0cea01d0b526 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:54.652056 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100423d-350f-476b-b7f7-0cea01d0b526 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:54.657417 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3033a8c-036e-4101-8457-e26c69c00626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:54.658053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3033a8c-036e-4101-8457-e26c69c00626 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:54.658337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3033a8c-036e-4101-8457-e26c69c00626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:54.658615 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3033a8c-036e-4101-8457-e26c69c00626 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:54.659387 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3033a8c-036e-4101-8457-e26c69c00626 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:14:54.659696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3033a8c-036e-4101-8457-e26c69c00626 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:54.661338 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3033a8c-036e-4101-8457-e26c69c00626 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:54.673814 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1303/2562] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:14:54.678631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398ce07-de9b-4a53-85ec-d85fca242543 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:54.688643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398ce07-de9b-4a53-85ec-d85fca242543 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:54.693358 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182588b-9e0b-4c58-aa4f-62e496eab56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:54.693965 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182588b-9e0b-4c58-aa4f-62e496eab56c admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:54.694249 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182588b-9e0b-4c58-aa4f-62e496eab56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:54.694526 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182588b-9e0b-4c58-aa4f-62e496eab56c admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:54.695200 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182588b-9e0b-4c58-aa4f-62e496eab56c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:54.697137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182588b-9e0b-4c58-aa4f-62e496eab56c admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:54.725593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1260/2563] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:14:54 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:14:54.729692 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3033a8c-036e-4101-8457-e26c69c00626 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:54.740520 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3033a8c-036e-4101-8457-e26c69c00626 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:54.813851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08dfcc-c7e7-4fdd-a28c-916a8c62c285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:54.814884 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08dfcc-c7e7-4fdd-a28c-916a8c62c285 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:54.814884 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08dfcc-c7e7-4fdd-a28c-916a8c62c285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:54.815077 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08dfcc-c7e7-4fdd-a28c-916a8c62c285 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:54.815836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08dfcc-c7e7-4fdd-a28c-916a8c62c285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:54.818114 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08dfcc-c7e7-4fdd-a28c-916a8c62c285 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:54.840304 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1304/2564] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:14:54 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:14:54.846418 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182588b-9e0b-4c58-aa4f-62e496eab56c admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:54.857067 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182588b-9e0b-4c58-aa4f-62e496eab56c admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:54.863460 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2559a9-bd3d-49a5-bc73-f99b188fb819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:54.864073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2559a9-bd3d-49a5-bc73-f99b188fb819 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:54.864361 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2559a9-bd3d-49a5-bc73-f99b188fb819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:54.864672 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2559a9-bd3d-49a5-bc73-f99b188fb819 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:54.865376 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2559a9-bd3d-49a5-bc73-f99b188fb819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:54.866976 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2559a9-bd3d-49a5-bc73-f99b188fb819 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:54.877473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1261/2565] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:14:54.881703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08dfcc-c7e7-4fdd-a28c-916a8c62c285 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:54.892201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08dfcc-c7e7-4fdd-a28c-916a8c62c285 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:54.897054 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39d7c6-c6e0-43f9-afdd-bd47c86b83fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:54.897693 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39d7c6-c6e0-43f9-afdd-bd47c86b83fd admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:54.898000 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39d7c6-c6e0-43f9-afdd-bd47c86b83fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:54.898277 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39d7c6-c6e0-43f9-afdd-bd47c86b83fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:54.898997 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39d7c6-c6e0-43f9-afdd-bd47c86b83fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:54.900874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39d7c6-c6e0-43f9-afdd-bd47c86b83fd admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:54.924510 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1305/2566] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:14:54.926104 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2559a9-bd3d-49a5-bc73-f99b188fb819 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:54.936612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2559a9-bd3d-49a5-bc73-f99b188fb819 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:54.941442 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12359c71-8253-4ffb-9621-5f7050af19d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:54.942105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12359c71-8253-4ffb-9621-5f7050af19d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:54.942387 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12359c71-8253-4ffb-9621-5f7050af19d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:54.942664 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12359c71-8253-4ffb-9621-5f7050af19d8 admin admin] PATH_INFO: `/v3/projects/01df91c14fe9484a899245586b63bf52/users/9db6184bbcf841c2905b6e4dbc2c3b52/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:54.959386 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12359c71-8253-4ffb-9621-5f7050af19d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01df91c14fe9484a899245586b63bf52, user_id=9db6184bbcf841c2905b6e4dbc2c3b52, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:54.962179 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12359c71-8253-4ffb-9621-5f7050af19d8 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:54.977654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1262/2567] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:14:54 2022] PUT /identity/v3/projects/01df91c14fe9484a899245586b63bf52/users/9db6184bbcf841c2905b6e4dbc2c3b52/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:14:54.990160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad46d0-29db-4cac-a990-121f7870e8bf None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:54.990530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad46d0-29db-4cac-a990-121f7870e8bf None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:54.990870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad46d0-29db-4cac-a990-121f7870e8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:55.020103 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-29ad46d0-29db-4cac-a990-121f7870e8bf None None] MFA Rules not processed for user `9db6184bbcf841c2905b6e4dbc2c3b52`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:14:55.021330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-29ad46d0-29db-4cac-a990-121f7870e8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:55.091755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1306/2568] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:14:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:14:55.103650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12359c71-8253-4ffb-9621-5f7050af19d8 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:14:55.105372 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-12359c71-8253-4ffb-9621-5f7050af19d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:14:55.129258 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:14:55.305027 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12359c71-8253-4ffb-9621-5f7050af19d8 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:14:55.309398 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb42bc3-1b66-4359-8067-933fb1d2576f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:14:55.310142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb42bc3-1b66-4359-8067-933fb1d2576f service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:14:55.310308 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb42bc3-1b66-4359-8067-933fb1d2576f service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:14:55.310585 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb42bc3-1b66-4359-8067-933fb1d2576f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:14:55.320250 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb42bc3-1b66-4359-8067-933fb1d2576f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:14:55.321711 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb42bc3-1b66-4359-8067-933fb1d2576f service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:14:55.331340 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1263/2569] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:14:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:15:01.920820 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f030195-e367-4144-9645-09a8d13db32e None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:15:01.921388 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f030195-e367-4144-9645-09a8d13db32e None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:15:01.921388 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f030195-e367-4144-9645-09a8d13db32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:15:01.943478 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3f030195-e367-4144-9645-09a8d13db32e None None] MFA Rules not processed for user `324d0f6b637647a29580091f3a248cda`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:15:01.944777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3f030195-e367-4144-9645-09a8d13db32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:15:01.961043 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:15:02.008557 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1307/2570] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:15:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:15:05.327084 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=17 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:15:12.001781 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=17 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:15:25.665102 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb42bc3-1b66-4359-8067-933fb1d2576f service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:15:25.728213 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb42bc3-1b66-4359-8067-933fb1d2576f service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:15:25.732898 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb00d7-3703-44ff-86b6-fca37604726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:15:25.733531 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb00d7-3703-44ff-86b6-fca37604726b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:15:25.733815 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb00d7-3703-44ff-86b6-fca37604726b admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:15:25.734771 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb00d7-3703-44ff-86b6-fca37604726b admin admin] PATH_INFO: `/v3/users/9db6184bbcf841c2905b6e4dbc2c3b52` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:15:25.735945 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb00d7-3703-44ff-86b6-fca37604726b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db6184bbcf841c2905b6e4dbc2c3b52)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:15:25.738158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb00d7-3703-44ff-86b6-fca37604726b admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:15:25.785831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-edfb00d7-3703-44ff-86b6-fca37604726b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db6184bbcf841c2905b6e4dbc2c3b52'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:15:25.786489 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-edfb00d7-3703-44ff-86b6-fca37604726b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db6184bbcf841c2905b6e4dbc2c3b52'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:15:25.798792 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-edfb00d7-3703-44ff-86b6-fca37604726b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db6184bbcf841c2905b6e4dbc2c3b52'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:15:25.806204 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-edfb00d7-3703-44ff-86b6-fca37604726b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db6184bbcf841c2905b6e4dbc2c3b52'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:15:25.806929 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-edfb00d7-3703-44ff-86b6-fca37604726b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db6184bbcf841c2905b6e4dbc2c3b52'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:15:25.819107 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1264/2571] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:15:25 2022] DELETE /identity/v3/users/9db6184bbcf841c2905b6e4dbc2c3b52 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:15:25.823575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358ce20-b1e5-4683-b06d-1b5bde0c0fbc None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:15:25.824065 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358ce20-b1e5-4683-b06d-1b5bde0c0fbc None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:15:25.824160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358ce20-b1e5-4683-b06d-1b5bde0c0fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:15:25.843081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-3358ce20-b1e5-4683-b06d-1b5bde0c0fbc None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:15:25.845091 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3358ce20-b1e5-4683-b06d-1b5bde0c0fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:15:25.903692 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1308/2572] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:15:25.913727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb00d7-3703-44ff-86b6-fca37604726b admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:15:25.915231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-edfb00d7-3703-44ff-86b6-fca37604726b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:15:25.972964 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb00d7-3703-44ff-86b6-fca37604726b admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:15:25.976963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81fad4-e92d-4a85-ae52-df144fbb1c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:15:25.977581 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81fad4-e92d-4a85-ae52-df144fbb1c93 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:15:25.977865 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81fad4-e92d-4a85-ae52-df144fbb1c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:15:25.978137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81fad4-e92d-4a85-ae52-df144fbb1c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:15:25.989514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81fad4-e92d-4a85-ae52-df144fbb1c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:15:25.990946 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81fad4-e92d-4a85-ae52-df144fbb1c93 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:15:26.001071 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1265/2573] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:15:26.359956 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358ce20-b1e5-4683-b06d-1b5bde0c0fbc None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:15:26.361451 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3358ce20-b1e5-4683-b06d-1b5bde0c0fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:15:26.373587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358ce20-b1e5-4683-b06d-1b5bde0c0fbc None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:15:26.379235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392a3ef-ed9a-4455-a3d2-b4c7c6fd9964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:15:26.379886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392a3ef-ed9a-4455-a3d2-b4c7c6fd9964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:15:26.380208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392a3ef-ed9a-4455-a3d2-b4c7c6fd9964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:15:26.380439 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392a3ef-ed9a-4455-a3d2-b4c7c6fd9964 admin admin] PATH_INFO: `/v3/projects/01df91c14fe9484a899245586b63bf52` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:15:26.381735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392a3ef-ed9a-4455-a3d2-b4c7c6fd9964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01df91c14fe9484a899245586b63bf52)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:15:26.383657 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b392a3ef-ed9a-4455-a3d2-b4c7c6fd9964 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:15:26.432544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b392a3ef-ed9a-4455-a3d2-b4c7c6fd9964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01df91c14fe9484a899245586b63bf52', 'request_id': 'req-b392a3ef-ed9a-4455-a3d2-b4c7c6fd9964'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:15:26.439571 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b392a3ef-ed9a-4455-a3d2-b4c7c6fd9964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01df91c14fe9484a899245586b63bf52', 'request_id': 'req-b392a3ef-ed9a-4455-a3d2-b4c7c6fd9964'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:15:26.445431 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b392a3ef-ed9a-4455-a3d2-b4c7c6fd9964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01df91c14fe9484a899245586b63bf52', 'request_id': 'req-b392a3ef-ed9a-4455-a3d2-b4c7c6fd9964'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:15:26.459035 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b392a3ef-ed9a-4455-a3d2-b4c7c6fd9964 admin admin] The token cache is being invalidate because project 01df91c14fe9484a899245586b63bf52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:15:26.459322 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b392a3ef-ed9a-4455-a3d2-b4c7c6fd9964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:15:26.459935 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b392a3ef-ed9a-4455-a3d2-b4c7c6fd9964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:15:26.461486 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1309/2574] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:15:26 2022] DELETE /identity/v3/projects/01df91c14fe9484a899245586b63bf52 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:15:27.361499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe594b4-15f7-4b93-b87b-8a1cbec0003d None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:15:27.362021 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe594b4-15f7-4b93-b87b-8a1cbec0003d None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:15:27.362021 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe594b4-15f7-4b93-b87b-8a1cbec0003d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:15:27.380567 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-4fe594b4-15f7-4b93-b87b-8a1cbec0003d None None] MFA Rules not processed for user `7511e2f8a2c24c92be08dc5056bac4f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:15:27.381749 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4fe594b4-15f7-4b93-b87b-8a1cbec0003d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:15:27.398877 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:15:27.439717 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1266/2575] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:15:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:15:36.455939 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:15:37.433117 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=15 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:15:57.291306 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf1613-46b4-4989-82bb-3fa4485259e2 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:15:57.291887 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf1613-46b4-4989-82bb-3fa4485259e2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:15:57.291887 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf1613-46b4-4989-82bb-3fa4485259e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:15:57.312062 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-decf1613-46b4-4989-82bb-3fa4485259e2 None None] MFA Rules not processed for user `f43a16e2dcab4872963222c557853d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:15:57.313307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-decf1613-46b4-4989-82bb-3fa4485259e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:15:57.373851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1310/2576] 10.222.0.85 () {58 vars in 967 bytes} [Tue Aug 2 10:15:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:15:57.421801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe594b4-15f7-4b93-b87b-8a1cbec0003d None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:15:57.423209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4fe594b4-15f7-4b93-b87b-8a1cbec0003d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:15:57.491935 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe594b4-15f7-4b93-b87b-8a1cbec0003d None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:15:57.496767 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223abfce-0538-427f-b539-6e67b87dd80c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cfed2469a7419f8fcbe09d25cb896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:15:57.497403 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223abfce-0538-427f-b539-6e67b87dd80c service swift] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:15:57.497681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223abfce-0538-427f-b539-6e67b87dd80c service swift] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:15:57.497952 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223abfce-0538-427f-b539-6e67b87dd80c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:15:57.506017 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223abfce-0538-427f-b539-6e67b87dd80c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:15:57.507619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223abfce-0538-427f-b539-6e67b87dd80c service swift] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:15:57.516574 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1267/2577] 10.222.0.85 () {60 vars in 1384 bytes} [Tue Aug 2 10:15:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 10:16:04.345560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf1613-46b4-4989-82bb-3fa4485259e2 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:04.346960 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-decf1613-46b4-4989-82bb-3fa4485259e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:04.419178 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf1613-46b4-4989-82bb-3fa4485259e2 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:04.425411 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059e227-938d-4259-80c9-5ae2404f4601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:04.426125 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059e227-938d-4259-80c9-5ae2404f4601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:04.426393 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059e227-938d-4259-80c9-5ae2404f4601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:04.426635 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059e227-938d-4259-80c9-5ae2404f4601 admin admin] PATH_INFO: `/v3/users/b225a7ff45084cc8b1047b3ef31cc6a9` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:04.427862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059e227-938d-4259-80c9-5ae2404f4601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b225a7ff45084cc8b1047b3ef31cc6a9)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:04.430737 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059e227-938d-4259-80c9-5ae2404f4601 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:04.492548 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5059e227-938d-4259-80c9-5ae2404f4601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b225a7ff45084cc8b1047b3ef31cc6a9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:04.493326 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5059e227-938d-4259-80c9-5ae2404f4601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b225a7ff45084cc8b1047b3ef31cc6a9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:04.501036 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5059e227-938d-4259-80c9-5ae2404f4601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b225a7ff45084cc8b1047b3ef31cc6a9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:04.513928 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5059e227-938d-4259-80c9-5ae2404f4601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b225a7ff45084cc8b1047b3ef31cc6a9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:04.524352 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-5059e227-938d-4259-80c9-5ae2404f4601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b225a7ff45084cc8b1047b3ef31cc6a9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:04.531379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1311/2578] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:16:04 2022] DELETE /identity/v3/users/b225a7ff45084cc8b1047b3ef31cc6a9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:16:04.706897 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223abfce-0538-427f-b539-6e67b87dd80c service swift] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:04.721741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223abfce-0538-427f-b539-6e67b87dd80c service swift] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:04.783233 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37084f-90f1-44d8-9dbb-4415e94c6b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:04.783794 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37084f-90f1-44d8-9dbb-4415e94c6b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:04.784077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37084f-90f1-44d8-9dbb-4415e94c6b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:04.784357 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37084f-90f1-44d8-9dbb-4415e94c6b48 admin admin] PATH_INFO: `/v3/projects/273c1a0c72974d8e985e0756cec4047f` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:04.785536 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37084f-90f1-44d8-9dbb-4415e94c6b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=273c1a0c72974d8e985e0756cec4047f)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:04.787433 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37084f-90f1-44d8-9dbb-4415e94c6b48 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:04.844637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-ba37084f-90f1-44d8-9dbb-4415e94c6b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '273c1a0c72974d8e985e0756cec4047f', 'request_id': 'req-ba37084f-90f1-44d8-9dbb-4415e94c6b48'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:04.844637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-ba37084f-90f1-44d8-9dbb-4415e94c6b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '273c1a0c72974d8e985e0756cec4047f', 'request_id': 'req-ba37084f-90f1-44d8-9dbb-4415e94c6b48'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:04.848617 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-ba37084f-90f1-44d8-9dbb-4415e94c6b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '273c1a0c72974d8e985e0756cec4047f', 'request_id': 'req-ba37084f-90f1-44d8-9dbb-4415e94c6b48'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:04.861811 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-ba37084f-90f1-44d8-9dbb-4415e94c6b48 admin admin] The token cache is being invalidate because project 273c1a0c72974d8e985e0756cec4047f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:16:04.862098 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-ba37084f-90f1-44d8-9dbb-4415e94c6b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:04.862720 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-ba37084f-90f1-44d8-9dbb-4415e94c6b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:04.864506 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1268/2579] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:16:04 2022] DELETE /identity/v3/projects/273c1a0c72974d8e985e0756cec4047f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:16:04.868556 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059e227-938d-4259-80c9-5ae2404f4601 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:04.869982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5059e227-938d-4259-80c9-5ae2404f4601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:04.883431 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059e227-938d-4259-80c9-5ae2404f4601 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:04.904083 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:04.946662 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9bd9b-668a-49f0-a386-c1909416a4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:04.947309 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9bd9b-668a-49f0-a386-c1909416a4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:04.947591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9bd9b-668a-49f0-a386-c1909416a4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:04.947868 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9bd9b-668a-49f0-a386-c1909416a4ac admin admin] PATH_INFO: `/v3/users/5a12f80bd13c49cbac02b9b799117963` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:04.949073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9bd9b-668a-49f0-a386-c1909416a4ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a12f80bd13c49cbac02b9b799117963)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:04.951392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9bd9b-668a-49f0-a386-c1909416a4ac admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:05.000197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dcd9bd9b-668a-49f0-a386-c1909416a4ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a12f80bd13c49cbac02b9b799117963'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:05.000822 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dcd9bd9b-668a-49f0-a386-c1909416a4ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a12f80bd13c49cbac02b9b799117963'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:05.007703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dcd9bd9b-668a-49f0-a386-c1909416a4ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a12f80bd13c49cbac02b9b799117963'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:05.020058 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dcd9bd9b-668a-49f0-a386-c1909416a4ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a12f80bd13c49cbac02b9b799117963'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:05.027322 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-dcd9bd9b-668a-49f0-a386-c1909416a4ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a12f80bd13c49cbac02b9b799117963'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:05.034003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1312/2580] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:16:04 2022] DELETE /identity/v3/users/5a12f80bd13c49cbac02b9b799117963 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:16:05.226084 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37084f-90f1-44d8-9dbb-4415e94c6b48 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:05.227622 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ba37084f-90f1-44d8-9dbb-4415e94c6b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:05.242434 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37084f-90f1-44d8-9dbb-4415e94c6b48 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:05.262119 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:05.305307 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37a1a1-9e17-4c7e-8105-1f7b049927a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:05.306040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37a1a1-9e17-4c7e-8105-1f7b049927a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:05.306261 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37a1a1-9e17-4c7e-8105-1f7b049927a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:05.306538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37a1a1-9e17-4c7e-8105-1f7b049927a5 admin admin] PATH_INFO: `/v3/projects/cb304ad8a18047d984633cdea16bbc43` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:05.307692 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37a1a1-9e17-4c7e-8105-1f7b049927a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb304ad8a18047d984633cdea16bbc43)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:05.309626 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37a1a1-9e17-4c7e-8105-1f7b049927a5 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:05.359592 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-4f37a1a1-9e17-4c7e-8105-1f7b049927a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb304ad8a18047d984633cdea16bbc43', 'request_id': 'req-4f37a1a1-9e17-4c7e-8105-1f7b049927a5'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:05.365410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-4f37a1a1-9e17-4c7e-8105-1f7b049927a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb304ad8a18047d984633cdea16bbc43', 'request_id': 'req-4f37a1a1-9e17-4c7e-8105-1f7b049927a5'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:05.371436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-4f37a1a1-9e17-4c7e-8105-1f7b049927a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb304ad8a18047d984633cdea16bbc43', 'request_id': 'req-4f37a1a1-9e17-4c7e-8105-1f7b049927a5'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:05.383772 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-4f37a1a1-9e17-4c7e-8105-1f7b049927a5 admin admin] The token cache is being invalidate because project cb304ad8a18047d984633cdea16bbc43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:16:05.384055 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-4f37a1a1-9e17-4c7e-8105-1f7b049927a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:05.384710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-4f37a1a1-9e17-4c7e-8105-1f7b049927a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:05.386181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1269/2581] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:16:05 2022] DELETE /identity/v3/projects/cb304ad8a18047d984633cdea16bbc43 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:16:14.086517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9bd9b-668a-49f0-a386-c1909416a4ac admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:14.088282 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dcd9bd9b-668a-49f0-a386-c1909416a4ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:14.165787 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9bd9b-668a-49f0-a386-c1909416a4ac admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:14.228330 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed94f1-f614-48f8-9632-485445ded2db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:14.228994 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed94f1-f614-48f8-9632-485445ded2db service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:14.229274 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed94f1-f614-48f8-9632-485445ded2db service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:14.229549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed94f1-f614-48f8-9632-485445ded2db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:14.232494 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1aed94f1-f614-48f8-9632-485445ded2db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:14.250936 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:14.335139 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed94f1-f614-48f8-9632-485445ded2db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:14.337509 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed94f1-f614-48f8-9632-485445ded2db service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:14.362216 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1313/2582] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:16:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:16:15.380851 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:19.746717 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37a1a1-9e17-4c7e-8105-1f7b049927a5 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:19.748435 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4f37a1a1-9e17-4c7e-8105-1f7b049927a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:19.807414 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37a1a1-9e17-4c7e-8105-1f7b049927a5 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:19.813383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b1bc5-0dbd-4fb6-8a1e-d02497da1945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:19.814379 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b1bc5-0dbd-4fb6-8a1e-d02497da1945 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:19.814709 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b1bc5-0dbd-4fb6-8a1e-d02497da1945 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:19.814985 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b1bc5-0dbd-4fb6-8a1e-d02497da1945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:19.816869 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-d22b1bc5-0dbd-4fb6-8a1e-d02497da1945 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:19.880597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b1bc5-0dbd-4fb6-8a1e-d02497da1945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:19.882140 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b1bc5-0dbd-4fb6-8a1e-d02497da1945 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:19.891405 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1270/2583] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:16:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:16:19.999539 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed94f1-f614-48f8-9632-485445ded2db service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:20.001067 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1aed94f1-f614-48f8-9632-485445ded2db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:20.012227 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed94f1-f614-48f8-9632-485445ded2db service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:20.016640 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5257bb-e236-46f2-a661-e733b974be51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:20.017295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5257bb-e236-46f2-a661-e733b974be51 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:20.017587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5257bb-e236-46f2-a661-e733b974be51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:20.017913 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5257bb-e236-46f2-a661-e733b974be51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:20.020042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6a5257bb-e236-46f2-a661-e733b974be51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:20.099100 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5257bb-e236-46f2-a661-e733b974be51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:20.100577 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5257bb-e236-46f2-a661-e733b974be51 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:20.110524 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1314/2584] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:16:20.155869 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b1bc5-0dbd-4fb6-8a1e-d02497da1945 service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:20.165988 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b1bc5-0dbd-4fb6-8a1e-d02497da1945 service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:20.170073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0907ae6-2e29-401e-bf11-6bbbd86d9b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:20.170670 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0907ae6-2e29-401e-bf11-6bbbd86d9b3d service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:20.170932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0907ae6-2e29-401e-bf11-6bbbd86d9b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:20.171224 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0907ae6-2e29-401e-bf11-6bbbd86d9b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:20.173149 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f0907ae6-2e29-401e-bf11-6bbbd86d9b3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:20.188450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0907ae6-2e29-401e-bf11-6bbbd86d9b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:20.190031 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0907ae6-2e29-401e-bf11-6bbbd86d9b3d service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:20.203288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1271/2585] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:16:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:16:24.092141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5257bb-e236-46f2-a661-e733b974be51 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:24.093838 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6a5257bb-e236-46f2-a661-e733b974be51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:24.111513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5257bb-e236-46f2-a661-e733b974be51 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:24.117554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabea399-74f0-486f-adea-88226db66cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:24.118676 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabea399-74f0-486f-adea-88226db66cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:24.119107 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabea399-74f0-486f-adea-88226db66cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:24.119631 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabea399-74f0-486f-adea-88226db66cf7 admin admin] PATH_INFO: `/v3/users/324d0f6b637647a29580091f3a248cda` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:24.122187 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabea399-74f0-486f-adea-88226db66cf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=324d0f6b637647a29580091f3a248cda)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:24.125427 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabea399-74f0-486f-adea-88226db66cf7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:24.192636 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cabea399-74f0-486f-adea-88226db66cf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '324d0f6b637647a29580091f3a248cda'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:24.193484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cabea399-74f0-486f-adea-88226db66cf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '324d0f6b637647a29580091f3a248cda'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:24.200861 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cabea399-74f0-486f-adea-88226db66cf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '324d0f6b637647a29580091f3a248cda'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:24.215383 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cabea399-74f0-486f-adea-88226db66cf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '324d0f6b637647a29580091f3a248cda'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:24.224229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cabea399-74f0-486f-adea-88226db66cf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '324d0f6b637647a29580091f3a248cda'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:24.230359 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1315/2586] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:16:24 2022] DELETE /identity/v3/users/324d0f6b637647a29580091f3a248cda => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:16:24.401396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0907ae6-2e29-401e-bf11-6bbbd86d9b3d service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:24.412865 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0907ae6-2e29-401e-bf11-6bbbd86d9b3d service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:24.470451 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e955b-be61-477c-836b-d2e1337a26ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:24.471086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e955b-be61-477c-836b-d2e1337a26ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:24.471364 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e955b-be61-477c-836b-d2e1337a26ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:24.471632 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e955b-be61-477c-836b-d2e1337a26ad admin admin] PATH_INFO: `/v3/projects/3de3a9d89f244e328e304d028feab651` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:24.472825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e955b-be61-477c-836b-d2e1337a26ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=3de3a9d89f244e328e304d028feab651)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:24.474743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36e955b-be61-477c-836b-d2e1337a26ad admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:24.518253 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:24.522356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e36e955b-be61-477c-836b-d2e1337a26ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3de3a9d89f244e328e304d028feab651', 'request_id': 'req-e36e955b-be61-477c-836b-d2e1337a26ad'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:24.528197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e36e955b-be61-477c-836b-d2e1337a26ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3de3a9d89f244e328e304d028feab651', 'request_id': 'req-e36e955b-be61-477c-836b-d2e1337a26ad'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:24.534865 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e36e955b-be61-477c-836b-d2e1337a26ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3de3a9d89f244e328e304d028feab651', 'request_id': 'req-e36e955b-be61-477c-836b-d2e1337a26ad'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:24.547565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e36e955b-be61-477c-836b-d2e1337a26ad admin admin] The token cache is being invalidate because project 3de3a9d89f244e328e304d028feab651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:16:24.547874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e36e955b-be61-477c-836b-d2e1337a26ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:24.548525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-e36e955b-be61-477c-836b-d2e1337a26ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:24.550313 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1272/2587] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:16:24 2022] DELETE /identity/v3/projects/3de3a9d89f244e328e304d028feab651 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:16:24.555819 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bde63-6cc8-4fdd-8de1-3bed79a6a281 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:24.556113 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bde63-6cc8-4fdd-8de1-3bed79a6a281 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:24.556422 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475bde63-6cc8-4fdd-8de1-3bed79a6a281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:24.570668 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:24.578973 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-475bde63-6cc8-4fdd-8de1-3bed79a6a281 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:16:24.581149 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-475bde63-6cc8-4fdd-8de1-3bed79a6a281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:24.640567 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1316/2588] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:16:24.648499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0a9a9-c1f5-463a-b851-e0179aedccde None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:24.648786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0a9a9-c1f5-463a-b851-e0179aedccde None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:24.649054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0a9a9-c1f5-463a-b851-e0179aedccde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:24.668645 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-ccc0a9a9-c1f5-463a-b851-e0179aedccde None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:16:24.669858 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ccc0a9a9-c1f5-463a-b851-e0179aedccde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:24.677675 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1273/2589] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:16:24.682181 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bde63-6cc8-4fdd-8de1-3bed79a6a281 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:24.692366 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475bde63-6cc8-4fdd-8de1-3bed79a6a281 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:24.696919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec18137-9408-45af-ad6b-e3955d1fea38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:24.697518 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec18137-9408-45af-ad6b-e3955d1fea38 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:24.697797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec18137-9408-45af-ad6b-e3955d1fea38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:24.698070 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec18137-9408-45af-ad6b-e3955d1fea38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:24.698761 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec18137-9408-45af-ad6b-e3955d1fea38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:16:24.699063 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec18137-9408-45af-ad6b-e3955d1fea38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:24.700682 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec18137-9408-45af-ad6b-e3955d1fea38 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:24.712701 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1317/2590] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:16:24.717794 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0a9a9-c1f5-463a-b851-e0179aedccde None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:24.727171 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0a9a9-c1f5-463a-b851-e0179aedccde None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:24.731825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682e79c-2436-4a3c-870c-ffea446c3850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:24.732489 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682e79c-2436-4a3c-870c-ffea446c3850 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:24.732775 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682e79c-2436-4a3c-870c-ffea446c3850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:24.733051 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d682e79c-2436-4a3c-870c-ffea446c3850 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:24.733714 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682e79c-2436-4a3c-870c-ffea446c3850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:24.735600 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d682e79c-2436-4a3c-870c-ffea446c3850 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:24.762421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1274/2591] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:16:24 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:16:24.767213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec18137-9408-45af-ad6b-e3955d1fea38 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:24.777227 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec18137-9408-45af-ad6b-e3955d1fea38 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:24.835285 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad18118-ad4a-400c-b03d-9b6d3dbea390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:24.835813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad18118-ad4a-400c-b03d-9b6d3dbea390 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:24.836097 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad18118-ad4a-400c-b03d-9b6d3dbea390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:24.836374 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad18118-ad4a-400c-b03d-9b6d3dbea390 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:24.837081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad18118-ad4a-400c-b03d-9b6d3dbea390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:24.838990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad18118-ad4a-400c-b03d-9b6d3dbea390 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:24.860576 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1318/2592] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:16:24 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:16:24.864996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682e79c-2436-4a3c-870c-ffea446c3850 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:24.876397 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d682e79c-2436-4a3c-870c-ffea446c3850 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:24.881051 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70189bc-6fe5-4257-8b48-2a4a80e0dc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:24.881651 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70189bc-6fe5-4257-8b48-2a4a80e0dc68 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:24.881934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70189bc-6fe5-4257-8b48-2a4a80e0dc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:24.882205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70189bc-6fe5-4257-8b48-2a4a80e0dc68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:24.882898 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70189bc-6fe5-4257-8b48-2a4a80e0dc68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:24.884500 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70189bc-6fe5-4257-8b48-2a4a80e0dc68 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:24.895146 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1275/2593] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:16:24.899223 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad18118-ad4a-400c-b03d-9b6d3dbea390 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:24.909421 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad18118-ad4a-400c-b03d-9b6d3dbea390 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:24.914065 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d040797-274c-4b0d-a712-273b26a01a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:24.914666 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d040797-274c-4b0d-a712-273b26a01a21 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:24.914946 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d040797-274c-4b0d-a712-273b26a01a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:24.915216 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d040797-274c-4b0d-a712-273b26a01a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:24.915905 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d040797-274c-4b0d-a712-273b26a01a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:24.917510 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d040797-274c-4b0d-a712-273b26a01a21 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:24.927776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1319/2594] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:16:24.931892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70189bc-6fe5-4257-8b48-2a4a80e0dc68 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:24.942336 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70189bc-6fe5-4257-8b48-2a4a80e0dc68 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:24.946906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681e8bd-6ab8-4e2c-913e-d88f31f202dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:24.947559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681e8bd-6ab8-4e2c-913e-d88f31f202dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:24.947928 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681e8bd-6ab8-4e2c-913e-d88f31f202dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:24.948117 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a681e8bd-6ab8-4e2c-913e-d88f31f202dd admin admin] PATH_INFO: `/v3/projects/dae6fcf9825743ffad8b042e5c4d55ed/users/163e87443807427695fa90bd14f3ebf1/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:24.963399 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681e8bd-6ab8-4e2c-913e-d88f31f202dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae6fcf9825743ffad8b042e5c4d55ed, user_id=163e87443807427695fa90bd14f3ebf1, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:24.966071 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a681e8bd-6ab8-4e2c-913e-d88f31f202dd admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:24.980538 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1276/2595] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:16:24 2022] PUT /identity/v3/projects/dae6fcf9825743ffad8b042e5c4d55ed/users/163e87443807427695fa90bd14f3ebf1/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:16:24.986592 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4633b9-aad0-428c-b46c-bf6276a65259 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:24.987012 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4633b9-aad0-428c-b46c-bf6276a65259 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:24.987397 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4633b9-aad0-428c-b46c-bf6276a65259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:25.009011 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ff4633b9-aad0-428c-b46c-bf6276a65259 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:16:25.010423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ff4633b9-aad0-428c-b46c-bf6276a65259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:25.072995 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1320/2596] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:16:25.082913 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681e8bd-6ab8-4e2c-913e-d88f31f202dd admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:25.084879 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a681e8bd-6ab8-4e2c-913e-d88f31f202dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:25.146189 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a681e8bd-6ab8-4e2c-913e-d88f31f202dd admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:25.149947 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf90f7-4a24-4036-8974-b81a9325d7b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:25.150642 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf90f7-4a24-4036-8974-b81a9325d7b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:25.150900 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf90f7-4a24-4036-8974-b81a9325d7b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:25.151174 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf90f7-4a24-4036-8974-b81a9325d7b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:25.161909 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf90f7-4a24-4036-8974-b81a9325d7b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:25.163338 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf90f7-4a24-4036-8974-b81a9325d7b2 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:25.173824 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1277/2597] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:16:29.729140 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d7a8d-32ab-47bb-a5af-d9b9111f4d9b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:29.730081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d7a8d-32ab-47bb-a5af-d9b9111f4d9b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:29.730572 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d7a8d-32ab-47bb-a5af-d9b9111f4d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:29.789169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:29.800099 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-eb6d7a8d-32ab-47bb-a5af-d9b9111f4d9b None None] MFA Rules not processed for user `163e87443807427695fa90bd14f3ebf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:16:29.802160 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-eb6d7a8d-32ab-47bb-a5af-d9b9111f4d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:29.924821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1321/2598] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:16:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:16:29.941365 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf90f7-4a24-4036-8974-b81a9325d7b2 service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:29.943604 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-9ecf90f7-4a24-4036-8974-b81a9325d7b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:30.087864 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf90f7-4a24-4036-8974-b81a9325d7b2 service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:30.096282 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0e03c-b2a5-41b0-ad22-4f5db0131d2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:30.097603 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0e03c-b2a5-41b0-ad22-4f5db0131d2e service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:30.098162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0e03c-b2a5-41b0-ad22-4f5db0131d2e service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:30.098503 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0e03c-b2a5-41b0-ad22-4f5db0131d2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:30.109973 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:30.114302 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0e03c-b2a5-41b0-ad22-4f5db0131d2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:30.115973 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0e03c-b2a5-41b0-ad22-4f5db0131d2e service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:30.140217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1278/2599] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:16:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:16:32.285401 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e9616-5c23-4369-8a6c-0a7de6c54ba4 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:32.285872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e9616-5c23-4369-8a6c-0a7de6c54ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:32.286277 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e9616-5c23-4369-8a6c-0a7de6c54ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:32.322583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e29e9616-5c23-4369-8a6c-0a7de6c54ba4 None None] MFA Rules not processed for user `163e87443807427695fa90bd14f3ebf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:16:32.324660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e29e9616-5c23-4369-8a6c-0a7de6c54ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:32.333513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1322/2600] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:16:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:16:33.118221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0e03c-b2a5-41b0-ad22-4f5db0131d2e service nova] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:33.120498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-27f0e03c-b2a5-41b0-ad22-4f5db0131d2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:33.139198 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0e03c-b2a5-41b0-ad22-4f5db0131d2e service nova] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:33.146567 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9835b0b-d930-4337-a28a-c1b2eaf87dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:33.147612 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9835b0b-d930-4337-a28a-c1b2eaf87dea service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:33.148106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9835b0b-d930-4337-a28a-c1b2eaf87dea service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:33.148681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9835b0b-d930-4337-a28a-c1b2eaf87dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:33.151011 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f9835b0b-d930-4337-a28a-c1b2eaf87dea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:33.175685 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9835b0b-d930-4337-a28a-c1b2eaf87dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:33.177453 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9835b0b-d930-4337-a28a-c1b2eaf87dea service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:33.192650 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1279/2601] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:16:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:16:33.670389 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e9616-5c23-4369-8a6c-0a7de6c54ba4 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:33.672598 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e29e9616-5c23-4369-8a6c-0a7de6c54ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:33.781987 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e9616-5c23-4369-8a6c-0a7de6c54ba4 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:33.789734 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cce4f3-4a24-4a98-8d48-7236edefc064 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2a420cc676e4f2bb2766826a1de3b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:33.791156 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cce4f3-4a24-4a98-8d48-7236edefc064 service placement] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:33.792225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cce4f3-4a24-4a98-8d48-7236edefc064 service placement] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:33.792528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cce4f3-4a24-4a98-8d48-7236edefc064 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:33.796626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-06cce4f3-4a24-4a98-8d48-7236edefc064 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:33.817070 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cce4f3-4a24-4a98-8d48-7236edefc064 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:33.819417 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cce4f3-4a24-4a98-8d48-7236edefc064 service placement] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:33.834854 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9835b0b-d930-4337-a28a-c1b2eaf87dea service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:33.836518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f9835b0b-d930-4337-a28a-c1b2eaf87dea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:33.840280 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1323/2602] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:16:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:16:33.862295 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9835b0b-d930-4337-a28a-c1b2eaf87dea service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:33.882297 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0319b-5af8-49ac-8efb-9cf186455c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:33.883528 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0319b-5af8-49ac-8efb-9cf186455c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:33.886761 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0319b-5af8-49ac-8efb-9cf186455c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:33.887407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0319b-5af8-49ac-8efb-9cf186455c57 admin admin] PATH_INFO: `/v3/users/7511e2f8a2c24c92be08dc5056bac4f4` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:33.892403 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0319b-5af8-49ac-8efb-9cf186455c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7511e2f8a2c24c92be08dc5056bac4f4)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:33.899712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0319b-5af8-49ac-8efb-9cf186455c57 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:34.020741 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c3f0319b-5af8-49ac-8efb-9cf186455c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7511e2f8a2c24c92be08dc5056bac4f4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:34.025426 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c3f0319b-5af8-49ac-8efb-9cf186455c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7511e2f8a2c24c92be08dc5056bac4f4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:34.046547 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c3f0319b-5af8-49ac-8efb-9cf186455c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7511e2f8a2c24c92be08dc5056bac4f4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:34.058816 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c3f0319b-5af8-49ac-8efb-9cf186455c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7511e2f8a2c24c92be08dc5056bac4f4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:34.061757 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-c3f0319b-5af8-49ac-8efb-9cf186455c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7511e2f8a2c24c92be08dc5056bac4f4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:34.084378 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1280/2603] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:16:33 2022] DELETE /identity/v3/users/7511e2f8a2c24c92be08dc5056bac4f4 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:16:34.339444 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cce4f3-4a24-4a98-8d48-7236edefc064 service placement] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:34.374563 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cce4f3-4a24-4a98-8d48-7236edefc064 service placement] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:34.464864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f8299-98ed-4d40-9ed8-5445c8f42505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:34.465745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f8299-98ed-4d40-9ed8-5445c8f42505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:34.467461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f8299-98ed-4d40-9ed8-5445c8f42505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:34.467816 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f8299-98ed-4d40-9ed8-5445c8f42505 admin admin] PATH_INFO: `/v3/projects/c93b7cf72a1546e4a83974777e864ee8` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:34.469718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f8299-98ed-4d40-9ed8-5445c8f42505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c93b7cf72a1546e4a83974777e864ee8)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:34.474754 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f8299-98ed-4d40-9ed8-5445c8f42505 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:34.538595 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:34.602829 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b33f8299-98ed-4d40-9ed8-5445c8f42505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c93b7cf72a1546e4a83974777e864ee8', 'request_id': 'req-b33f8299-98ed-4d40-9ed8-5445c8f42505'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:34.644586 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b33f8299-98ed-4d40-9ed8-5445c8f42505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c93b7cf72a1546e4a83974777e864ee8', 'request_id': 'req-b33f8299-98ed-4d40-9ed8-5445c8f42505'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:34.669663 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b33f8299-98ed-4d40-9ed8-5445c8f42505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c93b7cf72a1546e4a83974777e864ee8', 'request_id': 'req-b33f8299-98ed-4d40-9ed8-5445c8f42505'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:34.703719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b33f8299-98ed-4d40-9ed8-5445c8f42505 admin admin] The token cache is being invalidate because project c93b7cf72a1546e4a83974777e864ee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:16:34.704758 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b33f8299-98ed-4d40-9ed8-5445c8f42505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:34.705241 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-b33f8299-98ed-4d40-9ed8-5445c8f42505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:16:34.714671 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1324/2604] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:16:34 2022] DELETE /identity/v3/projects/c93b7cf72a1546e4a83974777e864ee8 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:16:34.717743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39b3fa-773a-4335-aa4f-6fb9a2431b71 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:34.718168 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39b3fa-773a-4335-aa4f-6fb9a2431b71 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:34.718168 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39b3fa-773a-4335-aa4f-6fb9a2431b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:34.755953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-fb39b3fa-773a-4335-aa4f-6fb9a2431b71 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:16:34.759283 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-fb39b3fa-773a-4335-aa4f-6fb9a2431b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:34.961362 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1281/2605] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:16:34.972101 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e97a8d-217a-4e17-a823-c1ff4540f2a7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:34.972628 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e97a8d-217a-4e17-a823-c1ff4540f2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:34.973163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e97a8d-217a-4e17-a823-c1ff4540f2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:35.003754 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f5e97a8d-217a-4e17-a823-c1ff4540f2a7 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:16:35.005009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f5e97a8d-217a-4e17-a823-c1ff4540f2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:35.014260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1325/2606] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:16:35.018659 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39b3fa-773a-4335-aa4f-6fb9a2431b71 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:35.028929 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39b3fa-773a-4335-aa4f-6fb9a2431b71 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:35.034169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2fcd1-e3e4-4f0a-bfb7-025580b2d6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:35.034797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2fcd1-e3e4-4f0a-bfb7-025580b2d6cc admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:35.035077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2fcd1-e3e4-4f0a-bfb7-025580b2d6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:35.035350 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2fcd1-e3e4-4f0a-bfb7-025580b2d6cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:35.036071 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2fcd1-e3e4-4f0a-bfb7-025580b2d6cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:16:35.036378 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2fcd1-e3e4-4f0a-bfb7-025580b2d6cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:35.038081 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e2fcd1-e3e4-4f0a-bfb7-025580b2d6cc admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:35.055087 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1282/2607] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 10:16:35.056314 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e97a8d-217a-4e17-a823-c1ff4540f2a7 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:35.066338 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e97a8d-217a-4e17-a823-c1ff4540f2a7 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:35.072998 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3632bfd-237e-497c-aab0-98cc118d86cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:35.074003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3632bfd-237e-497c-aab0-98cc118d86cb admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:35.074964 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3632bfd-237e-497c-aab0-98cc118d86cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:35.075982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3632bfd-237e-497c-aab0-98cc118d86cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:35.077559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3632bfd-237e-497c-aab0-98cc118d86cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:35.080964 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3632bfd-237e-497c-aab0-98cc118d86cb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:35.121329 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1326/2608] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:16:35 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:16:35.126077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2fcd1-e3e4-4f0a-bfb7-025580b2d6cc admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:35.137444 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e2fcd1-e3e4-4f0a-bfb7-025580b2d6cc admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:35.192782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:35.221453 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47fed8-8744-485b-8866-98589ef04597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:35.222397 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47fed8-8744-485b-8866-98589ef04597 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:35.222677 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47fed8-8744-485b-8866-98589ef04597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:35.223940 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47fed8-8744-485b-8866-98589ef04597 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:35.224990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47fed8-8744-485b-8866-98589ef04597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:35.227583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47fed8-8744-485b-8866-98589ef04597 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:35.280524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1283/2609] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:16:35 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:16:35.285705 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3632bfd-237e-497c-aab0-98cc118d86cb admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:35.308993 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3632bfd-237e-497c-aab0-98cc118d86cb admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:35.323603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e7063-073d-4d6e-91c5-6cb25ffe4352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:35.324231 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e7063-073d-4d6e-91c5-6cb25ffe4352 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:35.324712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e7063-073d-4d6e-91c5-6cb25ffe4352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:35.325008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e7063-073d-4d6e-91c5-6cb25ffe4352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:35.326250 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e7063-073d-4d6e-91c5-6cb25ffe4352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:35.327856 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193e7063-073d-4d6e-91c5-6cb25ffe4352 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:35.348052 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1327/2610] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:16:35.354188 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47fed8-8744-485b-8866-98589ef04597 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:35.371552 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47fed8-8744-485b-8866-98589ef04597 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:35.377673 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2435b448-fb98-46c3-85ff-13c7d936a6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:35.378309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435b448-fb98-46c3-85ff-13c7d936a6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:35.378647 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435b448-fb98-46c3-85ff-13c7d936a6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:35.378929 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2435b448-fb98-46c3-85ff-13c7d936a6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:35.379641 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435b448-fb98-46c3-85ff-13c7d936a6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:35.382089 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2435b448-fb98-46c3-85ff-13c7d936a6a5 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:35.408499 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1284/2611] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:16:35.411357 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e7063-073d-4d6e-91c5-6cb25ffe4352 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:35.427550 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193e7063-073d-4d6e-91c5-6cb25ffe4352 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:35.438464 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070269e-3a70-4e0e-9127-0af21ac6ef99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:35.439548 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070269e-3a70-4e0e-9127-0af21ac6ef99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:35.439979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070269e-3a70-4e0e-9127-0af21ac6ef99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:35.440417 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070269e-3a70-4e0e-9127-0af21ac6ef99 admin admin] PATH_INFO: `/v3/projects/f17e00394b974b66ae84688b0ed9de67/users/4b6f36b8484440ccbb4f703884717bd4/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:35.464653 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070269e-3a70-4e0e-9127-0af21ac6ef99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17e00394b974b66ae84688b0ed9de67, user_id=4b6f36b8484440ccbb4f703884717bd4, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:35.471390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070269e-3a70-4e0e-9127-0af21ac6ef99 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:35.490548 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1328/2612] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:16:35 2022] PUT /identity/v3/projects/f17e00394b974b66ae84688b0ed9de67/users/4b6f36b8484440ccbb4f703884717bd4/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:16:35.497969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357f468-7383-48d7-b20c-1e3312c70020 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:35.498429 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357f468-7383-48d7-b20c-1e3312c70020 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:35.498871 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357f468-7383-48d7-b20c-1e3312c70020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:35.519712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-4357f468-7383-48d7-b20c-1e3312c70020 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:16:35.521017 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4357f468-7383-48d7-b20c-1e3312c70020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:35.582782 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1285/2613] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:16:35.593406 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070269e-3a70-4e0e-9127-0af21ac6ef99 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:35.595172 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-3070269e-3a70-4e0e-9127-0af21ac6ef99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:35.661839 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070269e-3a70-4e0e-9127-0af21ac6ef99 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:35.666077 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa1ae9-57de-4d79-bb57-81f90170ae17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:35.666799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa1ae9-57de-4d79-bb57-81f90170ae17 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:35.667181 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa1ae9-57de-4d79-bb57-81f90170ae17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:35.667536 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa1ae9-57de-4d79-bb57-81f90170ae17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:35.679723 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa1ae9-57de-4d79-bb57-81f90170ae17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:35.681416 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa1ae9-57de-4d79-bb57-81f90170ae17 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:35.693757 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1329/2614] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:16:37.001381 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357f468-7383-48d7-b20c-1e3312c70020 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:37.003127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4357f468-7383-48d7-b20c-1e3312c70020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:37.025036 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357f468-7383-48d7-b20c-1e3312c70020 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:37.040679 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b75884-4a33-44c6-8ff2-11e8d8dfda86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:37.041326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b75884-4a33-44c6-8ff2-11e8d8dfda86 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:37.041607 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b75884-4a33-44c6-8ff2-11e8d8dfda86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:37.041878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b75884-4a33-44c6-8ff2-11e8d8dfda86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:37.043773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f3b75884-4a33-44c6-8ff2-11e8d8dfda86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:37.065916 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b75884-4a33-44c6-8ff2-11e8d8dfda86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:37.067368 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b75884-4a33-44c6-8ff2-11e8d8dfda86 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:37.088548 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1286/2615] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:16:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:16:37.103400 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa1ae9-57de-4d79-bb57-81f90170ae17 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:37.113918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa1ae9-57de-4d79-bb57-81f90170ae17 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:37.130051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368f6de-caea-495e-9b77-adeabd053408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:37.130849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368f6de-caea-495e-9b77-adeabd053408 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:37.131200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368f6de-caea-495e-9b77-adeabd053408 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:37.131496 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368f6de-caea-495e-9b77-adeabd053408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:37.137252 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a368f6de-caea-495e-9b77-adeabd053408 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:37.162365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368f6de-caea-495e-9b77-adeabd053408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:37.166258 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368f6de-caea-495e-9b77-adeabd053408 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:37.194317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1330/2616] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:16:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:16:37.348951 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c77fa-88ce-4e1b-ae3d-2e581bc40226 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:37.349816 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c77fa-88ce-4e1b-ae3d-2e581bc40226 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:37.350278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c77fa-88ce-4e1b-ae3d-2e581bc40226 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:37.352120 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1287/2617] 10.222.0.85 () {54 vars in 921 bytes} [Tue Aug 2 10:16:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:16:37.363874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25739d56-0615-4a1a-8e3d-75f718f5271b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:37.364933 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25739d56-0615-4a1a-8e3d-75f718f5271b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:37.365630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25739d56-0615-4a1a-8e3d-75f718f5271b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:37.417049 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-25739d56-0615-4a1a-8e3d-75f718f5271b None None] MFA Rules not processed for user `828eb58cdce44ca8827f1ce2be7c19d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:16:37.418700 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-25739d56-0615-4a1a-8e3d-75f718f5271b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:37.440192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1331/2618] 10.222.0.85 () {58 vars in 1018 bytes} [Tue Aug 2 10:16:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:16:37.464043 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c77fa-88ce-4e1b-ae3d-2e581bc40226 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:37.482954 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c77fa-88ce-4e1b-ae3d-2e581bc40226 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:37.490563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cfc1d-61e9-4f85-9491-ff8d95f024d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:37.491183 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cfc1d-61e9-4f85-9491-ff8d95f024d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:37.491467 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cfc1d-61e9-4f85-9491-ff8d95f024d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:37.491902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cfc1d-61e9-4f85-9491-ff8d95f024d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:37.502701 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cfc1d-61e9-4f85-9491-ff8d95f024d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:37.504280 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cfc1d-61e9-4f85-9491-ff8d95f024d9 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:37.519738 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1288/2619] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:16:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:16:37.707733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9e40f-fcf6-4bab-bc3f-47fb25907121 None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:37.708018 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9e40f-fcf6-4bab-bc3f-47fb25907121 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:37.708290 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9e40f-fcf6-4bab-bc3f-47fb25907121 None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:37.709972 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1332/2620] 10.222.0.85 () {54 vars in 921 bytes} [Tue Aug 2 10:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:16:37.717106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36354e-d50d-4249-ae7d-320916451953 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:37.717664 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36354e-d50d-4249-ae7d-320916451953 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:37.718131 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36354e-d50d-4249-ae7d-320916451953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:37.754070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-ff36354e-d50d-4249-ae7d-320916451953 None None] MFA Rules not processed for user `310867deefd34a598cfef2f3e4245ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:16:37.755199 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ff36354e-d50d-4249-ae7d-320916451953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:37.886393 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1289/2621] 10.222.0.85 () {58 vars in 1018 bytes} [Tue Aug 2 10:16:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:16:37.904096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9e40f-fcf6-4bab-bc3f-47fb25907121 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:37.922089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9e40f-fcf6-4bab-bc3f-47fb25907121 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:37.926845 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d3556-a6a4-4aff-93ed-6878380ce944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:37.928705 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d3556-a6a4-4aff-93ed-6878380ce944 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:37.929274 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d3556-a6a4-4aff-93ed-6878380ce944 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:37.929781 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d3556-a6a4-4aff-93ed-6878380ce944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:37.949255 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d3556-a6a4-4aff-93ed-6878380ce944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:37.951278 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90d3556-a6a4-4aff-93ed-6878380ce944 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:37.968577 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1333/2622] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:16:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:16:42.302014 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f30f5-7fe1-4e96-875b-3e041337cbd8 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:42.302408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f30f5-7fe1-4e96-875b-3e041337cbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:42.302630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f30f5-7fe1-4e96-875b-3e041337cbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:42.332283 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-764f30f5-7fe1-4e96-875b-3e041337cbd8 None None] MFA Rules not processed for user `4b6f36b8484440ccbb4f703884717bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:16:42.333586 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-764f30f5-7fe1-4e96-875b-3e041337cbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:42.348159 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:42.409660 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1290/2623] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:16:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:16:42.424489 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d3556-a6a4-4aff-93ed-6878380ce944 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:42.426004 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e90d3556-a6a4-4aff-93ed-6878380ce944 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:42.441607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d3556-a6a4-4aff-93ed-6878380ce944 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:42.447277 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bcb09-8941-48a7-8898-29f58a25fc19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:42.447962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bcb09-8941-48a7-8898-29f58a25fc19 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:42.448309 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bcb09-8941-48a7-8898-29f58a25fc19 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:42.448649 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bcb09-8941-48a7-8898-29f58a25fc19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:42.457921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bcb09-8941-48a7-8898-29f58a25fc19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:42.459665 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bcb09-8941-48a7-8898-29f58a25fc19 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:42.470083 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1334/2624] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:16:42 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:16:43.977163 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994054f-7c62-498e-8090-51a6a7f9cc75 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:43.977662 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994054f-7c62-498e-8090-51a6a7f9cc75 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:43.977780 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994054f-7c62-498e-8090-51a6a7f9cc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:44.005288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-4994054f-7c62-498e-8090-51a6a7f9cc75 None None] MFA Rules not processed for user `4b6f36b8484440ccbb4f703884717bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:16:44.006513 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4994054f-7c62-498e-8090-51a6a7f9cc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:44.027464 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1291/2625] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:16:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:16:47.567237 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bcb09-8941-48a7-8898-29f58a25fc19 service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:47.582922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bcb09-8941-48a7-8898-29f58a25fc19 service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:47.589147 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8d589-1945-4a4a-8073-3de7d278e477 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:47.594492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8d589-1945-4a4a-8073-3de7d278e477 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:47.595560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8d589-1945-4a4a-8073-3de7d278e477 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:47.595864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8d589-1945-4a4a-8073-3de7d278e477 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:47.598420 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-78d8d589-1945-4a4a-8073-3de7d278e477 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:47.612771 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:16:47.625307 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8d589-1945-4a4a-8073-3de7d278e477 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:47.627703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8d589-1945-4a4a-8073-3de7d278e477 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:47.645040 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1335/2626] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:16:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:16:53.006117 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994054f-7c62-498e-8090-51a6a7f9cc75 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:16:53.007524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4994054f-7c62-498e-8090-51a6a7f9cc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:53.025120 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994054f-7c62-498e-8090-51a6a7f9cc75 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:16:53.031742 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d35c4-8496-4f7c-b67e-a9b49a1ae613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:16:53.032491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d35c4-8496-4f7c-b67e-a9b49a1ae613 service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:16:53.032784 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d35c4-8496-4f7c-b67e-a9b49a1ae613 service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:16:53.033080 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d35c4-8496-4f7c-b67e-a9b49a1ae613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:16:53.034951 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ec6d35c4-8496-4f7c-b67e-a9b49a1ae613 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:16:53.052204 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d35c4-8496-4f7c-b67e-a9b49a1ae613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:16:53.054715 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d35c4-8496-4f7c-b67e-a9b49a1ae613 service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:16:53.068553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1292/2627] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:16:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:16:57.639351 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:17:03.063575 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=29 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:17:27.688810 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6dd9e-739a-4825-a287-63b78de5eed8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:17:27.689350 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6dd9e-739a-4825-a287-63b78de5eed8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:17:27.689350 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6dd9e-739a-4825-a287-63b78de5eed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:17:27.709033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-a2f6dd9e-739a-4825-a287-63b78de5eed8 None None] MFA Rules not processed for user `163e87443807427695fa90bd14f3ebf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:17:27.710246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a2f6dd9e-739a-4825-a287-63b78de5eed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:17:27.767532 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1336/2628] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:17:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:17:37.760705 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=25 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:17:48.107054 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bf720-b911-4b61-ada9-8998277b3df6 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:17:48.107561 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bf720-b911-4b61-ada9-8998277b3df6 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:17:48.107669 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bf720-b911-4b61-ada9-8998277b3df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:17:48.127352 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-820bf720-b911-4b61-ada9-8998277b3df6 None None] MFA Rules not processed for user `f43a16e2dcab4872963222c557853d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:17:48.128585 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-820bf720-b911-4b61-ada9-8998277b3df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:17:48.184685 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1293/2629] 10.222.0.85 () {58 vars in 1009 bytes} [Tue Aug 2 10:17:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:17:48.235431 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6dd9e-739a-4825-a287-63b78de5eed8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:17:48.237386 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-a2f6dd9e-739a-4825-a287-63b78de5eed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:17:48.331192 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6dd9e-739a-4825-a287-63b78de5eed8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:17:48.336230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76992b6-3b54-41b7-999c-d33ed661d75e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cfed2469a7419f8fcbe09d25cb896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:17:48.336870 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76992b6-3b54-41b7-999c-d33ed661d75e service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:17:48.337154 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76992b6-3b54-41b7-999c-d33ed661d75e service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:17:48.338030 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76992b6-3b54-41b7-999c-d33ed661d75e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:17:48.346341 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76992b6-3b54-41b7-999c-d33ed661d75e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:17:48.347921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76992b6-3b54-41b7-999c-d33ed661d75e service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:17:48.356153 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1337/2630] 10.222.0.85 () {60 vars in 1384 bytes} [Tue Aug 2 10:17:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 10:17:58.177883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=25 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:17:58.353479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=32 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:01.003120 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115aab5f-d6e9-4ebb-97ae-6ca3fd15583e None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:01.003702 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115aab5f-d6e9-4ebb-97ae-6ca3fd15583e None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:01.003840 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115aab5f-d6e9-4ebb-97ae-6ca3fd15583e None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:01.005292 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1294/2631] 10.222.0.85 () {54 vars in 921 bytes} [Tue Aug 2 10:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:18:01.011872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e0ecd-943f-491d-abcc-4afc7c4a9e06 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:01.012383 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e0ecd-943f-491d-abcc-4afc7c4a9e06 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:01.012528 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e0ecd-943f-491d-abcc-4afc7c4a9e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:01.033419 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-063e0ecd-943f-491d-abcc-4afc7c4a9e06 None None] MFA Rules not processed for user `310867deefd34a598cfef2f3e4245ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:18:01.034652 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-063e0ecd-943f-491d-abcc-4afc7c4a9e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:18:01.044881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1338/2632] 10.222.0.85 () {58 vars in 1018 bytes} [Tue Aug 2 10:18:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:18:01.057019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115aab5f-d6e9-4ebb-97ae-6ca3fd15583e None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:18:01.058870 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-115aab5f-d6e9-4ebb-97ae-6ca3fd15583e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:18:01.127212 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115aab5f-d6e9-4ebb-97ae-6ca3fd15583e None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:18:01.131290 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d15a5-16b4-43a6-88ec-2f7c69fd22a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0af63c36df2c4ceaa2df4d3ac59542bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:18:01.131934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d15a5-16b4-43a6-88ec-2f7c69fd22a4 service glance] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:01.132190 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d15a5-16b4-43a6-88ec-2f7c69fd22a4 service glance] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:01.132482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d15a5-16b4-43a6-88ec-2f7c69fd22a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:01.144211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d15a5-16b4-43a6-88ec-2f7c69fd22a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:18:01.145705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d15a5-16b4-43a6-88ec-2f7c69fd22a4 service glance] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:18:01.156971 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1295/2633] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:18:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:18:01.229921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e7235-e00e-48a9-b189-1a7284540fad None None] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:01.230207 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e7235-e00e-48a9-b189-1a7284540fad None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:01.230481 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e7235-e00e-48a9-b189-1a7284540fad None None] PATH_INFO: `/` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:01.231844 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1339/2634] 10.222.0.85 () {54 vars in 921 bytes} [Tue Aug 2 10:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:18:01.237114 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da059578-3732-4cd2-b519-cf50d757324f None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:01.237398 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da059578-3732-4cd2-b519-cf50d757324f None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:01.237672 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da059578-3732-4cd2-b519-cf50d757324f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:01.257718 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-da059578-3732-4cd2-b519-cf50d757324f None None] MFA Rules not processed for user `828eb58cdce44ca8827f1ce2be7c19d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:18:01.258956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-da059578-3732-4cd2-b519-cf50d757324f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:18:01.266470 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1296/2635] 10.222.0.85 () {58 vars in 1018 bytes} [Tue Aug 2 10:18:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:18:01.279389 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e7235-e00e-48a9-b189-1a7284540fad None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:18:01.291708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e7235-e00e-48a9-b189-1a7284540fad None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:18:01.295790 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e0e57-524a-42a2-8bd0-8e20ae476fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:18:01.296652 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e0e57-524a-42a2-8bd0-8e20ae476fdd service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:01.297133 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e0e57-524a-42a2-8bd0-8e20ae476fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:01.297581 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e0e57-524a-42a2-8bd0-8e20ae476fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:01.305865 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e0e57-524a-42a2-8bd0-8e20ae476fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:18:01.307475 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e0e57-524a-42a2-8bd0-8e20ae476fdd service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:18:01.315797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1340/2636] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:18:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:18:01.410071 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4420c2-6070-4872-b475-ab4e2550b266 None None] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:01.410432 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4420c2-6070-4872-b475-ab4e2550b266 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:01.410796 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4420c2-6070-4872-b475-ab4e2550b266 None None] PATH_INFO: `/` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:01.412557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1297/2637] 10.222.0.85 () {54 vars in 921 bytes} [Tue Aug 2 10:18:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 10:18:01.419222 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6aed0-99a2-4a23-ad21-0856bd323969 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:01.419830 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6aed0-99a2-4a23-ad21-0856bd323969 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:01.420414 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6aed0-99a2-4a23-ad21-0856bd323969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:01.454437 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-52e6aed0-99a2-4a23-ad21-0856bd323969 None None] MFA Rules not processed for user `310867deefd34a598cfef2f3e4245ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:18:01.456501 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-52e6aed0-99a2-4a23-ad21-0856bd323969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:18:01.468956 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1341/2638] 10.222.0.85 () {58 vars in 1018 bytes} [Tue Aug 2 10:18:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:18:01.480228 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4420c2-6070-4872-b475-ab4e2550b266 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:18:01.491553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4420c2-6070-4872-b475-ab4e2550b266 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:18:01.495959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0bd8e-1ed6-4752-9d83-98ee8b6afcaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:18:01.496608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0bd8e-1ed6-4752-9d83-98ee8b6afcaf service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:01.496891 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0bd8e-1ed6-4752-9d83-98ee8b6afcaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:01.497166 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0bd8e-1ed6-4752-9d83-98ee8b6afcaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:01.517415 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0bd8e-1ed6-4752-9d83-98ee8b6afcaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:18:01.518781 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0bd8e-1ed6-4752-9d83-98ee8b6afcaf service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:18:01.531070 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1298/2639] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:18:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:18:03.467336 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8bff5-1c24-4efe-ac4c-3e1aeacae108 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:03.467861 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8bff5-1c24-4efe-ac4c-3e1aeacae108 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:03.468125 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8bff5-1c24-4efe-ac4c-3e1aeacae108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:03.488946 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-56a8bff5-1c24-4efe-ac4c-3e1aeacae108 None None] MFA Rules not processed for user `f43a16e2dcab4872963222c557853d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:18:03.490313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-56a8bff5-1c24-4efe-ac4c-3e1aeacae108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:18:03.498559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1342/2640] 10.222.0.85 () {58 vars in 1009 bytes} [Tue Aug 2 10:18:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:18:03.511712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0bd8e-1ed6-4752-9d83-98ee8b6afcaf service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:18:03.523838 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0bd8e-1ed6-4752-9d83-98ee8b6afcaf service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:18:03.529142 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4654b0-1d58-409f-b610-1fb74693d715 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cfed2469a7419f8fcbe09d25cb896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:18:03.529915 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4654b0-1d58-409f-b610-1fb74693d715 service swift] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:03.530196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4654b0-1d58-409f-b610-1fb74693d715 service swift] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:03.530468 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4654b0-1d58-409f-b610-1fb74693d715 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:03.539484 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4654b0-1d58-409f-b610-1fb74693d715 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:18:03.541309 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4654b0-1d58-409f-b610-1fb74693d715 service swift] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:18:03.550544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1299/2641] 10.222.0.85 () {60 vars in 1384 bytes} [Tue Aug 2 10:18:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 10:18:13.483267 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=15 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:13.546643 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=41 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:18.460857 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8bff5-1c24-4efe-ac4c-3e1aeacae108 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:18:18.479922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8bff5-1c24-4efe-ac4c-3e1aeacae108 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:18:18.487600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5dd82-2b1e-4b80-9bde-5a7a2b99f408 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:18:18.488646 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5dd82-2b1e-4b80-9bde-5a7a2b99f408 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:18.489097 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5dd82-2b1e-4b80-9bde-5a7a2b99f408 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:18.489440 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5dd82-2b1e-4b80-9bde-5a7a2b99f408 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:18.491607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dce5dd82-2b1e-4b80-9bde-5a7a2b99f408 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:18:18.525200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5dd82-2b1e-4b80-9bde-5a7a2b99f408 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:18:18.527197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5dd82-2b1e-4b80-9bde-5a7a2b99f408 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:18:18.542663 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1343/2642] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:18:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:18:19.836333 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4654b0-1d58-409f-b610-1fb74693d715 service swift] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:18:19.846642 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4654b0-1d58-409f-b610-1fb74693d715 service swift] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:18:19.851479 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be1674-ef56-4368-a060-f3face956c79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:18:19.853128 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be1674-ef56-4368-a060-f3face956c79 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:19.853624 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be1674-ef56-4368-a060-f3face956c79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:19.854120 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be1674-ef56-4368-a060-f3face956c79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:19.857743 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-82be1674-ef56-4368-a060-f3face956c79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:18:19.871620 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be1674-ef56-4368-a060-f3face956c79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:18:19.873286 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be1674-ef56-4368-a060-f3face956c79 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:18:19.885064 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1300/2643] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:18:21.302269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c08e2-41ab-4fc3-831c-2cf503547e02 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:21.302663 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c08e2-41ab-4fc3-831c-2cf503547e02 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:21.302663 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c08e2-41ab-4fc3-831c-2cf503547e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:21.330027 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7b8c08e2-41ab-4fc3-831c-2cf503547e02 None None] MFA Rules not processed for user `f43a16e2dcab4872963222c557853d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:18:21.331478 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7b8c08e2-41ab-4fc3-831c-2cf503547e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:18:21.339291 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1344/2644] 10.222.0.85 () {58 vars in 967 bytes} [Tue Aug 2 10:18:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:18:21.354086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be1674-ef56-4368-a060-f3face956c79 service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:18:21.366950 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be1674-ef56-4368-a060-f3face956c79 service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:18:21.372930 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37ef47-1551-47bb-ba58-c6805e31f081 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cfed2469a7419f8fcbe09d25cb896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:18:21.373644 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37ef47-1551-47bb-ba58-c6805e31f081 service swift] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:21.373930 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37ef47-1551-47bb-ba58-c6805e31f081 service swift] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:21.374207 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37ef47-1551-47bb-ba58-c6805e31f081 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:21.387505 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37ef47-1551-47bb-ba58-c6805e31f081 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:18:21.389156 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37ef47-1551-47bb-ba58-c6805e31f081 service swift] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:18:21.398329 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1301/2645] 10.222.0.85 () {60 vars in 1384 bytes} [Tue Aug 2 10:18:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 10:18:23.514211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c08e2-41ab-4fc3-831c-2cf503547e02 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:18:23.516295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7b8c08e2-41ab-4fc3-831c-2cf503547e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:18:23.607201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c08e2-41ab-4fc3-831c-2cf503547e02 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:18:23.613019 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707432c-8f7b-4fc4-b290-c2dbaff37275 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2a420cc676e4f2bb2766826a1de3b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:18:23.613730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707432c-8f7b-4fc4-b290-c2dbaff37275 service placement] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:23.614014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707432c-8f7b-4fc4-b290-c2dbaff37275 service placement] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:23.614286 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707432c-8f7b-4fc4-b290-c2dbaff37275 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:23.616111 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5707432c-8f7b-4fc4-b290-c2dbaff37275 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:18:23.630149 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707432c-8f7b-4fc4-b290-c2dbaff37275 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:18:23.631775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707432c-8f7b-4fc4-b290-c2dbaff37275 service placement] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:18:23.652620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1345/2646] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:18:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:18:27.147655 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37ef47-1551-47bb-ba58-c6805e31f081 service swift] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:18:27.149905 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-bf37ef47-1551-47bb-ba58-c6805e31f081 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:18:27.165385 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37ef47-1551-47bb-ba58-c6805e31f081 service swift] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:18:27.172040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a510235-f1b5-4e70-955d-afdf5101554b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:18:27.172387 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a510235-f1b5-4e70-955d-afdf5101554b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:27.172709 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a510235-f1b5-4e70-955d-afdf5101554b admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:27.172982 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a510235-f1b5-4e70-955d-afdf5101554b admin admin] PATH_INFO: `/v3/users/020e96151bb442f7920aad3181706145` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:27.174260 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a510235-f1b5-4e70-955d-afdf5101554b admin admin] RBAC: Authorizing `identity:delete_user(user_id=020e96151bb442f7920aad3181706145)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:18:27.176267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a510235-f1b5-4e70-955d-afdf5101554b admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:18:27.229093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-0a510235-f1b5-4e70-955d-afdf5101554b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '020e96151bb442f7920aad3181706145'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:18:27.229688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-0a510235-f1b5-4e70-955d-afdf5101554b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '020e96151bb442f7920aad3181706145'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:18:27.243016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-0a510235-f1b5-4e70-955d-afdf5101554b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '020e96151bb442f7920aad3181706145'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:18:27.250127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-0a510235-f1b5-4e70-955d-afdf5101554b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '020e96151bb442f7920aad3181706145'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:18:27.250827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-0a510235-f1b5-4e70-955d-afdf5101554b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '020e96151bb442f7920aad3181706145'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:18:27.263121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1302/2647] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:18:27 2022] DELETE /identity/v3/users/020e96151bb442f7920aad3181706145 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:18:27.444020 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707432c-8f7b-4fc4-b290-c2dbaff37275 service placement] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:18:27.466999 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707432c-8f7b-4fc4-b290-c2dbaff37275 service placement] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:18:27.530849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38f910-a8d4-4f94-bdf2-b755424111db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:18:27.531500 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38f910-a8d4-4f94-bdf2-b755424111db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:27.531782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38f910-a8d4-4f94-bdf2-b755424111db admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:27.532065 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38f910-a8d4-4f94-bdf2-b755424111db admin admin] PATH_INFO: `/v3/projects/cd6c299fb9c94e3eaaa7635b9d1b8564` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:27.533261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38f910-a8d4-4f94-bdf2-b755424111db admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6c299fb9c94e3eaaa7635b9d1b8564)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:18:27.535179 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38f910-a8d4-4f94-bdf2-b755424111db admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:18:27.591365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1d38f910-a8d4-4f94-bdf2-b755424111db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6c299fb9c94e3eaaa7635b9d1b8564', 'request_id': 'req-1d38f910-a8d4-4f94-bdf2-b755424111db'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:18:27.597979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1d38f910-a8d4-4f94-bdf2-b755424111db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6c299fb9c94e3eaaa7635b9d1b8564', 'request_id': 'req-1d38f910-a8d4-4f94-bdf2-b755424111db'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:18:27.604380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1d38f910-a8d4-4f94-bdf2-b755424111db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6c299fb9c94e3eaaa7635b9d1b8564', 'request_id': 'req-1d38f910-a8d4-4f94-bdf2-b755424111db'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:18:27.621911 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:27.626823 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1d38f910-a8d4-4f94-bdf2-b755424111db admin admin] The token cache is being invalidate because project cd6c299fb9c94e3eaaa7635b9d1b8564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:18:27.627594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1d38f910-a8d4-4f94-bdf2-b755424111db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:18:27.628342 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1d38f910-a8d4-4f94-bdf2-b755424111db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:18:27.630167 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1346/2648] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:18:27 2022] DELETE /identity/v3/projects/cd6c299fb9c94e3eaaa7635b9d1b8564 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:18:27.634906 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a510235-f1b5-4e70-955d-afdf5101554b admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:18:27.636328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-0a510235-f1b5-4e70-955d-afdf5101554b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:18:27.650033 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a510235-f1b5-4e70-955d-afdf5101554b admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:18:27.713801 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9508a43b-f1c1-4373-bc64-658cb4476b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:18:27.714480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508a43b-f1c1-4373-bc64-658cb4476b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:27.714762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508a43b-f1c1-4373-bc64-658cb4476b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:27.715040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9508a43b-f1c1-4373-bc64-658cb4476b97 admin admin] PATH_INFO: `/v3/users/ede5d51e4b0e4687a6284abe9329bd43` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:27.716368 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508a43b-f1c1-4373-bc64-658cb4476b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ede5d51e4b0e4687a6284abe9329bd43)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:18:27.718367 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9508a43b-f1c1-4373-bc64-658cb4476b97 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:18:27.773731 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9508a43b-f1c1-4373-bc64-658cb4476b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ede5d51e4b0e4687a6284abe9329bd43'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:18:27.774732 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9508a43b-f1c1-4373-bc64-658cb4476b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ede5d51e4b0e4687a6284abe9329bd43'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:18:27.775997 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:27.791324 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9508a43b-f1c1-4373-bc64-658cb4476b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ede5d51e4b0e4687a6284abe9329bd43'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:18:27.799023 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9508a43b-f1c1-4373-bc64-658cb4476b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ede5d51e4b0e4687a6284abe9329bd43'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:18:27.799981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9508a43b-f1c1-4373-bc64-658cb4476b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ede5d51e4b0e4687a6284abe9329bd43'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:18:27.813447 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1303/2649] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:18:27 2022] DELETE /identity/v3/users/ede5d51e4b0e4687a6284abe9329bd43 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:18:28.011026 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38f910-a8d4-4f94-bdf2-b755424111db admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:18:28.012479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1d38f910-a8d4-4f94-bdf2-b755424111db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:18:28.028320 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38f910-a8d4-4f94-bdf2-b755424111db admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:18:28.099242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6218e235-ebf6-40b6-b630-dc694f6f0f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:18:28.099906 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218e235-ebf6-40b6-b630-dc694f6f0f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:28.100186 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218e235-ebf6-40b6-b630-dc694f6f0f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:28.100541 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6218e235-ebf6-40b6-b630-dc694f6f0f8a admin admin] PATH_INFO: `/v3/projects/972f21294d2248e292c12fc80d5155ed` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:28.102199 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218e235-ebf6-40b6-b630-dc694f6f0f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=972f21294d2248e292c12fc80d5155ed)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:18:28.104048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6218e235-ebf6-40b6-b630-dc694f6f0f8a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:18:28.157964 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6218e235-ebf6-40b6-b630-dc694f6f0f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '972f21294d2248e292c12fc80d5155ed', 'request_id': 'req-6218e235-ebf6-40b6-b630-dc694f6f0f8a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:18:28.165682 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6218e235-ebf6-40b6-b630-dc694f6f0f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '972f21294d2248e292c12fc80d5155ed', 'request_id': 'req-6218e235-ebf6-40b6-b630-dc694f6f0f8a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:18:28.171990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6218e235-ebf6-40b6-b630-dc694f6f0f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '972f21294d2248e292c12fc80d5155ed', 'request_id': 'req-6218e235-ebf6-40b6-b630-dc694f6f0f8a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:18:28.187054 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6218e235-ebf6-40b6-b630-dc694f6f0f8a admin admin] The token cache is being invalidate because project 972f21294d2248e292c12fc80d5155ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:18:28.187416 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6218e235-ebf6-40b6-b630-dc694f6f0f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:18:28.188102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6218e235-ebf6-40b6-b630-dc694f6f0f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:18:28.189649 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1347/2650] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:18:28 2022] DELETE /identity/v3/projects/972f21294d2248e292c12fc80d5155ed => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:18:29.412570 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676057f-7fbe-4e3d-a238-4f3f91991e4d None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:29.413061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676057f-7fbe-4e3d-a238-4f3f91991e4d None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:29.413165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676057f-7fbe-4e3d-a238-4f3f91991e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:29.433223 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-b676057f-7fbe-4e3d-a238-4f3f91991e4d None None] MFA Rules not processed for user `163e87443807427695fa90bd14f3ebf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:18:29.434539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b676057f-7fbe-4e3d-a238-4f3f91991e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:18:29.489529 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1304/2651] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:18:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:18:38.183797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:39.482565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=37,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:18:59.330344 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f463940-1b8c-4ce9-84fd-8d42de13a5a4 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:18:59.330898 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f463940-1b8c-4ce9-84fd-8d42de13a5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:18:59.331012 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f463940-1b8c-4ce9-84fd-8d42de13a5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:18:59.350791 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8f463940-1b8c-4ce9-84fd-8d42de13a5a4 None None] MFA Rules not processed for user `4b6f36b8484440ccbb4f703884717bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:18:59.352008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8f463940-1b8c-4ce9-84fd-8d42de13a5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:18:59.408911 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1348/2652] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:18:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:19:09.402149 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=25 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:18.693383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676057f-7fbe-4e3d-a238-4f3f91991e4d None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:19:18.694820 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b676057f-7fbe-4e3d-a238-4f3f91991e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:19:18.852772 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b676057f-7fbe-4e3d-a238-4f3f91991e4d None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:19:18.858128 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b523181-a7fa-4787-bdcc-73dac2020f28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2a420cc676e4f2bb2766826a1de3b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:19:18.858798 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b523181-a7fa-4787-bdcc-73dac2020f28 service placement] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:19:18.859069 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b523181-a7fa-4787-bdcc-73dac2020f28 service placement] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:19:18.859347 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b523181-a7fa-4787-bdcc-73dac2020f28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:19:18.861460 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-1b523181-a7fa-4787-bdcc-73dac2020f28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:19:18.874223 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b523181-a7fa-4787-bdcc-73dac2020f28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:19:18.875808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b523181-a7fa-4787-bdcc-73dac2020f28 service placement] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:19:18.886115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1305/2653] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:19:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:19:28.116086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd518ee5-22cb-4d8d-83c4-3cbc198530aa None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:19:28.116654 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd518ee5-22cb-4d8d-83c4-3cbc198530aa None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:19:28.116654 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd518ee5-22cb-4d8d-83c4-3cbc198530aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:19:28.137389 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-cd518ee5-22cb-4d8d-83c4-3cbc198530aa None None] MFA Rules not processed for user `163e87443807427695fa90bd14f3ebf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:19:28.139147 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cd518ee5-22cb-4d8d-83c4-3cbc198530aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:19:28.145524 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1349/2654] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:19:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:19:28.881799 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=63 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:19:38.131728 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:06.498424 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611ef83-3386-423e-9a69-070dc1f0304c None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:06.498935 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611ef83-3386-423e-9a69-070dc1f0304c None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:06.499040 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611ef83-3386-423e-9a69-070dc1f0304c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:06.534570 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-e611ef83-3386-423e-9a69-070dc1f0304c None None] MFA Rules not processed for user `f43a16e2dcab4872963222c557853d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:20:06.536640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e611ef83-3386-423e-9a69-070dc1f0304c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:20:06.599635 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1306/2655] 10.222.0.85 () {58 vars in 1009 bytes} [Tue Aug 2 10:20:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:20:06.653411 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd518ee5-22cb-4d8d-83c4-3cbc198530aa None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:06.654847 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cd518ee5-22cb-4d8d-83c4-3cbc198530aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:20:06.726521 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd518ee5-22cb-4d8d-83c4-3cbc198530aa None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:06.731933 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff5d5d-fdd0-4940-965e-ee65c9e753c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cfed2469a7419f8fcbe09d25cb896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:06.732614 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff5d5d-fdd0-4940-965e-ee65c9e753c7 service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:06.732932 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff5d5d-fdd0-4940-965e-ee65c9e753c7 service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:06.733211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff5d5d-fdd0-4940-965e-ee65c9e753c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:06.743106 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff5d5d-fdd0-4940-965e-ee65c9e753c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:06.743963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff5d5d-fdd0-4940-965e-ee65c9e753c7 service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:06.752491 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1350/2656] 10.222.0.85 () {60 vars in 1384 bytes} [Tue Aug 2 10:20:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 10:20:16.592483 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=32 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:16.748920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=32 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:23.484927 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2b8d7-0b2d-47f4-bb40-85a8531fb7c8 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:23.485883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2b8d7-0b2d-47f4-bb40-85a8531fb7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:23.485883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2b8d7-0b2d-47f4-bb40-85a8531fb7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:23.508036 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-11e2b8d7-0b2d-47f4-bb40-85a8531fb7c8 None None] MFA Rules not processed for user `f43a16e2dcab4872963222c557853d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:20:23.509299 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-11e2b8d7-0b2d-47f4-bb40-85a8531fb7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:20:23.516513 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1307/2657] 10.222.0.85 () {58 vars in 1009 bytes} [Tue Aug 2 10:20:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:20:23.529176 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff5d5d-fdd0-4940-965e-ee65c9e753c7 service swift] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:23.541046 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff5d5d-fdd0-4940-965e-ee65c9e753c7 service swift] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:23.547258 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0f42f-4f26-4a43-a6b8-49bd648ab578 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cfed2469a7419f8fcbe09d25cb896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:23.547873 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0f42f-4f26-4a43-a6b8-49bd648ab578 service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:23.548149 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0f42f-4f26-4a43-a6b8-49bd648ab578 service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:23.548419 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0f42f-4f26-4a43-a6b8-49bd648ab578 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:23.557226 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0f42f-4f26-4a43-a6b8-49bd648ab578 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:23.558789 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0f42f-4f26-4a43-a6b8-49bd648ab578 service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:23.568119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1351/2658] 10.222.0.85 () {60 vars in 1384 bytes} [Tue Aug 2 10:20:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 10:20:33.502456 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:33.564308 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=6 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:37.483415 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77b008-150f-4d69-8835-f5970fd96e0e None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:37.483935 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77b008-150f-4d69-8835-f5970fd96e0e None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:37.484038 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77b008-150f-4d69-8835-f5970fd96e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:37.505291 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-7a77b008-150f-4d69-8835-f5970fd96e0e None None] MFA Rules not processed for user `f43a16e2dcab4872963222c557853d32`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:20:37.506498 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7a77b008-150f-4d69-8835-f5970fd96e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:20:37.514557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1308/2659] 10.222.0.85 () {58 vars in 967 bytes} [Tue Aug 2 10:20:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:20:37.527530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0f42f-4f26-4a43-a6b8-49bd648ab578 service swift] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:37.539361 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0f42f-4f26-4a43-a6b8-49bd648ab578 service swift] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:37.545900 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a58be8-eb1d-45b7-a05a-f1d2564eb085 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9cfed2469a7419f8fcbe09d25cb896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:37.546787 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a58be8-eb1d-45b7-a05a-f1d2564eb085 service swift] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:37.547099 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a58be8-eb1d-45b7-a05a-f1d2564eb085 service swift] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:37.547514 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a58be8-eb1d-45b7-a05a-f1d2564eb085 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:37.558709 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a58be8-eb1d-45b7-a05a-f1d2564eb085 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:37.560219 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a58be8-eb1d-45b7-a05a-f1d2564eb085 service swift] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:37.570071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1352/2660] 10.222.0.85 () {60 vars in 1384 bytes} [Tue Aug 2 10:20:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 10:20:42.416996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77b008-150f-4d69-8835-f5970fd96e0e None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:42.417999 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7a77b008-150f-4d69-8835-f5970fd96e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:20:42.443534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77b008-150f-4d69-8835-f5970fd96e0e None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:42.449404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9f96c-2c45-401c-b038-14c5a9790f09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2a420cc676e4f2bb2766826a1de3b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:42.450058 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9f96c-2c45-401c-b038-14c5a9790f09 service placement] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:42.450476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9f96c-2c45-401c-b038-14c5a9790f09 service placement] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:42.450901 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9f96c-2c45-401c-b038-14c5a9790f09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:42.452865 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-63e9f96c-2c45-401c-b038-14c5a9790f09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:20:42.466958 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9f96c-2c45-401c-b038-14c5a9790f09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:42.468566 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9f96c-2c45-401c-b038-14c5a9790f09 service placement] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:42.482403 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1309/2661] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:20:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:20:42.490100 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a58be8-eb1d-45b7-a05a-f1d2564eb085 service swift] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:42.501570 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-70a58be8-eb1d-45b7-a05a-f1d2564eb085 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:20:42.614889 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a58be8-eb1d-45b7-a05a-f1d2564eb085 service swift] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:42.619496 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f4210-6e5d-47e4-8886-207cb3b8b5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:42.620138 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f4210-6e5d-47e4-8886-207cb3b8b5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:42.620422 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f4210-6e5d-47e4-8886-207cb3b8b5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:42.620730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f4210-6e5d-47e4-8886-207cb3b8b5d7 admin admin] PATH_INFO: `/v3/users/163e87443807427695fa90bd14f3ebf1` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:42.621917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f4210-6e5d-47e4-8886-207cb3b8b5d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=163e87443807427695fa90bd14f3ebf1)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:42.623875 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f4210-6e5d-47e4-8886-207cb3b8b5d7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:42.670591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cb9f4210-6e5d-47e4-8886-207cb3b8b5d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '163e87443807427695fa90bd14f3ebf1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:20:42.671183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cb9f4210-6e5d-47e4-8886-207cb3b8b5d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '163e87443807427695fa90bd14f3ebf1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:20:42.678866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cb9f4210-6e5d-47e4-8886-207cb3b8b5d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '163e87443807427695fa90bd14f3ebf1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:20:42.691283 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cb9f4210-6e5d-47e4-8886-207cb3b8b5d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '163e87443807427695fa90bd14f3ebf1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:20:42.700581 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-cb9f4210-6e5d-47e4-8886-207cb3b8b5d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '163e87443807427695fa90bd14f3ebf1'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:20:42.706866 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1353/2662] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:20:42 2022] DELETE /identity/v3/users/163e87443807427695fa90bd14f3ebf1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:20:42.889368 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9f96c-2c45-401c-b038-14c5a9790f09 service placement] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:42.901391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9f96c-2c45-401c-b038-14c5a9790f09 service placement] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:42.960336 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49a2c1-efab-4e59-8c71-553a10bce87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:42.961009 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49a2c1-efab-4e59-8c71-553a10bce87d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:42.961292 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49a2c1-efab-4e59-8c71-553a10bce87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:42.961570 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49a2c1-efab-4e59-8c71-553a10bce87d admin admin] PATH_INFO: `/v3/projects/dae6fcf9825743ffad8b042e5c4d55ed` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:42.962721 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49a2c1-efab-4e59-8c71-553a10bce87d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae6fcf9825743ffad8b042e5c4d55ed)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:42.964655 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49a2c1-efab-4e59-8c71-553a10bce87d admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:43.013125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-2f49a2c1-efab-4e59-8c71-553a10bce87d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae6fcf9825743ffad8b042e5c4d55ed', 'request_id': 'req-2f49a2c1-efab-4e59-8c71-553a10bce87d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:20:43.019207 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-2f49a2c1-efab-4e59-8c71-553a10bce87d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae6fcf9825743ffad8b042e5c4d55ed', 'request_id': 'req-2f49a2c1-efab-4e59-8c71-553a10bce87d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:20:43.025833 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-2f49a2c1-efab-4e59-8c71-553a10bce87d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae6fcf9825743ffad8b042e5c4d55ed', 'request_id': 'req-2f49a2c1-efab-4e59-8c71-553a10bce87d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:20:43.048356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-2f49a2c1-efab-4e59-8c71-553a10bce87d admin admin] The token cache is being invalidate because project dae6fcf9825743ffad8b042e5c4d55ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:20:43.048671 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-2f49a2c1-efab-4e59-8c71-553a10bce87d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:20:43.049288 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-2f49a2c1-efab-4e59-8c71-553a10bce87d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:20:43.050825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1310/2663] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:20:42 2022] DELETE /identity/v3/projects/dae6fcf9825743ffad8b042e5c4d55ed => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:20:43.055917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bc8ce-a4ea-4b13-a5d7-5f0b19b9c660 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:43.056203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bc8ce-a4ea-4b13-a5d7-5f0b19b9c660 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:43.056580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bc8ce-a4ea-4b13-a5d7-5f0b19b9c660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:43.112922 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:43.116007 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-068bc8ce-a4ea-4b13-a5d7-5f0b19b9c660 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:20:43.117334 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-068bc8ce-a4ea-4b13-a5d7-5f0b19b9c660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:20:43.189621 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1354/2664] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:20:43.197998 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0891a-9a7c-4601-99dd-592fc3993dd3 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:43.198311 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0891a-9a7c-4601-99dd-592fc3993dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:43.198583 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0891a-9a7c-4601-99dd-592fc3993dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:43.220195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-74c0891a-9a7c-4601-99dd-592fc3993dd3 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:20:43.222298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-74c0891a-9a7c-4601-99dd-592fc3993dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:20:43.231842 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1311/2665] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:20:43.236429 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bc8ce-a4ea-4b13-a5d7-5f0b19b9c660 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:43.246534 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bc8ce-a4ea-4b13-a5d7-5f0b19b9c660 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:43.251206 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fe66c-467a-4995-92ac-33015bd13b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:43.251825 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fe66c-467a-4995-92ac-33015bd13b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:43.252294 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fe66c-467a-4995-92ac-33015bd13b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:43.253081 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3fe66c-467a-4995-92ac-33015bd13b45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:43.253276 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fe66c-467a-4995-92ac-33015bd13b45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:20:43.253562 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fe66c-467a-4995-92ac-33015bd13b45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:43.255578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3fe66c-467a-4995-92ac-33015bd13b45 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:43.267760 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1355/2666] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:20:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:20:43.273557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0891a-9a7c-4601-99dd-592fc3993dd3 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:43.285579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0891a-9a7c-4601-99dd-592fc3993dd3 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:43.301073 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9748d19-8f1e-44a3-814b-97c3512d88e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:43.301714 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9748d19-8f1e-44a3-814b-97c3512d88e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:43.302001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9748d19-8f1e-44a3-814b-97c3512d88e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:43.302275 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9748d19-8f1e-44a3-814b-97c3512d88e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:43.302964 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9748d19-8f1e-44a3-814b-97c3512d88e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:43.304936 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9748d19-8f1e-44a3-814b-97c3512d88e8 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:43.351076 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1312/2667] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:20:43 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:20:43.355368 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fe66c-467a-4995-92ac-33015bd13b45 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:43.366230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3fe66c-467a-4995-92ac-33015bd13b45 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:43.427574 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970a895-835b-4dde-9353-82f271096551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:43.428201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970a895-835b-4dde-9353-82f271096551 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:43.428506 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970a895-835b-4dde-9353-82f271096551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:43.428784 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970a895-835b-4dde-9353-82f271096551 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:43.429582 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970a895-835b-4dde-9353-82f271096551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:43.431568 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970a895-835b-4dde-9353-82f271096551 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:43.458592 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1356/2668] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:20:43 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:20:43.462821 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9748d19-8f1e-44a3-814b-97c3512d88e8 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:43.474401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9748d19-8f1e-44a3-814b-97c3512d88e8 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:43.479121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe740b-7144-47da-83e6-6d6e101ef414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:43.479739 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe740b-7144-47da-83e6-6d6e101ef414 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:43.480050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe740b-7144-47da-83e6-6d6e101ef414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:43.480328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe740b-7144-47da-83e6-6d6e101ef414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:43.481065 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe740b-7144-47da-83e6-6d6e101ef414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:43.482680 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe740b-7144-47da-83e6-6d6e101ef414 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:43.493455 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1313/2669] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:20:43.497711 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970a895-835b-4dde-9353-82f271096551 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:43.509165 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970a895-835b-4dde-9353-82f271096551 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:43.514077 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a5eb1-8d79-4376-955d-d5a7ef337472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:43.514683 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a5eb1-8d79-4376-955d-d5a7ef337472 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:43.514989 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a5eb1-8d79-4376-955d-d5a7ef337472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:43.515261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a5eb1-8d79-4376-955d-d5a7ef337472 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:43.515958 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a5eb1-8d79-4376-955d-d5a7ef337472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:43.517571 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a5eb1-8d79-4376-955d-d5a7ef337472 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:43.530021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1357/2670] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:20:43.534578 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe740b-7144-47da-83e6-6d6e101ef414 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:43.545314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe740b-7144-47da-83e6-6d6e101ef414 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:43.550027 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4f975-8d36-4aba-bb88-a676860b78fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:43.550699 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4f975-8d36-4aba-bb88-a676860b78fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:43.550986 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4f975-8d36-4aba-bb88-a676860b78fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:43.551265 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4f975-8d36-4aba-bb88-a676860b78fb admin admin] PATH_INFO: `/v3/projects/a1c7fc76d02746aab4fb1401589aa44f/users/59eefd6e4ba64a4faadb2b6fcf4d409c/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:43.568155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4f975-8d36-4aba-bb88-a676860b78fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c7fc76d02746aab4fb1401589aa44f, user_id=59eefd6e4ba64a4faadb2b6fcf4d409c, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:43.571294 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4f975-8d36-4aba-bb88-a676860b78fb admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:43.595730 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1314/2671] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:20:43 2022] PUT /identity/v3/projects/a1c7fc76d02746aab4fb1401589aa44f/users/59eefd6e4ba64a4faadb2b6fcf4d409c/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:20:43.607205 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45229e6b-f34c-4384-a9d6-4d485f4198d9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:43.607491 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45229e6b-f34c-4384-a9d6-4d485f4198d9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:43.607770 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45229e6b-f34c-4384-a9d6-4d485f4198d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:43.638175 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-45229e6b-f34c-4384-a9d6-4d485f4198d9 None None] MFA Rules not processed for user `59eefd6e4ba64a4faadb2b6fcf4d409c`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:20:43.639407 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-45229e6b-f34c-4384-a9d6-4d485f4198d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:20:43.714049 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1358/2672] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:20:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:20:43.726049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4f975-8d36-4aba-bb88-a676860b78fb admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:43.727747 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-6cd4f975-8d36-4aba-bb88-a676860b78fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:20:43.738198 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:43.840410 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4f975-8d36-4aba-bb88-a676860b78fb admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:43.850766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d21bd-e9d2-4d1a-b00e-9c448e85c249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:43.851401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d21bd-e9d2-4d1a-b00e-9c448e85c249 service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:43.851697 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d21bd-e9d2-4d1a-b00e-9c448e85c249 service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:43.851968 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d21bd-e9d2-4d1a-b00e-9c448e85c249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:43.861167 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d21bd-e9d2-4d1a-b00e-9c448e85c249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:43.862793 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d21bd-e9d2-4d1a-b00e-9c448e85c249 service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:43.872723 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1315/2673] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:20:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:20:49.130294 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45229e6b-f34c-4384-a9d6-4d485f4198d9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:49.132603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:49.195033 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45229e6b-f34c-4384-a9d6-4d485f4198d9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:49.199611 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08fb7e-40dc-4f48-b79f-42af35ccb8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:49.200250 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08fb7e-40dc-4f48-b79f-42af35ccb8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:49.200561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08fb7e-40dc-4f48-b79f-42af35ccb8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:49.200843 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08fb7e-40dc-4f48-b79f-42af35ccb8a7 admin admin] PATH_INFO: `/v3/users/59eefd6e4ba64a4faadb2b6fcf4d409c` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:49.202012 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08fb7e-40dc-4f48-b79f-42af35ccb8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59eefd6e4ba64a4faadb2b6fcf4d409c)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:49.203933 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08fb7e-40dc-4f48-b79f-42af35ccb8a7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:49.254351 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9d08fb7e-40dc-4f48-b79f-42af35ccb8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59eefd6e4ba64a4faadb2b6fcf4d409c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:20:49.255022 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9d08fb7e-40dc-4f48-b79f-42af35ccb8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59eefd6e4ba64a4faadb2b6fcf4d409c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:20:49.262024 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9d08fb7e-40dc-4f48-b79f-42af35ccb8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59eefd6e4ba64a4faadb2b6fcf4d409c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:20:49.273954 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9d08fb7e-40dc-4f48-b79f-42af35ccb8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59eefd6e4ba64a4faadb2b6fcf4d409c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:20:49.281360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-9d08fb7e-40dc-4f48-b79f-42af35ccb8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59eefd6e4ba64a4faadb2b6fcf4d409c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:20:49.287479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1359/2674] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:20:49 2022] DELETE /identity/v3/users/59eefd6e4ba64a4faadb2b6fcf4d409c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:20:49.292238 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7540b99-363d-4651-9c66-becd191f3632 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:49.292757 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7540b99-363d-4651-9c66-becd191f3632 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:49.292869 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7540b99-363d-4651-9c66-becd191f3632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:49.312773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-f7540b99-363d-4651-9c66-becd191f3632 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:20:49.313982 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f7540b99-363d-4651-9c66-becd191f3632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:20:49.374916 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1316/2675] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:20:49.384945 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08fb7e-40dc-4f48-b79f-42af35ccb8a7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:49.386338 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9d08fb7e-40dc-4f48-b79f-42af35ccb8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:20:49.486041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08fb7e-40dc-4f48-b79f-42af35ccb8a7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:49.491365 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d98cf-f491-4c3d-82e6-d39b2abe4ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:49.492069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d98cf-f491-4c3d-82e6-d39b2abe4ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:49.492427 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d98cf-f491-4c3d-82e6-d39b2abe4ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:49.492804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d98cf-f491-4c3d-82e6-d39b2abe4ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:49.504542 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d98cf-f491-4c3d-82e6-d39b2abe4ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:49.506494 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d98cf-f491-4c3d-82e6-d39b2abe4ec6 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:49.518390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1360/2676] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:20:49.804016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7540b99-363d-4651-9c66-becd191f3632 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:49.805545 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f7540b99-363d-4651-9c66-becd191f3632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:20:49.818128 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7540b99-363d-4651-9c66-becd191f3632 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:49.822842 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78875d32-2571-42e6-9090-49e21782799f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:49.823563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78875d32-2571-42e6-9090-49e21782799f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:49.823859 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78875d32-2571-42e6-9090-49e21782799f admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:49.824133 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78875d32-2571-42e6-9090-49e21782799f admin admin] PATH_INFO: `/v3/projects/a1c7fc76d02746aab4fb1401589aa44f` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:49.825343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78875d32-2571-42e6-9090-49e21782799f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c7fc76d02746aab4fb1401589aa44f)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:49.827244 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78875d32-2571-42e6-9090-49e21782799f admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:49.876889 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-78875d32-2571-42e6-9090-49e21782799f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c7fc76d02746aab4fb1401589aa44f', 'request_id': 'req-78875d32-2571-42e6-9090-49e21782799f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:20:49.883037 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-78875d32-2571-42e6-9090-49e21782799f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c7fc76d02746aab4fb1401589aa44f', 'request_id': 'req-78875d32-2571-42e6-9090-49e21782799f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:20:49.889934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-78875d32-2571-42e6-9090-49e21782799f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c7fc76d02746aab4fb1401589aa44f', 'request_id': 'req-78875d32-2571-42e6-9090-49e21782799f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:20:49.894924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:49.905468 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-78875d32-2571-42e6-9090-49e21782799f admin admin] The token cache is being invalidate because project a1c7fc76d02746aab4fb1401589aa44f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:20:49.905810 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-78875d32-2571-42e6-9090-49e21782799f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:20:49.907363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-78875d32-2571-42e6-9090-49e21782799f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:20:49.909654 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1317/2677] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:20:49 2022] DELETE /identity/v3/projects/a1c7fc76d02746aab4fb1401589aa44f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:20:49.915051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef7c76-cfdd-4417-a7d7-b93522894904 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:49.915390 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef7c76-cfdd-4417-a7d7-b93522894904 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:49.915681 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef7c76-cfdd-4417-a7d7-b93522894904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:49.925806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:49.938345 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-deef7c76-cfdd-4417-a7d7-b93522894904 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:20:49.940312 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-deef7c76-cfdd-4417-a7d7-b93522894904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:20:50.006117 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1361/2678] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:20:50.014608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f9aee-c3f4-430b-9b25-5e338c31196d None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:50.014894 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f9aee-c3f4-430b-9b25-5e338c31196d None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:50.015158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f9aee-c3f4-430b-9b25-5e338c31196d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:50.036984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-643f9aee-c3f4-430b-9b25-5e338c31196d None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:20:50.038191 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-643f9aee-c3f4-430b-9b25-5e338c31196d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:20:50.046110 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1318/2679] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:20:50.051211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef7c76-cfdd-4417-a7d7-b93522894904 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:50.061130 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef7c76-cfdd-4417-a7d7-b93522894904 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:50.066846 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafbe19-1d56-4803-8f8e-2208a8ce804e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:50.067455 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafbe19-1d56-4803-8f8e-2208a8ce804e admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:50.067734 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafbe19-1d56-4803-8f8e-2208a8ce804e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:50.068005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafbe19-1d56-4803-8f8e-2208a8ce804e admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:50.068733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafbe19-1d56-4803-8f8e-2208a8ce804e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:20:50.069064 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafbe19-1d56-4803-8f8e-2208a8ce804e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:50.070665 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafbe19-1d56-4803-8f8e-2208a8ce804e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:50.083554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1362/2680] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:20:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:20:50.087970 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f9aee-c3f4-430b-9b25-5e338c31196d None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:50.097340 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f9aee-c3f4-430b-9b25-5e338c31196d None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:50.101932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f2e5a-16c5-45ae-879f-8dc69cc16820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:50.102536 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f2e5a-16c5-45ae-879f-8dc69cc16820 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:50.102818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f2e5a-16c5-45ae-879f-8dc69cc16820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:50.103094 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f2e5a-16c5-45ae-879f-8dc69cc16820 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:50.103766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f2e5a-16c5-45ae-879f-8dc69cc16820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:50.105754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f2e5a-16c5-45ae-879f-8dc69cc16820 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:50.132635 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1319/2681] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:20:50 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:20:50.136815 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafbe19-1d56-4803-8f8e-2208a8ce804e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:50.147142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafbe19-1d56-4803-8f8e-2208a8ce804e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:50.205655 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b13d6-5590-41ad-adfd-9003d1a53e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:50.206740 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b13d6-5590-41ad-adfd-9003d1a53e4d admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:50.207027 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b13d6-5590-41ad-adfd-9003d1a53e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:50.207306 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b13d6-5590-41ad-adfd-9003d1a53e4d admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:50.207984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b13d6-5590-41ad-adfd-9003d1a53e4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:50.209933 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b13d6-5590-41ad-adfd-9003d1a53e4d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:50.231619 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1363/2682] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:20:50 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:20:50.236194 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f2e5a-16c5-45ae-879f-8dc69cc16820 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:50.247701 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f2e5a-16c5-45ae-879f-8dc69cc16820 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:50.252301 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df82903-a696-47ac-8d34-4089b3cf77a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:50.253466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df82903-a696-47ac-8d34-4089b3cf77a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:50.253752 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df82903-a696-47ac-8d34-4089b3cf77a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:50.254025 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df82903-a696-47ac-8d34-4089b3cf77a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:50.254726 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df82903-a696-47ac-8d34-4089b3cf77a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:50.256301 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df82903-a696-47ac-8d34-4089b3cf77a6 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:50.266774 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1320/2683] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:20:50.271476 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b13d6-5590-41ad-adfd-9003d1a53e4d admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:50.281743 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b13d6-5590-41ad-adfd-9003d1a53e4d admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:50.287098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0f108-04d7-4faa-91e9-d52295573658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:50.287712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0f108-04d7-4faa-91e9-d52295573658 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:50.287995 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0f108-04d7-4faa-91e9-d52295573658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:50.288271 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0f108-04d7-4faa-91e9-d52295573658 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:50.289004 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0f108-04d7-4faa-91e9-d52295573658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:50.290603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0f108-04d7-4faa-91e9-d52295573658 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:50.302704 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1364/2684] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:20:50.306983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df82903-a696-47ac-8d34-4089b3cf77a6 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:50.319234 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df82903-a696-47ac-8d34-4089b3cf77a6 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:50.324148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb41f88-de1f-4a94-9f3f-0a2c80a80b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:50.324866 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb41f88-de1f-4a94-9f3f-0a2c80a80b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:50.325150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb41f88-de1f-4a94-9f3f-0a2c80a80b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:50.325426 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb41f88-de1f-4a94-9f3f-0a2c80a80b0c admin admin] PATH_INFO: `/v3/projects/9b09ff41a0c34b608b6e79558a70a477/users/6233035dafac451a8f5c905f64ceea4b/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:50.341510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb41f88-de1f-4a94-9f3f-0a2c80a80b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b09ff41a0c34b608b6e79558a70a477, user_id=6233035dafac451a8f5c905f64ceea4b, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:50.344168 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb41f88-de1f-4a94-9f3f-0a2c80a80b0c admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:50.358321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1321/2685] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:20:50 2022] PUT /identity/v3/projects/9b09ff41a0c34b608b6e79558a70a477/users/6233035dafac451a8f5c905f64ceea4b/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:20:50.370304 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9431161-ad02-4a57-aee2-022bd45d96e9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:50.370591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9431161-ad02-4a57-aee2-022bd45d96e9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:50.370868 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9431161-ad02-4a57-aee2-022bd45d96e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:50.400547 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b9431161-ad02-4a57-aee2-022bd45d96e9 None None] MFA Rules not processed for user `6233035dafac451a8f5c905f64ceea4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:20:50.401768 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b9431161-ad02-4a57-aee2-022bd45d96e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:20:50.463092 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:50.467019 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1365/2686] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:20:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:20:50.471549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb41f88-de1f-4a94-9f3f-0a2c80a80b0c admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:50.534862 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb41f88-de1f-4a94-9f3f-0a2c80a80b0c admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:50.539603 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6dd33-c63e-47f0-a565-a85626efa6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:50.540223 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6dd33-c63e-47f0-a565-a85626efa6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:50.540536 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6dd33-c63e-47f0-a565-a85626efa6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:50.540815 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6dd33-c63e-47f0-a565-a85626efa6b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:50.541484 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6dd33-c63e-47f0-a565-a85626efa6b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:50.543385 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca6dd33-c63e-47f0-a565-a85626efa6b6 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:50.570892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1322/2687] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:20:50 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:20:50.574917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9431161-ad02-4a57-aee2-022bd45d96e9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:50.586394 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9431161-ad02-4a57-aee2-022bd45d96e9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:50.649242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62468a-47df-46fa-a8ba-ef83ba50e11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:50.649864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62468a-47df-46fa-a8ba-ef83ba50e11e admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:50.650149 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62468a-47df-46fa-a8ba-ef83ba50e11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:50.650426 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62468a-47df-46fa-a8ba-ef83ba50e11e admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:50.651110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62468a-47df-46fa-a8ba-ef83ba50e11e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:50.653100 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62468a-47df-46fa-a8ba-ef83ba50e11e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:50.680985 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1366/2688] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:20:50 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:20:50.685396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6dd33-c63e-47f0-a565-a85626efa6b6 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:50.697547 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6dd33-c63e-47f0-a565-a85626efa6b6 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:50.702290 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc03f3-e63f-4305-aa86-6c28256424fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:50.702902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc03f3-e63f-4305-aa86-6c28256424fd admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:50.703188 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc03f3-e63f-4305-aa86-6c28256424fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:50.703465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc03f3-e63f-4305-aa86-6c28256424fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:50.704170 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc03f3-e63f-4305-aa86-6c28256424fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:50.705902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc03f3-e63f-4305-aa86-6c28256424fd admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:50.716686 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1323/2689] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:20:50.720943 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62468a-47df-46fa-a8ba-ef83ba50e11e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:50.731733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62468a-47df-46fa-a8ba-ef83ba50e11e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:50.736725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1787d6d-9dc2-4e6a-a9e2-05b8dbeff457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:50.737937 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1787d6d-9dc2-4e6a-a9e2-05b8dbeff457 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:50.738218 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1787d6d-9dc2-4e6a-a9e2-05b8dbeff457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:50.738498 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1787d6d-9dc2-4e6a-a9e2-05b8dbeff457 admin admin] PATH_INFO: `/v3/projects/51e1740bf19e44ec921999dd545d573b/users/bed14858fec84f6d9a7c5b2a3cf492cb/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:50.754166 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1787d6d-9dc2-4e6a-a9e2-05b8dbeff457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e1740bf19e44ec921999dd545d573b, user_id=bed14858fec84f6d9a7c5b2a3cf492cb, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:50.756864 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1787d6d-9dc2-4e6a-a9e2-05b8dbeff457 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:50.770475 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1367/2690] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:20:50 2022] PUT /identity/v3/projects/51e1740bf19e44ec921999dd545d573b/users/bed14858fec84f6d9a7c5b2a3cf492cb/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:20:50.774438 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc03f3-e63f-4305-aa86-6c28256424fd admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:50.784273 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc03f3-e63f-4305-aa86-6c28256424fd admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:50.839702 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81f86d-ae22-4d4e-9671-0dd6a777b94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:50.840229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81f86d-ae22-4d4e-9671-0dd6a777b94d admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:50.840541 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81f86d-ae22-4d4e-9671-0dd6a777b94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:50.840816 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81f86d-ae22-4d4e-9671-0dd6a777b94d admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:50.841500 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81f86d-ae22-4d4e-9671-0dd6a777b94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:50.843082 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81f86d-ae22-4d4e-9671-0dd6a777b94d admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:50.853360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1324/2691] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:20:50.857552 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1787d6d-9dc2-4e6a-a9e2-05b8dbeff457 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:50.869031 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1787d6d-9dc2-4e6a-a9e2-05b8dbeff457 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:50.873767 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966744f-decf-4633-bce7-f67cdeea9a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:50.874438 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966744f-decf-4633-bce7-f67cdeea9a62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:50.874734 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966744f-decf-4633-bce7-f67cdeea9a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:50.875005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966744f-decf-4633-bce7-f67cdeea9a62 admin admin] PATH_INFO: `/v3/projects/51e1740bf19e44ec921999dd545d573b/users/bed14858fec84f6d9a7c5b2a3cf492cb/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:50.877067 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966744f-decf-4633-bce7-f67cdeea9a62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e1740bf19e44ec921999dd545d573b, user_id=bed14858fec84f6d9a7c5b2a3cf492cb, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:50.879801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966744f-decf-4633-bce7-f67cdeea9a62 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:50.890706 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1368/2692] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:20:50 2022] PUT /identity/v3/projects/51e1740bf19e44ec921999dd545d573b/users/bed14858fec84f6d9a7c5b2a3cf492cb/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:20:50.902315 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bb51d-d9b8-4cea-ae28-b191b4e23055 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:50.902602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bb51d-d9b8-4cea-ae28-b191b4e23055 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:50.902879 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bb51d-d9b8-4cea-ae28-b191b4e23055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:50.910672 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:50.937841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-a43bb51d-d9b8-4cea-ae28-b191b4e23055 None None] MFA Rules not processed for user `bed14858fec84f6d9a7c5b2a3cf492cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:20:50.939481 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a43bb51d-d9b8-4cea-ae28-b191b4e23055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:20:51.013817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1325/2693] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:20:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:20:51.026886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966744f-decf-4633-bce7-f67cdeea9a62 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:51.028597 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f966744f-decf-4633-bce7-f67cdeea9a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:20:51.115774 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966744f-decf-4633-bce7-f67cdeea9a62 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:51.119407 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8334f3f-bb39-48bf-8cfd-762cab5c4945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:51.120022 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8334f3f-bb39-48bf-8cfd-762cab5c4945 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:51.120306 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8334f3f-bb39-48bf-8cfd-762cab5c4945 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:51.120617 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8334f3f-bb39-48bf-8cfd-762cab5c4945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:51.168094 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:20:51.182068 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8334f3f-bb39-48bf-8cfd-762cab5c4945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:51.183530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8334f3f-bb39-48bf-8cfd-762cab5c4945 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:51.192713 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1369/2694] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:20:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:20:53.806234 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bb51d-d9b8-4cea-ae28-b191b4e23055 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:20:53.817313 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bb51d-d9b8-4cea-ae28-b191b4e23055 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:20:53.820852 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e19c17-5a09-4c01-aa11-6635ff079315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:20:53.821464 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e19c17-5a09-4c01-aa11-6635ff079315 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:20:53.821744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e19c17-5a09-4c01-aa11-6635ff079315 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:20:53.822020 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e19c17-5a09-4c01-aa11-6635ff079315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:20:53.831553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e19c17-5a09-4c01-aa11-6635ff079315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:20:53.833151 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e19c17-5a09-4c01-aa11-6635ff079315 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:20:53.842758 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1326/2695] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:20:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:21:01.188485 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=6 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:03.838454 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=39 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:06.475004 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8334f3f-bb39-48bf-8cfd-762cab5c4945 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:06.542178 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8334f3f-bb39-48bf-8cfd-762cab5c4945 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:06.546666 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415eccf-fc24-4a72-982f-c1c317087fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:06.547305 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415eccf-fc24-4a72-982f-c1c317087fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:06.547578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415eccf-fc24-4a72-982f-c1c317087fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:06.547849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415eccf-fc24-4a72-982f-c1c317087fd5 admin admin] PATH_INFO: `/v3/users/6233035dafac451a8f5c905f64ceea4b` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:06.549569 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415eccf-fc24-4a72-982f-c1c317087fd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6233035dafac451a8f5c905f64ceea4b)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:06.551470 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415eccf-fc24-4a72-982f-c1c317087fd5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:06.601252 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f415eccf-fc24-4a72-982f-c1c317087fd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6233035dafac451a8f5c905f64ceea4b'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:06.601685 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f415eccf-fc24-4a72-982f-c1c317087fd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6233035dafac451a8f5c905f64ceea4b'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:06.609463 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f415eccf-fc24-4a72-982f-c1c317087fd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6233035dafac451a8f5c905f64ceea4b'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:06.622646 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f415eccf-fc24-4a72-982f-c1c317087fd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6233035dafac451a8f5c905f64ceea4b'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:06.630164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f415eccf-fc24-4a72-982f-c1c317087fd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6233035dafac451a8f5c905f64ceea4b'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:06.636200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1370/2696] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:21:06 2022] DELETE /identity/v3/users/6233035dafac451a8f5c905f64ceea4b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:06.640928 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fd59e-9310-47d4-8bb8-f6f9d049973c None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:06.642895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fd59e-9310-47d4-8bb8-f6f9d049973c None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:06.642895 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fd59e-9310-47d4-8bb8-f6f9d049973c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:06.661239 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-8d8fd59e-9310-47d4-8bb8-f6f9d049973c None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:06.662431 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-8d8fd59e-9310-47d4-8bb8-f6f9d049973c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:06.727649 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1327/2697] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:06.738845 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415eccf-fc24-4a72-982f-c1c317087fd5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:06.740289 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f415eccf-fc24-4a72-982f-c1c317087fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:06.797810 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415eccf-fc24-4a72-982f-c1c317087fd5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:06.802106 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07366d8a-70cf-4abe-af26-4ce80f4d6b36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:06.802719 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07366d8a-70cf-4abe-af26-4ce80f4d6b36 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:06.803003 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07366d8a-70cf-4abe-af26-4ce80f4d6b36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:06.803280 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07366d8a-70cf-4abe-af26-4ce80f4d6b36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:06.812544 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07366d8a-70cf-4abe-af26-4ce80f4d6b36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:06.814059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07366d8a-70cf-4abe-af26-4ce80f4d6b36 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:06.823779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1371/2698] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:21:07.110469 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fd59e-9310-47d4-8bb8-f6f9d049973c None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:07.112735 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-8d8fd59e-9310-47d4-8bb8-f6f9d049973c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:07.127748 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fd59e-9310-47d4-8bb8-f6f9d049973c None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:07.133481 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975f997-b031-4a65-bd83-338d9a041448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:07.134537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975f997-b031-4a65-bd83-338d9a041448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:07.135044 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975f997-b031-4a65-bd83-338d9a041448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:07.135511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975f997-b031-4a65-bd83-338d9a041448 admin admin] PATH_INFO: `/v3/projects/9b09ff41a0c34b608b6e79558a70a477` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:07.138885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975f997-b031-4a65-bd83-338d9a041448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b09ff41a0c34b608b6e79558a70a477)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:07.140005 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975f997-b031-4a65-bd83-338d9a041448 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:07.191645 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3975f997-b031-4a65-bd83-338d9a041448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b09ff41a0c34b608b6e79558a70a477', 'request_id': 'req-3975f997-b031-4a65-bd83-338d9a041448'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:07.198236 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3975f997-b031-4a65-bd83-338d9a041448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b09ff41a0c34b608b6e79558a70a477', 'request_id': 'req-3975f997-b031-4a65-bd83-338d9a041448'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:07.204839 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3975f997-b031-4a65-bd83-338d9a041448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b09ff41a0c34b608b6e79558a70a477', 'request_id': 'req-3975f997-b031-4a65-bd83-338d9a041448'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:07.220146 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3975f997-b031-4a65-bd83-338d9a041448 admin admin] The token cache is being invalidate because project 9b09ff41a0c34b608b6e79558a70a477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:21:07.220496 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3975f997-b031-4a65-bd83-338d9a041448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:07.221932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-3975f997-b031-4a65-bd83-338d9a041448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:07.223472 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1328/2699] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:21:07 2022] DELETE /identity/v3/projects/9b09ff41a0c34b608b6e79558a70a477 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:21:07.227624 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07366d8a-70cf-4abe-af26-4ce80f4d6b36 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:07.238004 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07366d8a-70cf-4abe-af26-4ce80f4d6b36 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:07.256545 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:07.298485 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e790761-54af-4fd2-98a5-bd7e382bf05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:07.299195 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e790761-54af-4fd2-98a5-bd7e382bf05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:07.299704 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e790761-54af-4fd2-98a5-bd7e382bf05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:07.300171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e790761-54af-4fd2-98a5-bd7e382bf05a admin admin] PATH_INFO: `/v3/users/bed14858fec84f6d9a7c5b2a3cf492cb` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:07.301443 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e790761-54af-4fd2-98a5-bd7e382bf05a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed14858fec84f6d9a7c5b2a3cf492cb)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:07.303422 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e790761-54af-4fd2-98a5-bd7e382bf05a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:07.353797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8e790761-54af-4fd2-98a5-bd7e382bf05a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed14858fec84f6d9a7c5b2a3cf492cb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:07.354526 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8e790761-54af-4fd2-98a5-bd7e382bf05a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed14858fec84f6d9a7c5b2a3cf492cb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:07.364429 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8e790761-54af-4fd2-98a5-bd7e382bf05a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed14858fec84f6d9a7c5b2a3cf492cb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:07.376601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8e790761-54af-4fd2-98a5-bd7e382bf05a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed14858fec84f6d9a7c5b2a3cf492cb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:07.385186 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-8e790761-54af-4fd2-98a5-bd7e382bf05a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed14858fec84f6d9a7c5b2a3cf492cb'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:07.391349 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1372/2700] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:21:07 2022] DELETE /identity/v3/users/bed14858fec84f6d9a7c5b2a3cf492cb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:07.696005 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975f997-b031-4a65-bd83-338d9a041448 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:07.698121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-3975f997-b031-4a65-bd83-338d9a041448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:07.712872 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975f997-b031-4a65-bd83-338d9a041448 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:07.781753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827410b4-ea33-4916-beac-d8f52e70ee4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:07.782339 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827410b4-ea33-4916-beac-d8f52e70ee4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:07.782715 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827410b4-ea33-4916-beac-d8f52e70ee4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:07.782981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827410b4-ea33-4916-beac-d8f52e70ee4c admin admin] PATH_INFO: `/v3/projects/51e1740bf19e44ec921999dd545d573b` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:07.784718 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827410b4-ea33-4916-beac-d8f52e70ee4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=51e1740bf19e44ec921999dd545d573b)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:07.787306 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827410b4-ea33-4916-beac-d8f52e70ee4c admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:07.823691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:07.846226 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-827410b4-ea33-4916-beac-d8f52e70ee4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51e1740bf19e44ec921999dd545d573b', 'request_id': 'req-827410b4-ea33-4916-beac-d8f52e70ee4c'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:07.852355 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-827410b4-ea33-4916-beac-d8f52e70ee4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51e1740bf19e44ec921999dd545d573b', 'request_id': 'req-827410b4-ea33-4916-beac-d8f52e70ee4c'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:07.861000 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-827410b4-ea33-4916-beac-d8f52e70ee4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51e1740bf19e44ec921999dd545d573b', 'request_id': 'req-827410b4-ea33-4916-beac-d8f52e70ee4c'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:07.878343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-827410b4-ea33-4916-beac-d8f52e70ee4c admin admin] The token cache is being invalidate because project 51e1740bf19e44ec921999dd545d573b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:21:07.878746 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-827410b4-ea33-4916-beac-d8f52e70ee4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:07.879610 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-827410b4-ea33-4916-beac-d8f52e70ee4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:07.881866 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1329/2701] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:21:07 2022] DELETE /identity/v3/projects/51e1740bf19e44ec921999dd545d573b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:07.888500 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c59a73-1f38-4f87-9605-f68bf694360f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:07.889042 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c59a73-1f38-4f87-9605-f68bf694360f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:07.889240 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c59a73-1f38-4f87-9605-f68bf694360f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:07.913316 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f1c59a73-1f38-4f87-9605-f68bf694360f None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:07.914580 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f1c59a73-1f38-4f87-9605-f68bf694360f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:07.981072 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1373/2702] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:07.990768 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278382a-20e8-4472-92a7-38bec5bececa None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:07.991056 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278382a-20e8-4472-92a7-38bec5bececa None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:07.991373 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278382a-20e8-4472-92a7-38bec5bececa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:08.013127 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-2278382a-20e8-4472-92a7-38bec5bececa None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:08.014337 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2278382a-20e8-4472-92a7-38bec5bececa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:08.023298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1330/2703] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:08.028234 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c59a73-1f38-4f87-9605-f68bf694360f None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:08.039644 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c59a73-1f38-4f87-9605-f68bf694360f None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:08.044496 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad2d63-06c4-4d34-be46-5c075b3ebcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:08.045097 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad2d63-06c4-4d34-be46-5c075b3ebcf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:08.045430 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad2d63-06c4-4d34-be46-5c075b3ebcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:08.045650 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad2d63-06c4-4d34-be46-5c075b3ebcf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:08.046379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad2d63-06c4-4d34-be46-5c075b3ebcf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:21:08.046605 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad2d63-06c4-4d34-be46-5c075b3ebcf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:08.048222 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad2d63-06c4-4d34-be46-5c075b3ebcf5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:08.060222 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1374/2704] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:21:08.065400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278382a-20e8-4472-92a7-38bec5bececa None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:08.075683 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278382a-20e8-4472-92a7-38bec5bececa None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:08.080874 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d392bfd-3881-4280-a51d-47751dfa5d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:08.081520 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d392bfd-3881-4280-a51d-47751dfa5d5c admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:08.081841 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d392bfd-3881-4280-a51d-47751dfa5d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:08.082116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d392bfd-3881-4280-a51d-47751dfa5d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:08.082849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d392bfd-3881-4280-a51d-47751dfa5d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:08.085005 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d392bfd-3881-4280-a51d-47751dfa5d5c admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:08.129217 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1331/2705] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:21:08 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:21:08.133685 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad2d63-06c4-4d34-be46-5c075b3ebcf5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:08.145348 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad2d63-06c4-4d34-be46-5c075b3ebcf5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:08.175777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:08.214439 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d83b5e-9d2f-4b5b-86ac-9b347635048a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:08.215102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d83b5e-9d2f-4b5b-86ac-9b347635048a admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:08.215435 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d83b5e-9d2f-4b5b-86ac-9b347635048a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:08.215750 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d83b5e-9d2f-4b5b-86ac-9b347635048a admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:08.216566 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d83b5e-9d2f-4b5b-86ac-9b347635048a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:08.221086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d83b5e-9d2f-4b5b-86ac-9b347635048a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:08.246792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1375/2706] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:21:08 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:21:08.251443 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d392bfd-3881-4280-a51d-47751dfa5d5c admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:08.264039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d392bfd-3881-4280-a51d-47751dfa5d5c admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:08.269407 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac9180-5dfd-4905-a0d9-e97fca591cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:08.270091 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac9180-5dfd-4905-a0d9-e97fca591cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:08.270447 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac9180-5dfd-4905-a0d9-e97fca591cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:08.270773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac9180-5dfd-4905-a0d9-e97fca591cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:08.271543 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac9180-5dfd-4905-a0d9-e97fca591cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:08.273438 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac9180-5dfd-4905-a0d9-e97fca591cd4 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:08.285474 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1332/2707] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:08.293421 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d83b5e-9d2f-4b5b-86ac-9b347635048a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:08.307308 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d83b5e-9d2f-4b5b-86ac-9b347635048a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:08.312071 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8569e9f-87ad-4a6b-909e-5909df150584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:08.312712 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8569e9f-87ad-4a6b-909e-5909df150584 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:08.312996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8569e9f-87ad-4a6b-909e-5909df150584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:08.313273 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8569e9f-87ad-4a6b-909e-5909df150584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:08.313974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8569e9f-87ad-4a6b-909e-5909df150584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:08.315622 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8569e9f-87ad-4a6b-909e-5909df150584 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:08.325780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1376/2708] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:08.330052 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac9180-5dfd-4905-a0d9-e97fca591cd4 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:08.340168 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac9180-5dfd-4905-a0d9-e97fca591cd4 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:08.344836 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6bde4-24ad-4bb2-9e89-beb264c25fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:08.345495 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6bde4-24ad-4bb2-9e89-beb264c25fed admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:08.346452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6bde4-24ad-4bb2-9e89-beb264c25fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:08.346969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6bde4-24ad-4bb2-9e89-beb264c25fed admin admin] PATH_INFO: `/v3/projects/90388da944854683b4a1e84f5ffee516/users/f77636d3b5914a06b38a2b7e7e3638b7/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:08.363092 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6bde4-24ad-4bb2-9e89-beb264c25fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=90388da944854683b4a1e84f5ffee516, user_id=f77636d3b5914a06b38a2b7e7e3638b7, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:08.365808 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6bde4-24ad-4bb2-9e89-beb264c25fed admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:08.379491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1333/2709] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:08 2022] PUT /identity/v3/projects/90388da944854683b4a1e84f5ffee516/users/f77636d3b5914a06b38a2b7e7e3638b7/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:08.391050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692563c4-1df2-481e-a090-84353b13f6a8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:08.391335 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692563c4-1df2-481e-a090-84353b13f6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:08.391604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692563c4-1df2-481e-a090-84353b13f6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:08.420137 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-692563c4-1df2-481e-a090-84353b13f6a8 None None] MFA Rules not processed for user `f77636d3b5914a06b38a2b7e7e3638b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:08.421384 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-692563c4-1df2-481e-a090-84353b13f6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:08.487905 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1377/2710] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:08.492666 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6bde4-24ad-4bb2-9e89-beb264c25fed admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:08.558429 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6bde4-24ad-4bb2-9e89-beb264c25fed admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:08.563149 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af20ab5-8994-484f-a115-366e07412a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:08.563766 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af20ab5-8994-484f-a115-366e07412a9a admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:08.564049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af20ab5-8994-484f-a115-366e07412a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:08.564327 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af20ab5-8994-484f-a115-366e07412a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:08.565802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af20ab5-8994-484f-a115-366e07412a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:08.567707 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af20ab5-8994-484f-a115-366e07412a9a admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:08.593927 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1334/2711] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:21:08 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:21:08.598270 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692563c4-1df2-481e-a090-84353b13f6a8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:08.609341 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692563c4-1df2-481e-a090-84353b13f6a8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:08.667829 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae841e-b373-4d58-9c49-77597c5e8a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:08.668445 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae841e-b373-4d58-9c49-77597c5e8a4e admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:08.668754 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae841e-b373-4d58-9c49-77597c5e8a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:08.669023 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae841e-b373-4d58-9c49-77597c5e8a4e admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:08.669693 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae841e-b373-4d58-9c49-77597c5e8a4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:08.671611 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae841e-b373-4d58-9c49-77597c5e8a4e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:08.697462 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1378/2712] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:21:08 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:21:08.698639 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af20ab5-8994-484f-a115-366e07412a9a admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:08.709559 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af20ab5-8994-484f-a115-366e07412a9a admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:08.714125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66bee9-1612-4f6d-864c-dc6e0249977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:08.714822 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66bee9-1612-4f6d-864c-dc6e0249977c admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:08.715102 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66bee9-1612-4f6d-864c-dc6e0249977c admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:08.715375 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66bee9-1612-4f6d-864c-dc6e0249977c admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:08.716075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66bee9-1612-4f6d-864c-dc6e0249977c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:08.717691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66bee9-1612-4f6d-864c-dc6e0249977c admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:08.728684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1335/2713] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:08.732804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae841e-b373-4d58-9c49-77597c5e8a4e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:08.743880 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae841e-b373-4d58-9c49-77597c5e8a4e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:08.748454 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060d041-ff3f-46fd-830a-8771a9060f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:08.749138 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060d041-ff3f-46fd-830a-8771a9060f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:08.749414 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060d041-ff3f-46fd-830a-8771a9060f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:08.749685 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060d041-ff3f-46fd-830a-8771a9060f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:08.750377 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060d041-ff3f-46fd-830a-8771a9060f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:08.752588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060d041-ff3f-46fd-830a-8771a9060f73 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:08.763116 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1379/2714] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:08.767351 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66bee9-1612-4f6d-864c-dc6e0249977c admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:08.777697 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66bee9-1612-4f6d-864c-dc6e0249977c admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:08.782362 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890f7e6-0033-4cc4-a864-dd7d4da6614f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:08.783024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890f7e6-0033-4cc4-a864-dd7d4da6614f admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:08.783355 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890f7e6-0033-4cc4-a864-dd7d4da6614f admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:08.783835 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890f7e6-0033-4cc4-a864-dd7d4da6614f admin admin] PATH_INFO: `/v3/projects/2c7e13d7872742a396e819470e7b4866/users/4a942ef774c14cb68864d8be6aa16c48/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:08.795989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:08.800554 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890f7e6-0033-4cc4-a864-dd7d4da6614f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c7e13d7872742a396e819470e7b4866, user_id=4a942ef774c14cb68864d8be6aa16c48, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:08.804147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890f7e6-0033-4cc4-a864-dd7d4da6614f admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:08.821652 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1336/2715] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:08 2022] PUT /identity/v3/projects/2c7e13d7872742a396e819470e7b4866/users/4a942ef774c14cb68864d8be6aa16c48/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:08.887696 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462653d3-5bf7-43ab-87de-04d585915988 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:08.888025 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462653d3-5bf7-43ab-87de-04d585915988 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:08.888305 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462653d3-5bf7-43ab-87de-04d585915988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:08.916608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-462653d3-5bf7-43ab-87de-04d585915988 None None] MFA Rules not processed for user `4a942ef774c14cb68864d8be6aa16c48`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:08.917842 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-462653d3-5bf7-43ab-87de-04d585915988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:08.922269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:08.987523 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1380/2716] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:08.992072 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890f7e6-0033-4cc4-a864-dd7d4da6614f admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:09.059188 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890f7e6-0033-4cc4-a864-dd7d4da6614f admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:09.063934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568bfdd-6f32-410a-bc90-cf0c4e2bc06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:09.065132 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568bfdd-6f32-410a-bc90-cf0c4e2bc06e admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:09.065412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568bfdd-6f32-410a-bc90-cf0c4e2bc06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:09.065704 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568bfdd-6f32-410a-bc90-cf0c4e2bc06e admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:09.066458 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568bfdd-6f32-410a-bc90-cf0c4e2bc06e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:09.068358 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568bfdd-6f32-410a-bc90-cf0c4e2bc06e admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:09.098728 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1337/2717] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:21:08 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:21:09.099967 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462653d3-5bf7-43ab-87de-04d585915988 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:09.112142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462653d3-5bf7-43ab-87de-04d585915988 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:09.193268 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92de419-a350-4259-8732-7190ed07ca3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:09.193891 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92de419-a350-4259-8732-7190ed07ca3c admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:09.194173 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92de419-a350-4259-8732-7190ed07ca3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:09.194446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92de419-a350-4259-8732-7190ed07ca3c admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:09.195126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92de419-a350-4259-8732-7190ed07ca3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:09.197090 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92de419-a350-4259-8732-7190ed07ca3c admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:09.219832 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1381/2718] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:21:09 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:21:09.223726 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568bfdd-6f32-410a-bc90-cf0c4e2bc06e admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:09.234058 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568bfdd-6f32-410a-bc90-cf0c4e2bc06e admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:09.239818 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e99bb-91fb-4032-93c1-c228cc9abc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:09.240431 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e99bb-91fb-4032-93c1-c228cc9abc17 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:09.240742 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e99bb-91fb-4032-93c1-c228cc9abc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:09.241016 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e99bb-91fb-4032-93c1-c228cc9abc17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:09.241709 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e99bb-91fb-4032-93c1-c228cc9abc17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:09.243298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e99bb-91fb-4032-93c1-c228cc9abc17 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:09.255075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1338/2719] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:09.259322 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92de419-a350-4259-8732-7190ed07ca3c admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:09.269599 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92de419-a350-4259-8732-7190ed07ca3c admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:09.274222 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db82654-e46a-487e-9220-b263be1fdf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:09.274929 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db82654-e46a-487e-9220-b263be1fdf0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:09.275210 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db82654-e46a-487e-9220-b263be1fdf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:09.275480 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db82654-e46a-487e-9220-b263be1fdf0f admin admin] PATH_INFO: `/v3/projects/618ee2ddb17f4e7ca8da247096f3279b/users/eb9a3e97b65f4dd3ada54f474e9323d3/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:09.293809 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db82654-e46a-487e-9220-b263be1fdf0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=618ee2ddb17f4e7ca8da247096f3279b, user_id=eb9a3e97b65f4dd3ada54f474e9323d3, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:09.294817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db82654-e46a-487e-9220-b263be1fdf0f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:09.311893 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1382/2720] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:09 2022] PUT /identity/v3/projects/618ee2ddb17f4e7ca8da247096f3279b/users/eb9a3e97b65f4dd3ada54f474e9323d3/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:09.316993 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e99bb-91fb-4032-93c1-c228cc9abc17 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:09.327471 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e99bb-91fb-4032-93c1-c228cc9abc17 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:09.387289 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5422d-00bd-4f9c-856a-a436319ab874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:09.387824 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5422d-00bd-4f9c-856a-a436319ab874 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:09.388115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5422d-00bd-4f9c-856a-a436319ab874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:09.388390 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5422d-00bd-4f9c-856a-a436319ab874 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:09.389318 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5422d-00bd-4f9c-856a-a436319ab874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:09.390720 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5422d-00bd-4f9c-856a-a436319ab874 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:09.404621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1339/2721] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:09.407225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db82654-e46a-487e-9220-b263be1fdf0f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:09.418419 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db82654-e46a-487e-9220-b263be1fdf0f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:09.423201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4785405-1dc2-49d6-a617-1011a29123a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:09.424383 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4785405-1dc2-49d6-a617-1011a29123a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:09.424707 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4785405-1dc2-49d6-a617-1011a29123a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:09.424986 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4785405-1dc2-49d6-a617-1011a29123a7 admin admin] PATH_INFO: `/v3/projects/618ee2ddb17f4e7ca8da247096f3279b/users/eb9a3e97b65f4dd3ada54f474e9323d3/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:09.427027 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4785405-1dc2-49d6-a617-1011a29123a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=618ee2ddb17f4e7ca8da247096f3279b, user_id=eb9a3e97b65f4dd3ada54f474e9323d3, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:09.429724 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4785405-1dc2-49d6-a617-1011a29123a7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:09.441410 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1383/2722] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:09 2022] PUT /identity/v3/projects/618ee2ddb17f4e7ca8da247096f3279b/users/eb9a3e97b65f4dd3ada54f474e9323d3/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:09.451901 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd1b99-af6e-40fd-a31e-7f01fda90a23 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:09.452256 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd1b99-af6e-40fd-a31e-7f01fda90a23 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:09.452506 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd1b99-af6e-40fd-a31e-7f01fda90a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:09.481363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-33bd1b99-af6e-40fd-a31e-7f01fda90a23 None None] MFA Rules not processed for user `eb9a3e97b65f4dd3ada54f474e9323d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:09.482586 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-33bd1b99-af6e-40fd-a31e-7f01fda90a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:09.536934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:09.563618 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1340/2723] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:09.576695 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4785405-1dc2-49d6-a617-1011a29123a7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:09.578358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e4785405-1dc2-49d6-a617-1011a29123a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:09.639752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4785405-1dc2-49d6-a617-1011a29123a7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:09.643608 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa88ab-f7b8-4367-abf1-6b350f9eebe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:09.644234 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa88ab-f7b8-4367-abf1-6b350f9eebe9 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:09.644537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa88ab-f7b8-4367-abf1-6b350f9eebe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:09.644811 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa88ab-f7b8-4367-abf1-6b350f9eebe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:09.653946 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa88ab-f7b8-4367-abf1-6b350f9eebe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:09.655366 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa88ab-f7b8-4367-abf1-6b350f9eebe9 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:09.661173 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:09.667011 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1384/2724] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:21:10.214058 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd1b99-af6e-40fd-a31e-7f01fda90a23 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:10.215681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-33bd1b99-af6e-40fd-a31e-7f01fda90a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:10.229116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd1b99-af6e-40fd-a31e-7f01fda90a23 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:10.232764 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192986e-5d25-41f7-a6f6-34a5e2685d34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:10.233390 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192986e-5d25-41f7-a6f6-34a5e2685d34 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:10.233676 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192986e-5d25-41f7-a6f6-34a5e2685d34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:10.233958 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192986e-5d25-41f7-a6f6-34a5e2685d34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:10.293232 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192986e-5d25-41f7-a6f6-34a5e2685d34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:10.294685 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192986e-5d25-41f7-a6f6-34a5e2685d34 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:10.304899 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1341/2725] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:21:14.439745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa88ab-f7b8-4367-abf1-6b350f9eebe9 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:14.449743 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa88ab-f7b8-4367-abf1-6b350f9eebe9 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:14.455858 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564710f-2dff-473e-8d50-3985d2851073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:14.456921 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564710f-2dff-473e-8d50-3985d2851073 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:14.457420 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564710f-2dff-473e-8d50-3985d2851073 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:14.457896 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564710f-2dff-473e-8d50-3985d2851073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:14.538592 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564710f-2dff-473e-8d50-3985d2851073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:14.540023 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564710f-2dff-473e-8d50-3985d2851073 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:14.549163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1385/2726] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:21:16.744828 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192986e-5d25-41f7-a6f6-34a5e2685d34 service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:16.823461 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192986e-5d25-41f7-a6f6-34a5e2685d34 service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:16.828486 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7037b9-230c-4ac0-92f5-b7711662dd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:16.829425 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7037b9-230c-4ac0-92f5-b7711662dd86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:16.829843 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7037b9-230c-4ac0-92f5-b7711662dd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:16.830221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7037b9-230c-4ac0-92f5-b7711662dd86 admin admin] PATH_INFO: `/v3/users/f77636d3b5914a06b38a2b7e7e3638b7` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:16.831572 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7037b9-230c-4ac0-92f5-b7711662dd86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f77636d3b5914a06b38a2b7e7e3638b7)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:16.833549 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7037b9-230c-4ac0-92f5-b7711662dd86 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:16.891528 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-cc7037b9-230c-4ac0-92f5-b7711662dd86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f77636d3b5914a06b38a2b7e7e3638b7'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:16.892204 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-cc7037b9-230c-4ac0-92f5-b7711662dd86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f77636d3b5914a06b38a2b7e7e3638b7'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:16.906779 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-cc7037b9-230c-4ac0-92f5-b7711662dd86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f77636d3b5914a06b38a2b7e7e3638b7'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:16.915231 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-cc7037b9-230c-4ac0-92f5-b7711662dd86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f77636d3b5914a06b38a2b7e7e3638b7'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:16.915862 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-cc7037b9-230c-4ac0-92f5-b7711662dd86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f77636d3b5914a06b38a2b7e7e3638b7'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:16.930775 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1342/2727] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:21:16 2022] DELETE /identity/v3/users/f77636d3b5914a06b38a2b7e7e3638b7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:16.935437 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036e5e1-f049-47cd-ba3f-36b47db1968b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:16.936150 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036e5e1-f049-47cd-ba3f-36b47db1968b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:16.936150 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1036e5e1-f049-47cd-ba3f-36b47db1968b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:16.957774 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-1036e5e1-f049-47cd-ba3f-36b47db1968b None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:16.959015 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1036e5e1-f049-47cd-ba3f-36b47db1968b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:17.025647 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1386/2728] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:17.037148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7037b9-230c-4ac0-92f5-b7711662dd86 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:17.038684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-cc7037b9-230c-4ac0-92f5-b7711662dd86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:17.047904 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:17.108745 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7037b9-230c-4ac0-92f5-b7711662dd86 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:17.113963 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a4696-4a8a-472d-a113-9d0484cd8877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:17.114593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a4696-4a8a-472d-a113-9d0484cd8877 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:17.114973 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a4696-4a8a-472d-a113-9d0484cd8877 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:17.115229 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a4696-4a8a-472d-a113-9d0484cd8877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:17.125807 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a4696-4a8a-472d-a113-9d0484cd8877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:17.127453 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a4696-4a8a-472d-a113-9d0484cd8877 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:17.138515 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1343/2729] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:21:17.452543 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036e5e1-f049-47cd-ba3f-36b47db1968b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:17.454517 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-1036e5e1-f049-47cd-ba3f-36b47db1968b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:17.470147 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1036e5e1-f049-47cd-ba3f-36b47db1968b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:17.478705 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a321deb-8393-4649-a1cf-74849d532da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:17.479465 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a321deb-8393-4649-a1cf-74849d532da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:17.479754 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a321deb-8393-4649-a1cf-74849d532da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:17.480118 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a321deb-8393-4649-a1cf-74849d532da2 admin admin] PATH_INFO: `/v3/projects/90388da944854683b4a1e84f5ffee516` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:17.481463 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a321deb-8393-4649-a1cf-74849d532da2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90388da944854683b4a1e84f5ffee516)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:17.483459 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a321deb-8393-4649-a1cf-74849d532da2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:17.549862 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4a321deb-8393-4649-a1cf-74849d532da2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90388da944854683b4a1e84f5ffee516', 'request_id': 'req-4a321deb-8393-4649-a1cf-74849d532da2'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:17.558867 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4a321deb-8393-4649-a1cf-74849d532da2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90388da944854683b4a1e84f5ffee516', 'request_id': 'req-4a321deb-8393-4649-a1cf-74849d532da2'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:17.566654 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4a321deb-8393-4649-a1cf-74849d532da2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90388da944854683b4a1e84f5ffee516', 'request_id': 'req-4a321deb-8393-4649-a1cf-74849d532da2'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:17.581362 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4a321deb-8393-4649-a1cf-74849d532da2 admin admin] The token cache is being invalidate because project 90388da944854683b4a1e84f5ffee516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:21:17.581643 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4a321deb-8393-4649-a1cf-74849d532da2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:17.582318 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4a321deb-8393-4649-a1cf-74849d532da2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:17.583961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1387/2730] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:21:17 2022] DELETE /identity/v3/projects/90388da944854683b4a1e84f5ffee516 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:17.587981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a4696-4a8a-472d-a113-9d0484cd8877 service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:17.600186 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a4696-4a8a-472d-a113-9d0484cd8877 service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:17.695240 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94026a-930a-4f21-990a-2b9d60a269f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:17.696744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94026a-930a-4f21-990a-2b9d60a269f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:17.696744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94026a-930a-4f21-990a-2b9d60a269f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:17.696744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94026a-930a-4f21-990a-2b9d60a269f3 admin admin] PATH_INFO: `/v3/users/4a942ef774c14cb68864d8be6aa16c48` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:17.697375 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94026a-930a-4f21-990a-2b9d60a269f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a942ef774c14cb68864d8be6aa16c48)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:17.699510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94026a-930a-4f21-990a-2b9d60a269f3 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:17.775077 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-1a94026a-930a-4f21-990a-2b9d60a269f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a942ef774c14cb68864d8be6aa16c48'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:17.776647 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-1a94026a-930a-4f21-990a-2b9d60a269f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a942ef774c14cb68864d8be6aa16c48'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:17.810508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-1a94026a-930a-4f21-990a-2b9d60a269f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a942ef774c14cb68864d8be6aa16c48'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:17.819465 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-1a94026a-930a-4f21-990a-2b9d60a269f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a942ef774c14cb68864d8be6aa16c48'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:17.820412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-1a94026a-930a-4f21-990a-2b9d60a269f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a942ef774c14cb68864d8be6aa16c48'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:17.836450 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1344/2731] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:21:17 2022] DELETE /identity/v3/users/4a942ef774c14cb68864d8be6aa16c48 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:18.610037 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a321deb-8393-4649-a1cf-74849d532da2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:18.612753 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4a321deb-8393-4649-a1cf-74849d532da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:18.642672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a321deb-8393-4649-a1cf-74849d532da2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:18.698730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:18.758833 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed27d1a-87f0-4474-9640-81abdffa9810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:18.760101 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed27d1a-87f0-4474-9640-81abdffa9810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:18.760373 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed27d1a-87f0-4474-9640-81abdffa9810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:18.760684 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed27d1a-87f0-4474-9640-81abdffa9810 admin admin] PATH_INFO: `/v3/projects/2c7e13d7872742a396e819470e7b4866` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:18.761914 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed27d1a-87f0-4474-9640-81abdffa9810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c7e13d7872742a396e819470e7b4866)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:18.763827 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed27d1a-87f0-4474-9640-81abdffa9810 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:18.823102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fed27d1a-87f0-4474-9640-81abdffa9810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c7e13d7872742a396e819470e7b4866', 'request_id': 'req-fed27d1a-87f0-4474-9640-81abdffa9810'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:18.829548 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fed27d1a-87f0-4474-9640-81abdffa9810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c7e13d7872742a396e819470e7b4866', 'request_id': 'req-fed27d1a-87f0-4474-9640-81abdffa9810'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:18.835523 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fed27d1a-87f0-4474-9640-81abdffa9810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c7e13d7872742a396e819470e7b4866', 'request_id': 'req-fed27d1a-87f0-4474-9640-81abdffa9810'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:18.851238 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fed27d1a-87f0-4474-9640-81abdffa9810 admin admin] The token cache is being invalidate because project 2c7e13d7872742a396e819470e7b4866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:21:18.851611 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fed27d1a-87f0-4474-9640-81abdffa9810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:18.852883 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-fed27d1a-87f0-4474-9640-81abdffa9810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:18.856299 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1388/2732] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:21:18 2022] DELETE /identity/v3/projects/2c7e13d7872742a396e819470e7b4866 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:18.858413 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94026a-930a-4f21-990a-2b9d60a269f3 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:18.859862 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-1a94026a-930a-4f21-990a-2b9d60a269f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:18.873999 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94026a-930a-4f21-990a-2b9d60a269f3 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:18.904395 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:18.957519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08870c3-7a8e-41a6-ac4f-a1099f2c4584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:18.957980 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08870c3-7a8e-41a6-ac4f-a1099f2c4584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:18.958858 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08870c3-7a8e-41a6-ac4f-a1099f2c4584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:18.958858 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08870c3-7a8e-41a6-ac4f-a1099f2c4584 admin admin] PATH_INFO: `/v3/users/eb9a3e97b65f4dd3ada54f474e9323d3` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:18.959791 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08870c3-7a8e-41a6-ac4f-a1099f2c4584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb9a3e97b65f4dd3ada54f474e9323d3)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:18.961755 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08870c3-7a8e-41a6-ac4f-a1099f2c4584 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:19.026773 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f08870c3-7a8e-41a6-ac4f-a1099f2c4584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb9a3e97b65f4dd3ada54f474e9323d3'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:19.027571 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f08870c3-7a8e-41a6-ac4f-a1099f2c4584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb9a3e97b65f4dd3ada54f474e9323d3'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:19.046540 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f08870c3-7a8e-41a6-ac4f-a1099f2c4584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb9a3e97b65f4dd3ada54f474e9323d3'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:19.057175 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f08870c3-7a8e-41a6-ac4f-a1099f2c4584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb9a3e97b65f4dd3ada54f474e9323d3'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:19.058251 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f08870c3-7a8e-41a6-ac4f-a1099f2c4584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb9a3e97b65f4dd3ada54f474e9323d3'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:19.077278 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1345/2733] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:21:18 2022] DELETE /identity/v3/users/eb9a3e97b65f4dd3ada54f474e9323d3 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:21:19.497415 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed27d1a-87f0-4474-9640-81abdffa9810 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:19.500366 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fed27d1a-87f0-4474-9640-81abdffa9810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:19.523880 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed27d1a-87f0-4474-9640-81abdffa9810 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:19.618215 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605e6fb-42dd-44ed-a1dc-110833eea7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:19.619626 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605e6fb-42dd-44ed-a1dc-110833eea7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:19.619964 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605e6fb-42dd-44ed-a1dc-110833eea7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:19.620245 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605e6fb-42dd-44ed-a1dc-110833eea7a9 admin admin] PATH_INFO: `/v3/projects/618ee2ddb17f4e7ca8da247096f3279b` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:19.621560 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605e6fb-42dd-44ed-a1dc-110833eea7a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=618ee2ddb17f4e7ca8da247096f3279b)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:19.623780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605e6fb-42dd-44ed-a1dc-110833eea7a9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:19.685916 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4605e6fb-42dd-44ed-a1dc-110833eea7a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '618ee2ddb17f4e7ca8da247096f3279b', 'request_id': 'req-4605e6fb-42dd-44ed-a1dc-110833eea7a9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:19.698421 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4605e6fb-42dd-44ed-a1dc-110833eea7a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '618ee2ddb17f4e7ca8da247096f3279b', 'request_id': 'req-4605e6fb-42dd-44ed-a1dc-110833eea7a9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:19.699984 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:19.711432 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4605e6fb-42dd-44ed-a1dc-110833eea7a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '618ee2ddb17f4e7ca8da247096f3279b', 'request_id': 'req-4605e6fb-42dd-44ed-a1dc-110833eea7a9'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:19.734073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4605e6fb-42dd-44ed-a1dc-110833eea7a9 admin admin] The token cache is being invalidate because project 618ee2ddb17f4e7ca8da247096f3279b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:21:19.734472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4605e6fb-42dd-44ed-a1dc-110833eea7a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:19.735530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4605e6fb-42dd-44ed-a1dc-110833eea7a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:19.744434 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1389/2734] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:21:19 2022] DELETE /identity/v3/projects/618ee2ddb17f4e7ca8da247096f3279b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:19.747510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b56e2-fbe1-47bd-9f45-508f36ec74cc None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:19.747510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b56e2-fbe1-47bd-9f45-508f36ec74cc None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:19.747510 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b56e2-fbe1-47bd-9f45-508f36ec74cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:19.774202 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-6c3b56e2-fbe1-47bd-9f45-508f36ec74cc None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:19.776093 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-6c3b56e2-fbe1-47bd-9f45-508f36ec74cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:19.864226 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1346/2735] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:19.875310 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931015f6-a484-4be0-ac6b-82877c2cdfe7 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:19.875790 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931015f6-a484-4be0-ac6b-82877c2cdfe7 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:19.876340 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931015f6-a484-4be0-ac6b-82877c2cdfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:19.904174 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-931015f6-a484-4be0-ac6b-82877c2cdfe7 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:19.905588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-931015f6-a484-4be0-ac6b-82877c2cdfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:19.928717 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1390/2736] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:19.933391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b56e2-fbe1-47bd-9f45-508f36ec74cc None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:19.948267 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b56e2-fbe1-47bd-9f45-508f36ec74cc None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:19.963616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931015f6-a484-4be0-ac6b-82877c2cdfe7 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:19.967641 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-931015f6-a484-4be0-ac6b-82877c2cdfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:19.972431 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1da93-4b56-4a2d-a533-cba890bf937c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:19.974264 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1da93-4b56-4a2d-a533-cba890bf937c admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:19.980178 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1da93-4b56-4a2d-a533-cba890bf937c admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:19.980584 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1da93-4b56-4a2d-a533-cba890bf937c admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:19.981449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1da93-4b56-4a2d-a533-cba890bf937c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:21:19.981989 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1da93-4b56-4a2d-a533-cba890bf937c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:19.983814 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1da93-4b56-4a2d-a533-cba890bf937c admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:19.987235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931015f6-a484-4be0-ac6b-82877c2cdfe7 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:19.993155 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532e459-3bd4-498d-990c-006482b6bc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:19.993700 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532e459-3bd4-498d-990c-006482b6bc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:19.994056 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532e459-3bd4-498d-990c-006482b6bc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:19.994593 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532e459-3bd4-498d-990c-006482b6bc9e admin admin] PATH_INFO: `/v3/users/4b6f36b8484440ccbb4f703884717bd4` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:19.996105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532e459-3bd4-498d-990c-006482b6bc9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b6f36b8484440ccbb4f703884717bd4)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:19.998913 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532e459-3bd4-498d-990c-006482b6bc9e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:20.011516 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1347/2737] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:21:20.023495 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1da93-4b56-4a2d-a533-cba890bf937c admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:20.040176 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1da93-4b56-4a2d-a533-cba890bf937c admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:20.046802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a9078-18f7-49af-9c0a-4c54e4d9816f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:20.047623 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a9078-18f7-49af-9c0a-4c54e4d9816f admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:20.048943 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a9078-18f7-49af-9c0a-4c54e4d9816f admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:20.048943 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a9078-18f7-49af-9c0a-4c54e4d9816f admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:20.050328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a9078-18f7-49af-9c0a-4c54e4d9816f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:20.052588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a9078-18f7-49af-9c0a-4c54e4d9816f admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:20.075311 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6532e459-3bd4-498d-990c-006482b6bc9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b6f36b8484440ccbb4f703884717bd4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:20.076086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6532e459-3bd4-498d-990c-006482b6bc9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b6f36b8484440ccbb4f703884717bd4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:20.084602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6532e459-3bd4-498d-990c-006482b6bc9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b6f36b8484440ccbb4f703884717bd4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:20.087627 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1348/2738] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:21:20 2022] POST /identity/v3/projects => generated 393 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:21:20.091996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a9078-18f7-49af-9c0a-4c54e4d9816f admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:20.103591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6532e459-3bd4-498d-990c-006482b6bc9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b6f36b8484440ccbb4f703884717bd4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:20.109074 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:20.114854 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-6532e459-3bd4-498d-990c-006482b6bc9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b6f36b8484440ccbb4f703884717bd4'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:20.125983 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1391/2739] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:21:19 2022] DELETE /identity/v3/users/4b6f36b8484440ccbb4f703884717bd4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:20.175816 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a9078-18f7-49af-9c0a-4c54e4d9816f admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:20.245032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859593b-a17c-48d0-a483-53588646203a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:20.245668 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859593b-a17c-48d0-a483-53588646203a admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:20.245947 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859593b-a17c-48d0-a483-53588646203a admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:20.246223 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859593b-a17c-48d0-a483-53588646203a admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:20.246931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859593b-a17c-48d0-a483-53588646203a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:20.248938 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859593b-a17c-48d0-a483-53588646203a admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:20.275756 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1349/2740] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:21:20 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:21:20.280118 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532e459-3bd4-498d-990c-006482b6bc9e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:20.281634 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6532e459-3bd4-498d-990c-006482b6bc9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:20.303887 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532e459-3bd4-498d-990c-006482b6bc9e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:20.308970 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bc0ae-cb71-4430-8db3-875e530e1d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:20.309602 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bc0ae-cb71-4430-8db3-875e530e1d56 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:20.310164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bc0ae-cb71-4430-8db3-875e530e1d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:20.310445 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bc0ae-cb71-4430-8db3-875e530e1d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:20.311283 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465bc0ae-cb71-4430-8db3-875e530e1d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:20.313040 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465bc0ae-cb71-4430-8db3-875e530e1d56 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:20.327798 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1392/2741] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:21:20.329075 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859593b-a17c-48d0-a483-53588646203a admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:20.340711 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859593b-a17c-48d0-a483-53588646203a admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:20.343021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bc0ae-cb71-4430-8db3-875e530e1d56 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:20.344780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-465bc0ae-cb71-4430-8db3-875e530e1d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:20.346257 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84ab38-1c3b-406f-bfa4-7440b274028f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:20.346883 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84ab38-1c3b-406f-bfa4-7440b274028f admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:20.347399 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84ab38-1c3b-406f-bfa4-7440b274028f admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:20.347775 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84ab38-1c3b-406f-bfa4-7440b274028f admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:20.348634 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84ab38-1c3b-406f-bfa4-7440b274028f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:20.350419 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84ab38-1c3b-406f-bfa4-7440b274028f admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:20.364942 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1350/2742] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:20.369396 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84ab38-1c3b-406f-bfa4-7440b274028f admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:20.370187 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bc0ae-cb71-4430-8db3-875e530e1d56 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:20.380794 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6dbed-e0d7-4b99-a000-8e007261fe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:20.381529 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6dbed-e0d7-4b99-a000-8e007261fe63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:20.382013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6dbed-e0d7-4b99-a000-8e007261fe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:20.382376 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6dbed-e0d7-4b99-a000-8e007261fe63 admin admin] PATH_INFO: `/v3/projects/f17e00394b974b66ae84688b0ed9de67` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:20.383035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84ab38-1c3b-406f-bfa4-7440b274028f admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:20.383727 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6dbed-e0d7-4b99-a000-8e007261fe63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17e00394b974b66ae84688b0ed9de67)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:20.385691 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6dbed-e0d7-4b99-a000-8e007261fe63 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:20.388154 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c7903-8d60-4a33-8b1d-66e5fe66786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:20.388866 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c7903-8d60-4a33-8b1d-66e5fe66786c admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:20.389151 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c7903-8d60-4a33-8b1d-66e5fe66786c admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:20.389428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c7903-8d60-4a33-8b1d-66e5fe66786c admin admin] PATH_INFO: `/v3/projects/d7a97565bc464fd6ad7a3ac55f499720/users/807c2b14f555402ea8009e2fb599c134/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:20.409411 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c7903-8d60-4a33-8b1d-66e5fe66786c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a97565bc464fd6ad7a3ac55f499720, user_id=807c2b14f555402ea8009e2fb599c134, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:20.412314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c7903-8d60-4a33-8b1d-66e5fe66786c admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:20.427566 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1351/2743] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:20 2022] PUT /identity/v3/projects/d7a97565bc464fd6ad7a3ac55f499720/users/807c2b14f555402ea8009e2fb599c134/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:20.438922 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733b65d-d421-4281-bba6-78ba6cf44533 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:20.439984 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733b65d-d421-4281-bba6-78ba6cf44533 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:20.440280 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733b65d-d421-4281-bba6-78ba6cf44533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:20.443184 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-10d6dbed-e0d7-4b99-a000-8e007261fe63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17e00394b974b66ae84688b0ed9de67', 'request_id': 'req-10d6dbed-e0d7-4b99-a000-8e007261fe63'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:20.453167 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-10d6dbed-e0d7-4b99-a000-8e007261fe63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17e00394b974b66ae84688b0ed9de67', 'request_id': 'req-10d6dbed-e0d7-4b99-a000-8e007261fe63'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:20.460889 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-10d6dbed-e0d7-4b99-a000-8e007261fe63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17e00394b974b66ae84688b0ed9de67', 'request_id': 'req-10d6dbed-e0d7-4b99-a000-8e007261fe63'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:20.472110 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-d733b65d-d421-4281-bba6-78ba6cf44533 None None] MFA Rules not processed for user `807c2b14f555402ea8009e2fb599c134`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:20.473541 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-d733b65d-d421-4281-bba6-78ba6cf44533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:20.474779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-10d6dbed-e0d7-4b99-a000-8e007261fe63 admin admin] The token cache is being invalidate because project f17e00394b974b66ae84688b0ed9de67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:21:20.475225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-10d6dbed-e0d7-4b99-a000-8e007261fe63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:20.475918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-10d6dbed-e0d7-4b99-a000-8e007261fe63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:20.477504 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1393/2744] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:21:20 2022] DELETE /identity/v3/projects/f17e00394b974b66ae84688b0ed9de67 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:21:20.482446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6286d-4ac6-41eb-8d11-e7547db1053f None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:20.482995 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6286d-4ac6-41eb-8d11-e7547db1053f None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:20.483275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6286d-4ac6-41eb-8d11-e7547db1053f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:20.509161 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-70a6286d-4ac6-41eb-8d11-e7547db1053f None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:20.510773 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-70a6286d-4ac6-41eb-8d11-e7547db1053f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:20.529008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:DELETE=20,keystone:SELECT=77,keystone:INSERT=3 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:20.553469 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1352/2745] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:21:20.559777 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733b65d-d421-4281-bba6-78ba6cf44533 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:20.561681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-d733b65d-d421-4281-bba6-78ba6cf44533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:20.568046 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:20.588568 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1394/2746] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:21:20.597990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aba37a-de1e-4a42-8a6a-e74d12325cf2 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:20.598910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aba37a-de1e-4a42-8a6a-e74d12325cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:20.598910 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aba37a-de1e-4a42-8a6a-e74d12325cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:20.625021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-27aba37a-de1e-4a42-8a6a-e74d12325cf2 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:20.626309 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-27aba37a-de1e-4a42-8a6a-e74d12325cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:20.636122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1395/2747] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:21:20.640143 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aba37a-de1e-4a42-8a6a-e74d12325cf2 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:20.646732 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733b65d-d421-4281-bba6-78ba6cf44533 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:20.650547 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aba37a-de1e-4a42-8a6a-e74d12325cf2 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:20.654476 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b745d1-b31b-4875-aaf2-1c0abd4a891d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:20.655164 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b745d1-b31b-4875-aaf2-1c0abd4a891d admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:20.655382 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b745d1-b31b-4875-aaf2-1c0abd4a891d admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:20.655655 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b745d1-b31b-4875-aaf2-1c0abd4a891d admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:20.656331 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b745d1-b31b-4875-aaf2-1c0abd4a891d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:20.659010 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b745d1-b31b-4875-aaf2-1c0abd4a891d admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:20.659159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37be11d-f91d-4eba-9b60-2cce6ce2437a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:20.659851 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37be11d-f91d-4eba-9b60-2cce6ce2437a admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:20.660209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37be11d-f91d-4eba-9b60-2cce6ce2437a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:20.660620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37be11d-f91d-4eba-9b60-2cce6ce2437a admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:20.661428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37be11d-f91d-4eba-9b60-2cce6ce2437a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:21:20.661801 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37be11d-f91d-4eba-9b60-2cce6ce2437a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:20.663484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37be11d-f91d-4eba-9b60-2cce6ce2437a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:20.681341 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1396/2748] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:21:20.683662 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37be11d-f91d-4eba-9b60-2cce6ce2437a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:20.695358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37be11d-f91d-4eba-9b60-2cce6ce2437a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:20.696515 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1353/2749] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:21:20 2022] POST /identity/v3/projects => generated 393 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:21:20.700528 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b745d1-b31b-4875-aaf2-1c0abd4a891d admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:20.765121 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b982d7f-39e3-4782-bb62-bf2df4809f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:20.765730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b982d7f-39e3-4782-bb62-bf2df4809f0a admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:20.766013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b982d7f-39e3-4782-bb62-bf2df4809f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:20.766287 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b982d7f-39e3-4782-bb62-bf2df4809f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:20.766961 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b982d7f-39e3-4782-bb62-bf2df4809f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:20.769069 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b982d7f-39e3-4782-bb62-bf2df4809f0a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:20.772632 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b745d1-b31b-4875-aaf2-1c0abd4a891d admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:20.777424 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa7959-88e7-4825-bb7b-81a2e64dfca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:20.778049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa7959-88e7-4825-bb7b-81a2e64dfca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:20.778356 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa7959-88e7-4825-bb7b-81a2e64dfca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:20.778609 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa7959-88e7-4825-bb7b-81a2e64dfca2 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:20.779246 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa7959-88e7-4825-bb7b-81a2e64dfca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:20.781203 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fa7959-88e7-4825-bb7b-81a2e64dfca2 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:20.801342 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1397/2750] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:21:20 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:21:20.805406 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b982d7f-39e3-4782-bb62-bf2df4809f0a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:20.808699 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1354/2751] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:21:20 2022] POST /identity/v3/users => generated 303 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:21:20.810983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa7959-88e7-4825-bb7b-81a2e64dfca2 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:20.826924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa7959-88e7-4825-bb7b-81a2e64dfca2 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:20.894894 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68165122-0e36-4491-b308-63623924b04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:20.895581 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68165122-0e36-4491-b308-63623924b04e admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:20.895696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68165122-0e36-4491-b308-63623924b04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:20.895958 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68165122-0e36-4491-b308-63623924b04e admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:20.896694 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68165122-0e36-4491-b308-63623924b04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:20.898343 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68165122-0e36-4491-b308-63623924b04e admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:20.901698 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b982d7f-39e3-4782-bb62-bf2df4809f0a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:20.907722 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a9ad1-99ec-4e36-93e0-2a7a3fead7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:20.910686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a9ad1-99ec-4e36-93e0-2a7a3fead7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:20.910686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a9ad1-99ec-4e36-93e0-2a7a3fead7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:20.910686 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a9ad1-99ec-4e36-93e0-2a7a3fead7b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:20.911128 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1355/2752] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:20.911235 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a9ad1-99ec-4e36-93e0-2a7a3fead7b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:20.912350 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a9ad1-99ec-4e36-93e0-2a7a3fead7b2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:20.914406 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68165122-0e36-4491-b308-63623924b04e admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:20.925722 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68165122-0e36-4491-b308-63623924b04e admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:20.931316 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b792b4-8aec-4bec-999b-0853194596d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:20.931972 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b792b4-8aec-4bec-999b-0853194596d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:20.932261 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b792b4-8aec-4bec-999b-0853194596d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:20.932588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b792b4-8aec-4bec-999b-0853194596d2 admin admin] PATH_INFO: `/v3/projects/9b1805cb542e439692fe8b2a4953e51b/users/9a8799fd98d84716972fa2fc10256850/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:20.936604 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1398/2753] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:21:20 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:21:20.941229 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a9ad1-99ec-4e36-93e0-2a7a3fead7b2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:20.947718 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:20.952482 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a9ad1-99ec-4e36-93e0-2a7a3fead7b2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:20.952770 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b792b4-8aec-4bec-999b-0853194596d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b1805cb542e439692fe8b2a4953e51b, user_id=9a8799fd98d84716972fa2fc10256850, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:20.957433 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b792b4-8aec-4bec-999b-0853194596d2 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:20.958199 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfa7d3-16f7-4217-8520-a007ea099cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:20.958817 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfa7d3-16f7-4217-8520-a007ea099cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:20.959099 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfa7d3-16f7-4217-8520-a007ea099cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:20.959374 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdfa7d3-16f7-4217-8520-a007ea099cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:20.960083 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfa7d3-16f7-4217-8520-a007ea099cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:20.961723 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdfa7d3-16f7-4217-8520-a007ea099cd0 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:20.972615 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1356/2754] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:20 2022] PUT /identity/v3/projects/9b1805cb542e439692fe8b2a4953e51b/users/9a8799fd98d84716972fa2fc10256850/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:21:20.975974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1399/2755] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:20.977047 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b792b4-8aec-4bec-999b-0853194596d2 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:20.980411 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfa7d3-16f7-4217-8520-a007ea099cd0 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:20.988374 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:20.992482 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdfa7d3-16f7-4217-8520-a007ea099cd0 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:21.060829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b792b4-8aec-4bec-999b-0853194596d2 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:21.061894 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940986fa-ca2d-418c-b08e-1af9dd34a1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:21.062600 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940986fa-ca2d-418c-b08e-1af9dd34a1bb admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:21.062879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940986fa-ca2d-418c-b08e-1af9dd34a1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:21.063151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940986fa-ca2d-418c-b08e-1af9dd34a1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:21.063858 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940986fa-ca2d-418c-b08e-1af9dd34a1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:21.065892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940986fa-ca2d-418c-b08e-1af9dd34a1bb admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:21.066111 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807754ca-db17-4e0e-b34f-bc8a9c72f09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:21.066761 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807754ca-db17-4e0e-b34f-bc8a9c72f09e admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:21.067028 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807754ca-db17-4e0e-b34f-bc8a9c72f09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:21.067534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807754ca-db17-4e0e-b34f-bc8a9c72f09e admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:21.068017 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807754ca-db17-4e0e-b34f-bc8a9c72f09e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:21.069662 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807754ca-db17-4e0e-b34f-bc8a9c72f09e admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:21.077599 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1400/2756] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:21.082124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1357/2757] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:21:21.084543 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940986fa-ca2d-418c-b08e-1af9dd34a1bb admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:21.086108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807754ca-db17-4e0e-b34f-bc8a9c72f09e admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:21.095008 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940986fa-ca2d-418c-b08e-1af9dd34a1bb admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:21.099393 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807754ca-db17-4e0e-b34f-bc8a9c72f09e admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:21.103311 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6525f910-006f-443e-afb2-c779ebed2e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:21.103992 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525f910-006f-443e-afb2-c779ebed2e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:21.104280 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525f910-006f-443e-afb2-c779ebed2e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:21.104406 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a68b8e-3761-4c34-81b1-384ca2f1ac3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:21.104607 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6525f910-006f-443e-afb2-c779ebed2e20 admin admin] PATH_INFO: `/v3/projects/90d133fd350a41cd9b448081deffbba9/users/1f481f53238948e5bb6d0dace9e6480e/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:21.105061 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a68b8e-3761-4c34-81b1-384ca2f1ac3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:21.105400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a68b8e-3761-4c34-81b1-384ca2f1ac3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:21.105641 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a68b8e-3761-4c34-81b1-384ca2f1ac3e admin admin] PATH_INFO: `/v3/projects/9b1805cb542e439692fe8b2a4953e51b/users/9a8799fd98d84716972fa2fc10256850/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:21.107761 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a68b8e-3761-4c34-81b1-384ca2f1ac3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b1805cb542e439692fe8b2a4953e51b, user_id=9a8799fd98d84716972fa2fc10256850, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:21.112295 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a68b8e-3761-4c34-81b1-384ca2f1ac3e admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:21.121859 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525f910-006f-443e-afb2-c779ebed2e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90d133fd350a41cd9b448081deffbba9, user_id=1f481f53238948e5bb6d0dace9e6480e, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:21.124952 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6525f910-006f-443e-afb2-c779ebed2e20 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:21.126115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1358/2758] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:21 2022] PUT /identity/v3/projects/9b1805cb542e439692fe8b2a4953e51b/users/9a8799fd98d84716972fa2fc10256850/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:21:21.138032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d87b1-04ce-4ab7-adc1-35241b252a4e None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:21.138421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d87b1-04ce-4ab7-adc1-35241b252a4e None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:21.138744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d87b1-04ce-4ab7-adc1-35241b252a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:21.147381 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1401/2759] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:21 2022] PUT /identity/v3/projects/90d133fd350a41cd9b448081deffbba9/users/1f481f53238948e5bb6d0dace9e6480e/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:21:21.158392 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47232edf-5925-4800-a5e1-26787039f6a9 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:21.159406 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47232edf-5925-4800-a5e1-26787039f6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:21.159687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47232edf-5925-4800-a5e1-26787039f6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:21.170432 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-976d87b1-04ce-4ab7-adc1-35241b252a4e None None] MFA Rules not processed for user `9a8799fd98d84716972fa2fc10256850`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:21.171666 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-976d87b1-04ce-4ab7-adc1-35241b252a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:21.188777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-47232edf-5925-4800-a5e1-26787039f6a9 None None] MFA Rules not processed for user `1f481f53238948e5bb6d0dace9e6480e`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:21.190778 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-47232edf-5925-4800-a5e1-26787039f6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:21.252945 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1359/2760] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:21 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:21:21.261096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d87b1-04ce-4ab7-adc1-35241b252a4e None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:21.262597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-976d87b1-04ce-4ab7-adc1-35241b252a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:21.263792 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1402/2761] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:21:21.269324 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47232edf-5925-4800-a5e1-26787039f6a9 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:21.332794 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d87b1-04ce-4ab7-adc1-35241b252a4e None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:21.338205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50092dd9-d631-4745-b7ce-a46eef74db26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:21.338833 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50092dd9-d631-4745-b7ce-a46eef74db26 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:21.339113 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50092dd9-d631-4745-b7ce-a46eef74db26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:21.339390 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50092dd9-d631-4745-b7ce-a46eef74db26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:21.350763 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50092dd9-d631-4745-b7ce-a46eef74db26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:21.352230 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50092dd9-d631-4745-b7ce-a46eef74db26 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:21.353836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47232edf-5925-4800-a5e1-26787039f6a9 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:21.358021 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:21.363993 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec109e5-9016-40dc-abbc-8898d4a8f29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:21.364660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec109e5-9016-40dc-abbc-8898d4a8f29e admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:21.367612 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec109e5-9016-40dc-abbc-8898d4a8f29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:21.367753 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1360/2762] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:21 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:21:21.367855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec109e5-9016-40dc-abbc-8898d4a8f29e admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:21.367855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec109e5-9016-40dc-abbc-8898d4a8f29e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:21.367855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec109e5-9016-40dc-abbc-8898d4a8f29e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:21.380065 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:21.404745 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1403/2763] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:21:21 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:21:21.406689 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50092dd9-d631-4745-b7ce-a46eef74db26 service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:21.415305 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec109e5-9016-40dc-abbc-8898d4a8f29e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:21.417932 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dec109e5-9016-40dc-abbc-8898d4a8f29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:21.421314 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50092dd9-d631-4745-b7ce-a46eef74db26 service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:21.485920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9e950-1e97-45b9-bb5c-a2d424fd57af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:21.486525 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec109e5-9016-40dc-abbc-8898d4a8f29e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:21.486690 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9e950-1e97-45b9-bb5c-a2d424fd57af admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:21.486910 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9e950-1e97-45b9-bb5c-a2d424fd57af admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:21.487196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9e950-1e97-45b9-bb5c-a2d424fd57af admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:21.487871 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9e950-1e97-45b9-bb5c-a2d424fd57af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:21.489861 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9e950-1e97-45b9-bb5c-a2d424fd57af admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:21.490523 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db5098-5a86-4f27-b520-ee81698cf89f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:21.491210 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db5098-5a86-4f27-b520-ee81698cf89f service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:21.491562 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db5098-5a86-4f27-b520-ee81698cf89f service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:21.491901 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db5098-5a86-4f27-b520-ee81698cf89f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:21.515391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1361/2764] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:21:21 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:21:21.518959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9e950-1e97-45b9-bb5c-a2d424fd57af admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:21.529790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9e950-1e97-45b9-bb5c-a2d424fd57af admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:21.539150 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f7e34-37b5-42d2-a7dc-5d3d81af5848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:21.539781 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f7e34-37b5-42d2-a7dc-5d3d81af5848 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:21.540074 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f7e34-37b5-42d2-a7dc-5d3d81af5848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:21.540353 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f7e34-37b5-42d2-a7dc-5d3d81af5848 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:21.541112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f7e34-37b5-42d2-a7dc-5d3d81af5848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:21.542928 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f7e34-37b5-42d2-a7dc-5d3d81af5848 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:21.557863 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1362/2765] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:21:21.559530 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f7e34-37b5-42d2-a7dc-5d3d81af5848 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:21.559676 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db5098-5a86-4f27-b520-ee81698cf89f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:21.561096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db5098-5a86-4f27-b520-ee81698cf89f service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:21.569813 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f7e34-37b5-42d2-a7dc-5d3d81af5848 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:21.572122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1404/2766] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:21 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:21:21.574711 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e66f6-b752-417d-b1a6-fba4d7a3d88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:21.575378 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e66f6-b752-417d-b1a6-fba4d7a3d88b admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:21.575659 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e66f6-b752-417d-b1a6-fba4d7a3d88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:21.575932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e66f6-b752-417d-b1a6-fba4d7a3d88b admin admin] PATH_INFO: `/v3/projects/aebb570e58584fb2b70e322b70dc1ad6/users/3d0dd5a85678437880d66b2f4edd8e0f/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:21.595885 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e66f6-b752-417d-b1a6-fba4d7a3d88b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aebb570e58584fb2b70e322b70dc1ad6, user_id=3d0dd5a85678437880d66b2f4edd8e0f, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:21.598854 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e66f6-b752-417d-b1a6-fba4d7a3d88b admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:21.615461 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1363/2767] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:21 2022] PUT /identity/v3/projects/aebb570e58584fb2b70e322b70dc1ad6/users/3d0dd5a85678437880d66b2f4edd8e0f/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:21.619529 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db5098-5a86-4f27-b520-ee81698cf89f service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:21.636642 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db5098-5a86-4f27-b520-ee81698cf89f service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:21.724426 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae44c7-4fa3-425f-b752-a9c8330ddb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:21.725480 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae44c7-4fa3-425f-b752-a9c8330ddb2b admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:21.725612 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae44c7-4fa3-425f-b752-a9c8330ddb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:21.726262 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae44c7-4fa3-425f-b752-a9c8330ddb2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:21.727074 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae44c7-4fa3-425f-b752-a9c8330ddb2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:21.728963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae44c7-4fa3-425f-b752-a9c8330ddb2b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:21.745258 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1405/2768] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:21.749876 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e66f6-b752-417d-b1a6-fba4d7a3d88b admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:21.769670 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e66f6-b752-417d-b1a6-fba4d7a3d88b admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:21.780598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915f303-2c86-496c-9d45-4078d4b15d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:21.781534 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f303-2c86-496c-9d45-4078d4b15d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:21.782139 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f303-2c86-496c-9d45-4078d4b15d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:21.784039 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915f303-2c86-496c-9d45-4078d4b15d17 admin admin] PATH_INFO: `/v3/projects/aebb570e58584fb2b70e322b70dc1ad6/users/3d0dd5a85678437880d66b2f4edd8e0f/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:21.786996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915f303-2c86-496c-9d45-4078d4b15d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aebb570e58584fb2b70e322b70dc1ad6, user_id=3d0dd5a85678437880d66b2f4edd8e0f, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:21.791271 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915f303-2c86-496c-9d45-4078d4b15d17 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:21.805694 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1364/2769] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:21 2022] PUT /identity/v3/projects/aebb570e58584fb2b70e322b70dc1ad6/users/3d0dd5a85678437880d66b2f4edd8e0f/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:21.819502 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3e234-a3bd-49d4-85f8-e566acabd8ee None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:21.820442 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3e234-a3bd-49d4-85f8-e566acabd8ee None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:21.820930 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3e234-a3bd-49d4-85f8-e566acabd8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:21.856269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b1a3e234-a3bd-49d4-85f8-e566acabd8ee None None] MFA Rules not processed for user `3d0dd5a85678437880d66b2f4edd8e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:21.857902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b1a3e234-a3bd-49d4-85f8-e566acabd8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:21.895843 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:21.964521 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1406/2770] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:22.037211 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915f303-2c86-496c-9d45-4078d4b15d17 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:22.099736 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915f303-2c86-496c-9d45-4078d4b15d17 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:22.103391 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3ce1d-1361-4fbc-8671-b1ea7b2f3c10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:22.104002 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3ce1d-1361-4fbc-8671-b1ea7b2f3c10 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:22.104279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3ce1d-1361-4fbc-8671-b1ea7b2f3c10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:22.104589 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3ce1d-1361-4fbc-8671-b1ea7b2f3c10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:22.114756 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3ce1d-1361-4fbc-8671-b1ea7b2f3c10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:22.116181 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3ce1d-1361-4fbc-8671-b1ea7b2f3c10 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:22.126086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1365/2771] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:21:22.557433 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3e234-a3bd-49d4-85f8-e566acabd8ee None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:22.624622 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3e234-a3bd-49d4-85f8-e566acabd8ee None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:22.631097 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a1a07-6928-4bd1-b2ed-f40fc091284a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:22.631783 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a1a07-6928-4bd1-b2ed-f40fc091284a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:22.632065 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a1a07-6928-4bd1-b2ed-f40fc091284a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:22.632342 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a1a07-6928-4bd1-b2ed-f40fc091284a admin admin] PATH_INFO: `/v3/users/1f481f53238948e5bb6d0dace9e6480e` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:22.633588 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a1a07-6928-4bd1-b2ed-f40fc091284a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f481f53238948e5bb6d0dace9e6480e)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:22.635537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a1a07-6928-4bd1-b2ed-f40fc091284a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:22.690679 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7a2a1a07-6928-4bd1-b2ed-f40fc091284a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f481f53238948e5bb6d0dace9e6480e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:22.691318 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7a2a1a07-6928-4bd1-b2ed-f40fc091284a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f481f53238948e5bb6d0dace9e6480e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:22.698428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7a2a1a07-6928-4bd1-b2ed-f40fc091284a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f481f53238948e5bb6d0dace9e6480e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:22.711380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7a2a1a07-6928-4bd1-b2ed-f40fc091284a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f481f53238948e5bb6d0dace9e6480e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:22.722669 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-7a2a1a07-6928-4bd1-b2ed-f40fc091284a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f481f53238948e5bb6d0dace9e6480e'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:22.728162 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1407/2772] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:21:22 2022] DELETE /identity/v3/users/1f481f53238948e5bb6d0dace9e6480e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:22.732825 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8936a8-3181-473c-86ea-d5968e883f4e None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:22.733119 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8936a8-3181-473c-86ea-d5968e883f4e None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:22.733412 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8936a8-3181-473c-86ea-d5968e883f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:22.752867 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-ff8936a8-3181-473c-86ea-d5968e883f4e None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:22.754098 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ff8936a8-3181-473c-86ea-d5968e883f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:22.801789 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:22.825149 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1366/2773] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:22.836101 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a1a07-6928-4bd1-b2ed-f40fc091284a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:22.837524 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7a2a1a07-6928-4bd1-b2ed-f40fc091284a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:22.900638 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:22.903045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a1a07-6928-4bd1-b2ed-f40fc091284a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:22.908446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c04e2-e83f-4114-bf73-480465e55085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:22.909917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c04e2-e83f-4114-bf73-480465e55085 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:22.910211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c04e2-e83f-4114-bf73-480465e55085 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:22.910552 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c04e2-e83f-4114-bf73-480465e55085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:22.921223 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c04e2-e83f-4114-bf73-480465e55085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:22.922725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c04e2-e83f-4114-bf73-480465e55085 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:22.933086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1408/2774] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:21:23.262149 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8936a8-3181-473c-86ea-d5968e883f4e None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:23.264594 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ff8936a8-3181-473c-86ea-d5968e883f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:23.289674 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8936a8-3181-473c-86ea-d5968e883f4e None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:23.297635 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fc9e9-5cd7-44ee-a4b9-bb952615a05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:23.298973 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fc9e9-5cd7-44ee-a4b9-bb952615a05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:23.302426 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fc9e9-5cd7-44ee-a4b9-bb952615a05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:23.302426 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fc9e9-5cd7-44ee-a4b9-bb952615a05b admin admin] PATH_INFO: `/v3/projects/90d133fd350a41cd9b448081deffbba9` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:23.303732 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3fc9e9-5cd7-44ee-a4b9-bb952615a05b admin admin] RBAC: Authorizing `identity:delete_project(project_id=90d133fd350a41cd9b448081deffbba9)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:23.305756 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3fc9e9-5cd7-44ee-a4b9-bb952615a05b admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:23.367688 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9a3fc9e9-5cd7-44ee-a4b9-bb952615a05b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90d133fd350a41cd9b448081deffbba9', 'request_id': 'req-9a3fc9e9-5cd7-44ee-a4b9-bb952615a05b'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:23.374993 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9a3fc9e9-5cd7-44ee-a4b9-bb952615a05b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90d133fd350a41cd9b448081deffbba9', 'request_id': 'req-9a3fc9e9-5cd7-44ee-a4b9-bb952615a05b'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:23.382409 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9a3fc9e9-5cd7-44ee-a4b9-bb952615a05b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90d133fd350a41cd9b448081deffbba9', 'request_id': 'req-9a3fc9e9-5cd7-44ee-a4b9-bb952615a05b'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:23.396829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9a3fc9e9-5cd7-44ee-a4b9-bb952615a05b admin admin] The token cache is being invalidate because project 90d133fd350a41cd9b448081deffbba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:21:23.397237 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9a3fc9e9-5cd7-44ee-a4b9-bb952615a05b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:23.397974 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-9a3fc9e9-5cd7-44ee-a4b9-bb952615a05b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:23.399581 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1367/2775] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:21:23 2022] DELETE /identity/v3/projects/90d133fd350a41cd9b448081deffbba9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:23.403907 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c04e2-e83f-4114-bf73-480465e55085 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:23.415437 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c04e2-e83f-4114-bf73-480465e55085 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:23.479568 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7931f6b-db74-42f6-b2d8-92f4b6a0cacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:23.480248 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7931f6b-db74-42f6-b2d8-92f4b6a0cacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:23.480590 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7931f6b-db74-42f6-b2d8-92f4b6a0cacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:23.480871 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7931f6b-db74-42f6-b2d8-92f4b6a0cacf admin admin] PATH_INFO: `/v3/users/3d0dd5a85678437880d66b2f4edd8e0f` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:23.482060 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7931f6b-db74-42f6-b2d8-92f4b6a0cacf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d0dd5a85678437880d66b2f4edd8e0f)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:23.483996 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7931f6b-db74-42f6-b2d8-92f4b6a0cacf admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:23.545090 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f7931f6b-db74-42f6-b2d8-92f4b6a0cacf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d0dd5a85678437880d66b2f4edd8e0f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:23.547108 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f7931f6b-db74-42f6-b2d8-92f4b6a0cacf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d0dd5a85678437880d66b2f4edd8e0f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:23.553827 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f7931f6b-db74-42f6-b2d8-92f4b6a0cacf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d0dd5a85678437880d66b2f4edd8e0f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:23.567171 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f7931f6b-db74-42f6-b2d8-92f4b6a0cacf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d0dd5a85678437880d66b2f4edd8e0f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:23.576990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f7931f6b-db74-42f6-b2d8-92f4b6a0cacf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d0dd5a85678437880d66b2f4edd8e0f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:23.585723 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1409/2776] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:21:23 2022] DELETE /identity/v3/users/3d0dd5a85678437880d66b2f4edd8e0f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:23.918771 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fc9e9-5cd7-44ee-a4b9-bb952615a05b admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:23.920297 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-9a3fc9e9-5cd7-44ee-a4b9-bb952615a05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:23.941171 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fc9e9-5cd7-44ee-a4b9-bb952615a05b admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:24.018239 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1090e-6c8f-4037-b15d-7475ea14aab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:24.018925 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1090e-6c8f-4037-b15d-7475ea14aab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:24.019308 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1090e-6c8f-4037-b15d-7475ea14aab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:24.019758 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1090e-6c8f-4037-b15d-7475ea14aab4 admin admin] PATH_INFO: `/v3/projects/aebb570e58584fb2b70e322b70dc1ad6` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:24.021170 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1090e-6c8f-4037-b15d-7475ea14aab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aebb570e58584fb2b70e322b70dc1ad6)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:24.023344 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1090e-6c8f-4037-b15d-7475ea14aab4 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:24.079651 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-14c1090e-6c8f-4037-b15d-7475ea14aab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aebb570e58584fb2b70e322b70dc1ad6', 'request_id': 'req-14c1090e-6c8f-4037-b15d-7475ea14aab4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:24.086068 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-14c1090e-6c8f-4037-b15d-7475ea14aab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aebb570e58584fb2b70e322b70dc1ad6', 'request_id': 'req-14c1090e-6c8f-4037-b15d-7475ea14aab4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:24.093137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-14c1090e-6c8f-4037-b15d-7475ea14aab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aebb570e58584fb2b70e322b70dc1ad6', 'request_id': 'req-14c1090e-6c8f-4037-b15d-7475ea14aab4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:24.102712 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:24.109225 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-14c1090e-6c8f-4037-b15d-7475ea14aab4 admin admin] The token cache is being invalidate because project aebb570e58584fb2b70e322b70dc1ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:21:24.109971 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-14c1090e-6c8f-4037-b15d-7475ea14aab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:24.111185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-14c1090e-6c8f-4037-b15d-7475ea14aab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:24.113866 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1368/2777] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:21:23 2022] DELETE /identity/v3/projects/aebb570e58584fb2b70e322b70dc1ad6 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:24.119064 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121706e-6e88-48b0-948f-2b9b1f8cda92 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:24.119554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121706e-6e88-48b0-948f-2b9b1f8cda92 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:24.119661 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121706e-6e88-48b0-948f-2b9b1f8cda92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:24.140282 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-0121706e-6e88-48b0-948f-2b9b1f8cda92 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:24.141750 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0121706e-6e88-48b0-948f-2b9b1f8cda92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:24.207919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1410/2778] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:24.215744 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e0e8d-8a65-4a42-8957-dc2833f1a878 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:24.216035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e0e8d-8a65-4a42-8957-dc2833f1a878 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:24.216317 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e0e8d-8a65-4a42-8957-dc2833f1a878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:24.237188 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-e09e0e8d-8a65-4a42-8957-dc2833f1a878 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:24.238400 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e09e0e8d-8a65-4a42-8957-dc2833f1a878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:24.246373 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1369/2779] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:24.250915 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121706e-6e88-48b0-948f-2b9b1f8cda92 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:24.261708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121706e-6e88-48b0-948f-2b9b1f8cda92 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:24.266562 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f56a3-ada7-4b1d-bbdf-98ddd11004b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:24.268434 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f56a3-ada7-4b1d-bbdf-98ddd11004b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:24.268691 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f56a3-ada7-4b1d-bbdf-98ddd11004b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:24.268968 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58f56a3-ada7-4b1d-bbdf-98ddd11004b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:24.269675 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f56a3-ada7-4b1d-bbdf-98ddd11004b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:21:24.269979 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f56a3-ada7-4b1d-bbdf-98ddd11004b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:24.271587 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58f56a3-ada7-4b1d-bbdf-98ddd11004b3 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:24.274417 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:24.290931 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1411/2780] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:21:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:21:24.292036 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e0e8d-8a65-4a42-8957-dc2833f1a878 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:24.302720 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e0e8d-8a65-4a42-8957-dc2833f1a878 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:24.307580 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf26c55-5e82-486a-8ad4-4e62cdc19c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:24.308206 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf26c55-5e82-486a-8ad4-4e62cdc19c09 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:24.308514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf26c55-5e82-486a-8ad4-4e62cdc19c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:24.308795 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf26c55-5e82-486a-8ad4-4e62cdc19c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:24.309480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf26c55-5e82-486a-8ad4-4e62cdc19c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:24.311383 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf26c55-5e82-486a-8ad4-4e62cdc19c09 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:24.351088 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1370/2781] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:21:24 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:21:24.355458 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f56a3-ada7-4b1d-bbdf-98ddd11004b3 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:24.366806 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58f56a3-ada7-4b1d-bbdf-98ddd11004b3 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:24.452902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558a85b-c64e-4cea-9cb8-773921384348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:24.453856 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558a85b-c64e-4cea-9cb8-773921384348 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:24.454147 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558a85b-c64e-4cea-9cb8-773921384348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:24.455413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558a85b-c64e-4cea-9cb8-773921384348 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:24.456494 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558a85b-c64e-4cea-9cb8-773921384348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:24.459849 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558a85b-c64e-4cea-9cb8-773921384348 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:24.488095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1412/2782] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:21:24 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:21:24.492947 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf26c55-5e82-486a-8ad4-4e62cdc19c09 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:24.503515 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf26c55-5e82-486a-8ad4-4e62cdc19c09 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:24.508292 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e67a2-569e-46f3-8622-d69a58885b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:24.508939 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e67a2-569e-46f3-8622-d69a58885b94 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:24.509221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e67a2-569e-46f3-8622-d69a58885b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:24.509495 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e67a2-569e-46f3-8622-d69a58885b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:24.510195 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e67a2-569e-46f3-8622-d69a58885b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:24.511812 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e67a2-569e-46f3-8622-d69a58885b94 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:24.522504 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1371/2783] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:24.526612 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558a85b-c64e-4cea-9cb8-773921384348 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:24.537448 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558a85b-c64e-4cea-9cb8-773921384348 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:24.542211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8e515-01ba-448e-aecd-12ec377f60d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:24.542802 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8e515-01ba-448e-aecd-12ec377f60d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:24.543154 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8e515-01ba-448e-aecd-12ec377f60d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:24.543438 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8e515-01ba-448e-aecd-12ec377f60d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:24.544136 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8e515-01ba-448e-aecd-12ec377f60d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:24.545808 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8e515-01ba-448e-aecd-12ec377f60d4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:24.557041 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1413/2784] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:24.561280 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e67a2-569e-46f3-8622-d69a58885b94 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:24.573244 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e67a2-569e-46f3-8622-d69a58885b94 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:24.578941 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16d5bd-69d6-4ffc-ab94-5fc4ab5fd1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:24.579684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16d5bd-69d6-4ffc-ab94-5fc4ab5fd1ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:24.580714 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16d5bd-69d6-4ffc-ab94-5fc4ab5fd1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:24.581024 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16d5bd-69d6-4ffc-ab94-5fc4ab5fd1ac admin admin] PATH_INFO: `/v3/projects/c8de64f691c04f3e993508850b6024f7/users/7545d748e6664e7db243b7ab909d2f2c/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:24.596057 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16d5bd-69d6-4ffc-ab94-5fc4ab5fd1ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8de64f691c04f3e993508850b6024f7, user_id=7545d748e6664e7db243b7ab909d2f2c, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:24.598756 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16d5bd-69d6-4ffc-ab94-5fc4ab5fd1ac admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:24.613434 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1372/2785] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:24 2022] PUT /identity/v3/projects/c8de64f691c04f3e993508850b6024f7/users/7545d748e6664e7db243b7ab909d2f2c/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:24.623885 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106a1df-c06b-4b2f-8775-fa91ed241ab3 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:24.624168 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106a1df-c06b-4b2f-8775-fa91ed241ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:24.624438 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106a1df-c06b-4b2f-8775-fa91ed241ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:24.654962 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-b106a1df-c06b-4b2f-8775-fa91ed241ab3 None None] MFA Rules not processed for user `7545d748e6664e7db243b7ab909d2f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:24.656182 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-b106a1df-c06b-4b2f-8775-fa91ed241ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:24.723639 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1414/2786] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:24.728088 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16d5bd-69d6-4ffc-ab94-5fc4ab5fd1ac admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:24.797814 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16d5bd-69d6-4ffc-ab94-5fc4ab5fd1ac admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:24.802728 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b63bd7-2696-4daf-938d-c46a3783dc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:24.803348 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b63bd7-2696-4daf-938d-c46a3783dc18 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:24.803637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b63bd7-2696-4daf-938d-c46a3783dc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:24.803916 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b63bd7-2696-4daf-938d-c46a3783dc18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:24.804635 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b63bd7-2696-4daf-938d-c46a3783dc18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:24.806535 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b63bd7-2696-4daf-938d-c46a3783dc18 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:24.834408 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1373/2787] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:21:24 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:21:24.838532 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106a1df-c06b-4b2f-8775-fa91ed241ab3 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:24.849342 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106a1df-c06b-4b2f-8775-fa91ed241ab3 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:24.907096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7eb698-64c2-4ec8-9a05-e763cbb1bf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:24.907743 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eb698-64c2-4ec8-9a05-e763cbb1bf30 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:24.908022 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eb698-64c2-4ec8-9a05-e763cbb1bf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:24.908293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7eb698-64c2-4ec8-9a05-e763cbb1bf30 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:24.908990 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7eb698-64c2-4ec8-9a05-e763cbb1bf30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:24.910908 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7eb698-64c2-4ec8-9a05-e763cbb1bf30 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:24.923794 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:24.938437 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1415/2788] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:21:24 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:21:24.948065 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b63bd7-2696-4daf-938d-c46a3783dc18 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:24.965036 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b63bd7-2696-4daf-938d-c46a3783dc18 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:24.972137 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f91a9-5a86-451a-9df7-6a73a03615f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:24.973124 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f91a9-5a86-451a-9df7-6a73a03615f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:24.973594 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f91a9-5a86-451a-9df7-6a73a03615f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:24.974062 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f91a9-5a86-451a-9df7-6a73a03615f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:24.975247 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f91a9-5a86-451a-9df7-6a73a03615f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:24.978155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f91a9-5a86-451a-9df7-6a73a03615f5 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:24.993640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1374/2789] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:24.997677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7eb698-64c2-4ec8-9a05-e763cbb1bf30 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:25.009038 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7eb698-64c2-4ec8-9a05-e763cbb1bf30 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:25.014055 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b799d35-2161-4997-bab1-84ba04439970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:25.014798 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b799d35-2161-4997-bab1-84ba04439970 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:25.015172 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b799d35-2161-4997-bab1-84ba04439970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:25.015570 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b799d35-2161-4997-bab1-84ba04439970 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:25.016374 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b799d35-2161-4997-bab1-84ba04439970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:25.018963 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b799d35-2161-4997-bab1-84ba04439970 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:25.036064 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1416/2790] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:25.037529 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f91a9-5a86-451a-9df7-6a73a03615f5 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:25.049279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f91a9-5a86-451a-9df7-6a73a03615f5 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:25.054896 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445674a9-ddd2-4d95-b370-06f72fac5c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:25.055668 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445674a9-ddd2-4d95-b370-06f72fac5c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:25.055958 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445674a9-ddd2-4d95-b370-06f72fac5c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:25.056236 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445674a9-ddd2-4d95-b370-06f72fac5c86 admin admin] PATH_INFO: `/v3/projects/b07916c48eac463e8562c86c722fc9aa/users/23b993a6558f419aa07069141e4d66dc/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:25.075427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445674a9-ddd2-4d95-b370-06f72fac5c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07916c48eac463e8562c86c722fc9aa, user_id=23b993a6558f419aa07069141e4d66dc, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:25.078120 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445674a9-ddd2-4d95-b370-06f72fac5c86 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:25.092730 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1375/2791] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:25 2022] PUT /identity/v3/projects/b07916c48eac463e8562c86c722fc9aa/users/23b993a6558f419aa07069141e4d66dc/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:25.104728 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f9dad-31a0-4766-8dba-65600aefd088 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:25.105014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f9dad-31a0-4766-8dba-65600aefd088 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:25.105322 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f9dad-31a0-4766-8dba-65600aefd088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:25.130763 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445674a9-ddd2-4d95-b370-06f72fac5c86 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:25.132527 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-445674a9-ddd2-4d95-b370-06f72fac5c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:25.135268 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6f0f9dad-31a0-4766-8dba-65600aefd088 None None] MFA Rules not processed for user `23b993a6558f419aa07069141e4d66dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:25.136446 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6f0f9dad-31a0-4766-8dba-65600aefd088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:25.180336 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:25.201880 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445674a9-ddd2-4d95-b370-06f72fac5c86 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:25.207521 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12009150-97ae-41ab-9463-389ea552fc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:25.208173 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12009150-97ae-41ab-9463-389ea552fc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:25.208452 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12009150-97ae-41ab-9463-389ea552fc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:25.208754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12009150-97ae-41ab-9463-389ea552fc37 admin admin] PATH_INFO: `/v3/users/807c2b14f555402ea8009e2fb599c134` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:25.209937 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12009150-97ae-41ab-9463-389ea552fc37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=807c2b14f555402ea8009e2fb599c134)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:25.210771 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1417/2792] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:25.211924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12009150-97ae-41ab-9463-389ea552fc37 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:25.215492 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f9dad-31a0-4766-8dba-65600aefd088 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:25.227147 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f9dad-31a0-4766-8dba-65600aefd088 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:25.231940 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df30c2e-6b68-4eb4-a6b1-77e43309ebee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:25.232584 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df30c2e-6b68-4eb4-a6b1-77e43309ebee admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:25.232890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df30c2e-6b68-4eb4-a6b1-77e43309ebee admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:25.233164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df30c2e-6b68-4eb4-a6b1-77e43309ebee admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:25.233837 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df30c2e-6b68-4eb4-a6b1-77e43309ebee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:25.236840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df30c2e-6b68-4eb4-a6b1-77e43309ebee admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:25.263638 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-12009150-97ae-41ab-9463-389ea552fc37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '807c2b14f555402ea8009e2fb599c134'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:25.264705 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-12009150-97ae-41ab-9463-389ea552fc37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '807c2b14f555402ea8009e2fb599c134'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:25.272770 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1418/2793] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:21:25 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:21:25.273799 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df30c2e-6b68-4eb4-a6b1-77e43309ebee admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:25.284162 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-12009150-97ae-41ab-9463-389ea552fc37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '807c2b14f555402ea8009e2fb599c134'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:25.297020 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-12009150-97ae-41ab-9463-389ea552fc37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '807c2b14f555402ea8009e2fb599c134'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:25.297656 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-12009150-97ae-41ab-9463-389ea552fc37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '807c2b14f555402ea8009e2fb599c134'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:25.317581 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1376/2794] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:21:25 2022] DELETE /identity/v3/users/807c2b14f555402ea8009e2fb599c134 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:21:25.322793 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c1db8-4a56-45d4-8189-80164b2613b4 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:25.323086 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c1db8-4a56-45d4-8189-80164b2613b4 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:25.323360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c1db8-4a56-45d4-8189-80164b2613b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:25.345094 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-7c2c1db8-4a56-45d4-8189-80164b2613b4 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:25.346821 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7c2c1db8-4a56-45d4-8189-80164b2613b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:25.350889 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df30c2e-6b68-4eb4-a6b1-77e43309ebee admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:25.405372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:25.413213 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8024fa-259e-4773-9814-f55d65996697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:25.413855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8024fa-259e-4773-9814-f55d65996697 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:25.414533 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8024fa-259e-4773-9814-f55d65996697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:25.415054 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8024fa-259e-4773-9814-f55d65996697 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:25.415733 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8024fa-259e-4773-9814-f55d65996697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:25.416447 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1377/2795] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:21:25.419699 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8024fa-259e-4773-9814-f55d65996697 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:25.429147 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c1db8-4a56-45d4-8189-80164b2613b4 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:25.430627 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-7c2c1db8-4a56-45d4-8189-80164b2613b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:25.448047 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1419/2796] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:21:25 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:21:25.449510 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8024fa-259e-4773-9814-f55d65996697 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:25.451202 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-fb8024fa-259e-4773-9814-f55d65996697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:25.463364 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8024fa-259e-4773-9814-f55d65996697 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:25.470013 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8d5f1-22a4-495d-b3b0-b286aea6771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:25.471242 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8d5f1-22a4-495d-b3b0-b286aea6771e admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:25.471622 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8d5f1-22a4-495d-b3b0-b286aea6771e admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:25.472052 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8d5f1-22a4-495d-b3b0-b286aea6771e admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:25.473197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8d5f1-22a4-495d-b3b0-b286aea6771e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:25.475631 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8d5f1-22a4-495d-b3b0-b286aea6771e admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:25.494672 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1420/2797] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:21:25.496006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8d5f1-22a4-495d-b3b0-b286aea6771e admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:25.500637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c1db8-4a56-45d4-8189-80164b2613b4 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:25.505036 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af706f-49d5-4509-94fa-0d0e09f9e468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:25.505793 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af706f-49d5-4509-94fa-0d0e09f9e468 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:25.506148 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af706f-49d5-4509-94fa-0d0e09f9e468 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:25.506491 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af706f-49d5-4509-94fa-0d0e09f9e468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:25.510268 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8d5f1-22a4-495d-b3b0-b286aea6771e admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:25.516704 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0aa41-5738-4a8d-8cb8-923f9d9d52ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:25.517608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af706f-49d5-4509-94fa-0d0e09f9e468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:25.517758 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0aa41-5738-4a8d-8cb8-923f9d9d52ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:25.518108 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0aa41-5738-4a8d-8cb8-923f9d9d52ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:25.518488 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0aa41-5738-4a8d-8cb8-923f9d9d52ad admin admin] PATH_INFO: `/v3/projects/3ce98d6dfbeb4e9a893584e920c2f8b7/users/57a959817d824c9cb2e4ef66f9c81712/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:25.519401 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af706f-49d5-4509-94fa-0d0e09f9e468 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:25.529511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1378/2798] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:21:25.540766 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0aa41-5738-4a8d-8cb8-923f9d9d52ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce98d6dfbeb4e9a893584e920c2f8b7, user_id=57a959817d824c9cb2e4ef66f9c81712, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:25.543458 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0aa41-5738-4a8d-8cb8-923f9d9d52ad admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:25.557552 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1421/2799] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:25 2022] PUT /identity/v3/projects/3ce98d6dfbeb4e9a893584e920c2f8b7/users/57a959817d824c9cb2e4ef66f9c81712/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:21:25.561631 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af706f-49d5-4509-94fa-0d0e09f9e468 service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:25.573046 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af706f-49d5-4509-94fa-0d0e09f9e468 service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:25.577199 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:25.642997 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38c635-8bc0-4c21-869b-52435cb04560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:25.643765 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38c635-8bc0-4c21-869b-52435cb04560 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:25.644178 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38c635-8bc0-4c21-869b-52435cb04560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:25.644604 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38c635-8bc0-4c21-869b-52435cb04560 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:25.645399 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38c635-8bc0-4c21-869b-52435cb04560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:25.655494 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38c635-8bc0-4c21-869b-52435cb04560 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:25.670740 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1379/2800] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:25.676169 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0aa41-5738-4a8d-8cb8-923f9d9d52ad admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:25.687038 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0aa41-5738-4a8d-8cb8-923f9d9d52ad admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:25.693021 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85b55c-598e-4830-bace-5af30830df4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:25.693790 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85b55c-598e-4830-bace-5af30830df4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:25.694132 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85b55c-598e-4830-bace-5af30830df4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:25.694499 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85b55c-598e-4830-bace-5af30830df4b admin admin] PATH_INFO: `/v3/projects/3ce98d6dfbeb4e9a893584e920c2f8b7/users/57a959817d824c9cb2e4ef66f9c81712/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:25.696640 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85b55c-598e-4830-bace-5af30830df4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce98d6dfbeb4e9a893584e920c2f8b7, user_id=57a959817d824c9cb2e4ef66f9c81712, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:25.699618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85b55c-598e-4830-bace-5af30830df4b admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:25.712282 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1422/2801] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:25 2022] PUT /identity/v3/projects/3ce98d6dfbeb4e9a893584e920c2f8b7/users/57a959817d824c9cb2e4ef66f9c81712/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:25.724990 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b5559-122c-429d-b094-c32312a2a7c0 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:25.725417 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b5559-122c-429d-b094-c32312a2a7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:25.725891 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b5559-122c-429d-b094-c32312a2a7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:25.760718 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-433b5559-122c-429d-b094-c32312a2a7c0 None None] MFA Rules not processed for user `57a959817d824c9cb2e4ef66f9c81712`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:25.761357 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-433b5559-122c-429d-b094-c32312a2a7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:25.834726 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1380/2802] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:25.842313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85b55c-598e-4830-bace-5af30830df4b admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:25.844476 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-dd85b55c-598e-4830-bace-5af30830df4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:25.848387 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b5559-122c-429d-b094-c32312a2a7c0 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:25.849907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-433b5559-122c-429d-b094-c32312a2a7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:25.916325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b5559-122c-429d-b094-c32312a2a7c0 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:25.920326 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8d282-7e1d-49f1-a0f8-9403d33ca012 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:25.921036 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8d282-7e1d-49f1-a0f8-9403d33ca012 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:25.921325 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8d282-7e1d-49f1-a0f8-9403d33ca012 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:25.921629 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8d282-7e1d-49f1-a0f8-9403d33ca012 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:25.929212 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85b55c-598e-4830-bace-5af30830df4b admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:25.937732 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8d282-7e1d-49f1-a0f8-9403d33ca012 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:25.938163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b6686-7fc9-4ccf-bcf1-2f8aa7b51881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:25.938879 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6686-7fc9-4ccf-bcf1-2f8aa7b51881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:25.939835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6686-7fc9-4ccf-bcf1-2f8aa7b51881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:25.940295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b6686-7fc9-4ccf-bcf1-2f8aa7b51881 admin admin] PATH_INFO: `/v3/projects/d7a97565bc464fd6ad7a3ac55f499720` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:25.940962 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8d282-7e1d-49f1-a0f8-9403d33ca012 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:25.941618 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b6686-7fc9-4ccf-bcf1-2f8aa7b51881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a97565bc464fd6ad7a3ac55f499720)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:25.943591 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b6686-7fc9-4ccf-bcf1-2f8aa7b51881 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:25.958063 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1381/2803] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:21:26.003053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0a9b6686-7fc9-4ccf-bcf1-2f8aa7b51881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a97565bc464fd6ad7a3ac55f499720', 'request_id': 'req-0a9b6686-7fc9-4ccf-bcf1-2f8aa7b51881'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:26.006935 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8d282-7e1d-49f1-a0f8-9403d33ca012 service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:26.008514 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-aaa8d282-7e1d-49f1-a0f8-9403d33ca012 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:26.011230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0a9b6686-7fc9-4ccf-bcf1-2f8aa7b51881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a97565bc464fd6ad7a3ac55f499720', 'request_id': 'req-0a9b6686-7fc9-4ccf-bcf1-2f8aa7b51881'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:26.020565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0a9b6686-7fc9-4ccf-bcf1-2f8aa7b51881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a97565bc464fd6ad7a3ac55f499720', 'request_id': 'req-0a9b6686-7fc9-4ccf-bcf1-2f8aa7b51881'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:26.023444 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8d282-7e1d-49f1-a0f8-9403d33ca012 service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:26.037727 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0a9b6686-7fc9-4ccf-bcf1-2f8aa7b51881 admin admin] The token cache is being invalidate because project d7a97565bc464fd6ad7a3ac55f499720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:21:26.038163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0a9b6686-7fc9-4ccf-bcf1-2f8aa7b51881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:26.039009 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-0a9b6686-7fc9-4ccf-bcf1-2f8aa7b51881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:26.044203 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1423/2804] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:21:25 2022] DELETE /identity/v3/projects/d7a97565bc464fd6ad7a3ac55f499720 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:26.045336 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b6686-7fc9-4ccf-bcf1-2f8aa7b51881 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:26.046880 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0a9b6686-7fc9-4ccf-bcf1-2f8aa7b51881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:26.060446 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:26.085237 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:26.085597 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17328d26-7d62-4e74-a477-01d9a5063056 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:26.086322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17328d26-7d62-4e74-a477-01d9a5063056 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:26.086797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17328d26-7d62-4e74-a477-01d9a5063056 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:26.087182 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17328d26-7d62-4e74-a477-01d9a5063056 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:26.089185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-17328d26-7d62-4e74-a477-01d9a5063056 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:26.122017 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b6686-7fc9-4ccf-bcf1-2f8aa7b51881 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:26.127341 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921a2af-ad64-40d1-a90f-b9e4325abfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:26.127988 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921a2af-ad64-40d1-a90f-b9e4325abfb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:26.128261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921a2af-ad64-40d1-a90f-b9e4325abfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:26.128561 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921a2af-ad64-40d1-a90f-b9e4325abfb6 admin admin] PATH_INFO: `/v3/users/9a8799fd98d84716972fa2fc10256850` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:26.129763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921a2af-ad64-40d1-a90f-b9e4325abfb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a8799fd98d84716972fa2fc10256850)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:26.131673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921a2af-ad64-40d1-a90f-b9e4325abfb6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:26.156003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17328d26-7d62-4e74-a477-01d9a5063056 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:26.158928 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17328d26-7d62-4e74-a477-01d9a5063056 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:26.169882 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1382/2805] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:21:26.181167 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1921a2af-ad64-40d1-a90f-b9e4325abfb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a8799fd98d84716972fa2fc10256850'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:26.182052 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1921a2af-ad64-40d1-a90f-b9e4325abfb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a8799fd98d84716972fa2fc10256850'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:26.190562 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1921a2af-ad64-40d1-a90f-b9e4325abfb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a8799fd98d84716972fa2fc10256850'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:26.203727 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1921a2af-ad64-40d1-a90f-b9e4325abfb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a8799fd98d84716972fa2fc10256850'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:26.211730 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-1921a2af-ad64-40d1-a90f-b9e4325abfb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a8799fd98d84716972fa2fc10256850'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:26.217905 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1424/2806] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:21:26 2022] DELETE /identity/v3/users/9a8799fd98d84716972fa2fc10256850 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:26.563158 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17328d26-7d62-4e74-a477-01d9a5063056 service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:26.575944 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17328d26-7d62-4e74-a477-01d9a5063056 service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:26.638050 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d915606c-4355-4033-92ad-c15071fdb3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:26.638697 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915606c-4355-4033-92ad-c15071fdb3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:26.638983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915606c-4355-4033-92ad-c15071fdb3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:26.639263 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d915606c-4355-4033-92ad-c15071fdb3e4 admin admin] PATH_INFO: `/v3/projects/9b1805cb542e439692fe8b2a4953e51b` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:26.640423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915606c-4355-4033-92ad-c15071fdb3e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b1805cb542e439692fe8b2a4953e51b)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:26.643130 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d915606c-4355-4033-92ad-c15071fdb3e4 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:26.688756 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-d915606c-4355-4033-92ad-c15071fdb3e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b1805cb542e439692fe8b2a4953e51b', 'request_id': 'req-d915606c-4355-4033-92ad-c15071fdb3e4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:26.694255 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-d915606c-4355-4033-92ad-c15071fdb3e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b1805cb542e439692fe8b2a4953e51b', 'request_id': 'req-d915606c-4355-4033-92ad-c15071fdb3e4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:26.700372 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-d915606c-4355-4033-92ad-c15071fdb3e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b1805cb542e439692fe8b2a4953e51b', 'request_id': 'req-d915606c-4355-4033-92ad-c15071fdb3e4'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:26.714513 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-d915606c-4355-4033-92ad-c15071fdb3e4 admin admin] The token cache is being invalidate because project 9b1805cb542e439692fe8b2a4953e51b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:21:26.714802 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-d915606c-4355-4033-92ad-c15071fdb3e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:26.715428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-d915606c-4355-4033-92ad-c15071fdb3e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:26.716959 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1383/2807] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:21:26 2022] DELETE /identity/v3/projects/9b1805cb542e439692fe8b2a4953e51b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:26.723935 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e47679-0525-43ea-8de2-d8dac30844c8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:26.724197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e47679-0525-43ea-8de2-d8dac30844c8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:26.724454 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e47679-0525-43ea-8de2-d8dac30844c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:26.745699 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-d3e47679-0525-43ea-8de2-d8dac30844c8 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:26.746892 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d3e47679-0525-43ea-8de2-d8dac30844c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:26.808368 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1425/2808] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:26.816613 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc08c7-7b6e-42c4-bd45-3ea01f52160a None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:26.816902 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc08c7-7b6e-42c4-bd45-3ea01f52160a None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:26.817178 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc08c7-7b6e-42c4-bd45-3ea01f52160a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:26.838334 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-dadc08c7-7b6e-42c4-bd45-3ea01f52160a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:26.839473 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-dadc08c7-7b6e-42c4-bd45-3ea01f52160a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:26.847988 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1384/2809] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:21:26.852441 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e47679-0525-43ea-8de2-d8dac30844c8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:26.862615 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e47679-0525-43ea-8de2-d8dac30844c8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:26.867487 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddc1aa-d5a4-4d9e-95c5-9d4188fd9c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:26.868097 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddc1aa-d5a4-4d9e-95c5-9d4188fd9c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:26.868382 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddc1aa-d5a4-4d9e-95c5-9d4188fd9c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:26.868695 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ddc1aa-d5a4-4d9e-95c5-9d4188fd9c09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:26.869428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddc1aa-d5a4-4d9e-95c5-9d4188fd9c09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:21:26.869736 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddc1aa-d5a4-4d9e-95c5-9d4188fd9c09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:26.871350 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ddc1aa-d5a4-4d9e-95c5-9d4188fd9c09 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:26.883665 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1426/2810] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:21:26.888209 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc08c7-7b6e-42c4-bd45-3ea01f52160a None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:26.898091 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc08c7-7b6e-42c4-bd45-3ea01f52160a None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:26.902768 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edd2ca-fbec-4833-9f84-4fa90a23f423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:26.903370 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edd2ca-fbec-4833-9f84-4fa90a23f423 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:26.903653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edd2ca-fbec-4833-9f84-4fa90a23f423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:26.903930 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edd2ca-fbec-4833-9f84-4fa90a23f423 admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:26.904630 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edd2ca-fbec-4833-9f84-4fa90a23f423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:26.906518 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edd2ca-fbec-4833-9f84-4fa90a23f423 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:26.912851 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:26.941065 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1385/2811] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:21:26 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:21:26.942141 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddc1aa-d5a4-4d9e-95c5-9d4188fd9c09 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:26.952304 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ddc1aa-d5a4-4d9e-95c5-9d4188fd9c09 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:26.987327 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:27.015269 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676200b3-c2e4-441d-972c-05c00a9171ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:27.015930 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676200b3-c2e4-441d-972c-05c00a9171ae admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:27.016214 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676200b3-c2e4-441d-972c-05c00a9171ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:27.016514 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676200b3-c2e4-441d-972c-05c00a9171ae admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:27.017840 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676200b3-c2e4-441d-972c-05c00a9171ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:27.019767 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676200b3-c2e4-441d-972c-05c00a9171ae admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:27.040934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1427/2812] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:21:26 2022] POST /identity/v3/users => generated 301 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:21:27.045747 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edd2ca-fbec-4833-9f84-4fa90a23f423 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:27.058018 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edd2ca-fbec-4833-9f84-4fa90a23f423 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:27.062817 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb8459-d449-418b-a4c4-764bbf749f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:27.063447 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb8459-d449-418b-a4c4-764bbf749f5b admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:27.063762 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb8459-d449-418b-a4c4-764bbf749f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:27.064121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb8459-d449-418b-a4c4-764bbf749f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:27.065068 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb8459-d449-418b-a4c4-764bbf749f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:27.066684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb8459-d449-418b-a4c4-764bbf749f5b admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:27.078289 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1386/2813] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:27.082876 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676200b3-c2e4-441d-972c-05c00a9171ae admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:27.094828 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676200b3-c2e4-441d-972c-05c00a9171ae admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:27.099982 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bcad0-be5c-405a-9c21-c91fbb496df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:27.100643 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bcad0-be5c-405a-9c21-c91fbb496df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:27.100927 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bcad0-be5c-405a-9c21-c91fbb496df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:27.101201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bcad0-be5c-405a-9c21-c91fbb496df6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:27.101902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7bcad0-be5c-405a-9c21-c91fbb496df6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:27.103513 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7bcad0-be5c-405a-9c21-c91fbb496df6 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:27.115423 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1428/2814] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:27.119887 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb8459-d449-418b-a4c4-764bbf749f5b admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:27.130049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb8459-d449-418b-a4c4-764bbf749f5b admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:27.134907 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf24d4-f19c-46b7-a437-2368bdee8afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:27.135566 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf24d4-f19c-46b7-a437-2368bdee8afe admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:27.135846 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf24d4-f19c-46b7-a437-2368bdee8afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:27.136121 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf24d4-f19c-46b7-a437-2368bdee8afe admin admin] PATH_INFO: `/v3/projects/ea432e90bb784e8ab19838d66c28b1ed/users/229d26024a3b46329575911d4eeda4f9/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:27.151265 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf24d4-f19c-46b7-a437-2368bdee8afe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea432e90bb784e8ab19838d66c28b1ed, user_id=229d26024a3b46329575911d4eeda4f9, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:27.153943 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf24d4-f19c-46b7-a437-2368bdee8afe admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:27.169934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1387/2815] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:27 2022] PUT /identity/v3/projects/ea432e90bb784e8ab19838d66c28b1ed/users/229d26024a3b46329575911d4eeda4f9/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:27.181260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7774d6-0c09-4ddd-9244-3b7e87ca88ec None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:27.181772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7774d6-0c09-4ddd-9244-3b7e87ca88ec None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:27.181872 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7774d6-0c09-4ddd-9244-3b7e87ca88ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:27.212980 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-8a7774d6-0c09-4ddd-9244-3b7e87ca88ec None None] MFA Rules not processed for user `229d26024a3b46329575911d4eeda4f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:27.214198 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-8a7774d6-0c09-4ddd-9244-3b7e87ca88ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:27.287860 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1429/2816] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:27 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:21:27.294713 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf24d4-f19c-46b7-a437-2368bdee8afe admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:27.363108 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf24d4-f19c-46b7-a437-2368bdee8afe admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:27.367840 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f8305-30a2-4765-8e08-0033a803afcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:27.368489 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f8305-30a2-4765-8e08-0033a803afcd admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:27.368769 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f8305-30a2-4765-8e08-0033a803afcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:27.369047 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f8305-30a2-4765-8e08-0033a803afcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:27.369724 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f8305-30a2-4765-8e08-0033a803afcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:27.371628 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f8305-30a2-4765-8e08-0033a803afcd admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:27.399960 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1388/2817] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:21:27 2022] POST /identity/v3/projects => generated 399 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:21:27.404325 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7774d6-0c09-4ddd-9244-3b7e87ca88ec None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:27.416127 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7774d6-0c09-4ddd-9244-3b7e87ca88ec None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:27.481855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0983771-439a-496c-8559-351c6c342fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:27.482480 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0983771-439a-496c-8559-351c6c342fdf admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:27.482763 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0983771-439a-496c-8559-351c6c342fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:27.483040 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0983771-439a-496c-8559-351c6c342fdf admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:27.483731 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0983771-439a-496c-8559-351c6c342fdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:27.486447 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0983771-439a-496c-8559-351c6c342fdf admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:27.509369 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1430/2818] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:21:27 2022] POST /identity/v3/users => generated 306 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:21:27.513717 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f8305-30a2-4765-8e08-0033a803afcd admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:27.525176 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f8305-30a2-4765-8e08-0033a803afcd admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:27.531221 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1d4ed-d585-48b7-a4a9-a10509c19c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:27.531833 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1d4ed-d585-48b7-a4a9-a10509c19c52 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:27.532146 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1d4ed-d585-48b7-a4a9-a10509c19c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:27.532426 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1d4ed-d585-48b7-a4a9-a10509c19c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:27.534321 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1d4ed-d585-48b7-a4a9-a10509c19c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:27.535931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1d4ed-d585-48b7-a4a9-a10509c19c52 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:27.547220 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1389/2819] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:21:27.551735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0983771-439a-496c-8559-351c6c342fdf admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:27.569484 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0983771-439a-496c-8559-351c6c342fdf admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:27.574585 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d0f5c-45b1-4a9c-94f0-0a1cf7d03855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:27.575272 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d0f5c-45b1-4a9c-94f0-0a1cf7d03855 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:27.575565 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d0f5c-45b1-4a9c-94f0-0a1cf7d03855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:27.575848 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d0f5c-45b1-4a9c-94f0-0a1cf7d03855 admin admin] PATH_INFO: `/v3/projects/2ca3822a4af0439fac4142d389b731a9/users/0a681f13692e46a588e92ff9cad7866d/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:27.594885 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d0f5c-45b1-4a9c-94f0-0a1cf7d03855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca3822a4af0439fac4142d389b731a9, user_id=0a681f13692e46a588e92ff9cad7866d, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:27.597645 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1d0f5c-45b1-4a9c-94f0-0a1cf7d03855 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:27.613371 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1431/2820] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:27 2022] PUT /identity/v3/projects/2ca3822a4af0439fac4142d389b731a9/users/0a681f13692e46a588e92ff9cad7866d/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:27.617046 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1d4ed-d585-48b7-a4a9-a10509c19c52 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:27.628592 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1d4ed-d585-48b7-a4a9-a10509c19c52 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:27.710344 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60933e-4074-4ac2-beb9-efac1f3d3e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:27.710896 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60933e-4074-4ac2-beb9-efac1f3d3e24 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:27.711199 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60933e-4074-4ac2-beb9-efac1f3d3e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:27.711453 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60933e-4074-4ac2-beb9-efac1f3d3e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:27.712171 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60933e-4074-4ac2-beb9-efac1f3d3e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:27.713785 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60933e-4074-4ac2-beb9-efac1f3d3e24 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:27.724544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1390/2821] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:21:27.728948 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d0f5c-45b1-4a9c-94f0-0a1cf7d03855 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:27.740518 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d0f5c-45b1-4a9c-94f0-0a1cf7d03855 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:27.745924 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5c81a-3f86-4b37-ab56-90a0cf97f8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:27.746766 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5c81a-3f86-4b37-ab56-90a0cf97f8e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:27.747166 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5c81a-3f86-4b37-ab56-90a0cf97f8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:27.747542 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5c81a-3f86-4b37-ab56-90a0cf97f8e7 admin admin] PATH_INFO: `/v3/projects/2ca3822a4af0439fac4142d389b731a9/users/0a681f13692e46a588e92ff9cad7866d/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:27.750006 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5c81a-3f86-4b37-ab56-90a0cf97f8e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca3822a4af0439fac4142d389b731a9, user_id=0a681f13692e46a588e92ff9cad7866d, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:27.753795 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5c81a-3f86-4b37-ab56-90a0cf97f8e7 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:27.757417 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:27.767804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1432/2822] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:27 2022] PUT /identity/v3/projects/2ca3822a4af0439fac4142d389b731a9/users/0a681f13692e46a588e92ff9cad7866d/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:21:27.778925 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a5639-a35b-44dc-bf20-89e67bf0fba8 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:27.779262 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a5639-a35b-44dc-bf20-89e67bf0fba8 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:27.779485 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a5639-a35b-44dc-bf20-89e67bf0fba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:27.815805 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-4b2a5639-a35b-44dc-bf20-89e67bf0fba8 None None] MFA Rules not processed for user `0a681f13692e46a588e92ff9cad7866d`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:27.820508 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4b2a5639-a35b-44dc-bf20-89e67bf0fba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:27.832083 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:27.910190 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1391/2823] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:27 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:27.926519 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5c81a-3f86-4b37-ab56-90a0cf97f8e7 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:27.928725 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-04c5c81a-3f86-4b37-ab56-90a0cf97f8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:27.994667 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5c81a-3f86-4b37-ab56-90a0cf97f8e7 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:27.998709 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d6f7a-f36c-43fb-8c74-c2d7bb6dee44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:27.999336 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d6f7a-f36c-43fb-8c74-c2d7bb6dee44 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:27.999620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d6f7a-f36c-43fb-8c74-c2d7bb6dee44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:27.999899 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9d6f7a-f36c-43fb-8c74-c2d7bb6dee44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:28.013268 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d6f7a-f36c-43fb-8c74-c2d7bb6dee44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:28.014658 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9d6f7a-f36c-43fb-8c74-c2d7bb6dee44 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:28.026347 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1433/2824] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:27 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:21:28.116838 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a5639-a35b-44dc-bf20-89e67bf0fba8 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:28.118227 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4b2a5639-a35b-44dc-bf20-89e67bf0fba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:28.131312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a5639-a35b-44dc-bf20-89e67bf0fba8 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:28.135002 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6f07c-6d40-4b92-9074-26c7574eda08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:28.135625 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6f07c-6d40-4b92-9074-26c7574eda08 service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:28.135911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6f07c-6d40-4b92-9074-26c7574eda08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:28.136185 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6f07c-6d40-4b92-9074-26c7574eda08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:28.200828 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6f07c-6d40-4b92-9074-26c7574eda08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:28.202289 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6f07c-6d40-4b92-9074-26c7574eda08 service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:28.214949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1392/2825] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:28 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:21:29.173483 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d6f7a-f36c-43fb-8c74-c2d7bb6dee44 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:29.175074 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2a9d6f7a-f36c-43fb-8c74-c2d7bb6dee44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:29.249275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9d6f7a-f36c-43fb-8c74-c2d7bb6dee44 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:29.255139 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b15405-3d7e-45ae-89a2-713f8a9892a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:29.255813 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b15405-3d7e-45ae-89a2-713f8a9892a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:29.256098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b15405-3d7e-45ae-89a2-713f8a9892a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:29.256371 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b15405-3d7e-45ae-89a2-713f8a9892a2 admin admin] PATH_INFO: `/v3/users/7545d748e6664e7db243b7ab909d2f2c` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:29.257594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b15405-3d7e-45ae-89a2-713f8a9892a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7545d748e6664e7db243b7ab909d2f2c)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:29.259520 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b15405-3d7e-45ae-89a2-713f8a9892a2 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:29.317453 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f2b15405-3d7e-45ae-89a2-713f8a9892a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7545d748e6664e7db243b7ab909d2f2c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:29.318197 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f2b15405-3d7e-45ae-89a2-713f8a9892a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7545d748e6664e7db243b7ab909d2f2c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:29.325782 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f2b15405-3d7e-45ae-89a2-713f8a9892a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7545d748e6664e7db243b7ab909d2f2c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:29.338755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f2b15405-3d7e-45ae-89a2-713f8a9892a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7545d748e6664e7db243b7ab909d2f2c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:29.347495 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-f2b15405-3d7e-45ae-89a2-713f8a9892a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7545d748e6664e7db243b7ab909d2f2c'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:29.353852 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1434/2826] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:21:29 2022] DELETE /identity/v3/users/7545d748e6664e7db243b7ab909d2f2c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:29.358878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a60de8-073f-4498-9afb-88d4ad2adb63 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:29.359380 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a60de8-073f-4498-9afb-88d4ad2adb63 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:29.359550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a60de8-073f-4498-9afb-88d4ad2adb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:29.385003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-50a60de8-073f-4498-9afb-88d4ad2adb63 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:29.386236 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-50a60de8-073f-4498-9afb-88d4ad2adb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:29.452550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1393/2827] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:29.462884 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b15405-3d7e-45ae-89a2-713f8a9892a2 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:29.464409 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f2b15405-3d7e-45ae-89a2-713f8a9892a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:29.487787 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:29.530772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b15405-3d7e-45ae-89a2-713f8a9892a2 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:29.535200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe6160-8431-483d-b389-87824ae58678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:29.535824 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe6160-8431-483d-b389-87824ae58678 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:29.536110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe6160-8431-483d-b389-87824ae58678 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:29.536411 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe6160-8431-483d-b389-87824ae58678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:29.547089 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe6160-8431-483d-b389-87824ae58678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:29.548767 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe6160-8431-483d-b389-87824ae58678 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:29.560524 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1435/2828] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:21:29.903964 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a60de8-073f-4498-9afb-88d4ad2adb63 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:29.911427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-50a60de8-073f-4498-9afb-88d4ad2adb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:29.942544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a60de8-073f-4498-9afb-88d4ad2adb63 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:29.951135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9f473-ba65-409c-94fe-535de304582f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:29.951968 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9f473-ba65-409c-94fe-535de304582f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:29.952378 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9f473-ba65-409c-94fe-535de304582f admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:29.952795 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9f473-ba65-409c-94fe-535de304582f admin admin] PATH_INFO: `/v3/projects/c8de64f691c04f3e993508850b6024f7` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:29.954118 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9f473-ba65-409c-94fe-535de304582f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8de64f691c04f3e993508850b6024f7)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:29.957827 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9f473-ba65-409c-94fe-535de304582f admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:30.003750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:30.011860 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-73d9f473-ba65-409c-94fe-535de304582f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8de64f691c04f3e993508850b6024f7', 'request_id': 'req-73d9f473-ba65-409c-94fe-535de304582f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:30.020806 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-73d9f473-ba65-409c-94fe-535de304582f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8de64f691c04f3e993508850b6024f7', 'request_id': 'req-73d9f473-ba65-409c-94fe-535de304582f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:30.028323 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-73d9f473-ba65-409c-94fe-535de304582f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8de64f691c04f3e993508850b6024f7', 'request_id': 'req-73d9f473-ba65-409c-94fe-535de304582f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:30.043931 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-73d9f473-ba65-409c-94fe-535de304582f admin admin] The token cache is being invalidate because project c8de64f691c04f3e993508850b6024f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:21:30.044215 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-73d9f473-ba65-409c-94fe-535de304582f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:30.044866 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-73d9f473-ba65-409c-94fe-535de304582f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:30.047424 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1394/2829] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:21:29 2022] DELETE /identity/v3/projects/c8de64f691c04f3e993508850b6024f7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:30.050726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe6160-8431-483d-b389-87824ae58678 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:30.061379 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe6160-8431-483d-b389-87824ae58678 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:30.122085 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33eea5b-cd7c-419b-b892-70be5c9531f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:30.122610 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eea5b-cd7c-419b-b892-70be5c9531f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:30.122891 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eea5b-cd7c-419b-b892-70be5c9531f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:30.123163 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33eea5b-cd7c-419b-b892-70be5c9531f5 admin admin] PATH_INFO: `/v3/users/23b993a6558f419aa07069141e4d66dc` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:30.124360 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33eea5b-cd7c-419b-b892-70be5c9531f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b993a6558f419aa07069141e4d66dc)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:30.126999 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33eea5b-cd7c-419b-b892-70be5c9531f5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:30.180086 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d33eea5b-cd7c-419b-b892-70be5c9531f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b993a6558f419aa07069141e4d66dc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:30.180831 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d33eea5b-cd7c-419b-b892-70be5c9531f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b993a6558f419aa07069141e4d66dc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:30.187836 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d33eea5b-cd7c-419b-b892-70be5c9531f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b993a6558f419aa07069141e4d66dc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:30.202506 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d33eea5b-cd7c-419b-b892-70be5c9531f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b993a6558f419aa07069141e4d66dc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:30.211290 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-d33eea5b-cd7c-419b-b892-70be5c9531f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b993a6558f419aa07069141e4d66dc'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:30.219225 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1436/2830] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:21:30 2022] DELETE /identity/v3/users/23b993a6558f419aa07069141e4d66dc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:30.505797 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9f473-ba65-409c-94fe-535de304582f admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:30.507353 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-73d9f473-ba65-409c-94fe-535de304582f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:30.520636 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9f473-ba65-409c-94fe-535de304582f admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:30.583351 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260fd04-e238-4c33-b2a1-7e026204c84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:30.584002 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260fd04-e238-4c33-b2a1-7e026204c84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:30.584345 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260fd04-e238-4c33-b2a1-7e026204c84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:30.584687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260fd04-e238-4c33-b2a1-7e026204c84d admin admin] PATH_INFO: `/v3/projects/b07916c48eac463e8562c86c722fc9aa` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:30.586296 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260fd04-e238-4c33-b2a1-7e026204c84d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b07916c48eac463e8562c86c722fc9aa)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:30.589666 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f260fd04-e238-4c33-b2a1-7e026204c84d admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:30.645019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f260fd04-e238-4c33-b2a1-7e026204c84d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b07916c48eac463e8562c86c722fc9aa', 'request_id': 'req-f260fd04-e238-4c33-b2a1-7e026204c84d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:30.650778 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f260fd04-e238-4c33-b2a1-7e026204c84d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b07916c48eac463e8562c86c722fc9aa', 'request_id': 'req-f260fd04-e238-4c33-b2a1-7e026204c84d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:30.658250 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f260fd04-e238-4c33-b2a1-7e026204c84d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b07916c48eac463e8562c86c722fc9aa', 'request_id': 'req-f260fd04-e238-4c33-b2a1-7e026204c84d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:30.675010 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f260fd04-e238-4c33-b2a1-7e026204c84d admin admin] The token cache is being invalidate because project b07916c48eac463e8562c86c722fc9aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:21:30.675299 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f260fd04-e238-4c33-b2a1-7e026204c84d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:30.675955 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-f260fd04-e238-4c33-b2a1-7e026204c84d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:30.677519 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1395/2831] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:21:30 2022] DELETE /identity/v3/projects/b07916c48eac463e8562c86c722fc9aa => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:30.683999 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33eea5b-cd7c-419b-b892-70be5c9531f5 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:30.685461 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d33eea5b-cd7c-419b-b892-70be5c9531f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:30.698807 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33eea5b-cd7c-419b-b892-70be5c9531f5 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:30.742936 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:30.763195 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f6cc6-5a2c-4c7e-acea-ffe77535c578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:30.763850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f6cc6-5a2c-4c7e-acea-ffe77535c578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:30.764134 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f6cc6-5a2c-4c7e-acea-ffe77535c578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:30.764412 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f6cc6-5a2c-4c7e-acea-ffe77535c578 admin admin] PATH_INFO: `/v3/users/57a959817d824c9cb2e4ef66f9c81712` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:30.765635 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f6cc6-5a2c-4c7e-acea-ffe77535c578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57a959817d824c9cb2e4ef66f9c81712)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:30.767632 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6f6cc6-5a2c-4c7e-acea-ffe77535c578 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:30.820210 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bf6f6cc6-5a2c-4c7e-acea-ffe77535c578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57a959817d824c9cb2e4ef66f9c81712'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:30.820894 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bf6f6cc6-5a2c-4c7e-acea-ffe77535c578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57a959817d824c9cb2e4ef66f9c81712'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:30.827929 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bf6f6cc6-5a2c-4c7e-acea-ffe77535c578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57a959817d824c9cb2e4ef66f9c81712'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:30.840059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bf6f6cc6-5a2c-4c7e-acea-ffe77535c578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57a959817d824c9cb2e4ef66f9c81712'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:30.848505 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-bf6f6cc6-5a2c-4c7e-acea-ffe77535c578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57a959817d824c9cb2e4ef66f9c81712'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:30.854735 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1437/2832] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:21:30 2022] DELETE /identity/v3/users/57a959817d824c9cb2e4ef66f9c81712 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:31.162901 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260fd04-e238-4c33-b2a1-7e026204c84d admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:31.164591 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-f260fd04-e238-4c33-b2a1-7e026204c84d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:31.183002 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260fd04-e238-4c33-b2a1-7e026204c84d admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:31.257188 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcf51c0-d901-474d-9445-7daedf0ae19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:31.257811 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf51c0-d901-474d-9445-7daedf0ae19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:31.258088 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf51c0-d901-474d-9445-7daedf0ae19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:31.258421 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcf51c0-d901-474d-9445-7daedf0ae19e admin admin] PATH_INFO: `/v3/projects/3ce98d6dfbeb4e9a893584e920c2f8b7` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:31.259783 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf51c0-d901-474d-9445-7daedf0ae19e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce98d6dfbeb4e9a893584e920c2f8b7)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:31.261727 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcf51c0-d901-474d-9445-7daedf0ae19e admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:31.263611 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:31.317306 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-dbcf51c0-d901-474d-9445-7daedf0ae19e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce98d6dfbeb4e9a893584e920c2f8b7', 'request_id': 'req-dbcf51c0-d901-474d-9445-7daedf0ae19e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:31.323638 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-dbcf51c0-d901-474d-9445-7daedf0ae19e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce98d6dfbeb4e9a893584e920c2f8b7', 'request_id': 'req-dbcf51c0-d901-474d-9445-7daedf0ae19e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:31.331601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-dbcf51c0-d901-474d-9445-7daedf0ae19e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce98d6dfbeb4e9a893584e920c2f8b7', 'request_id': 'req-dbcf51c0-d901-474d-9445-7daedf0ae19e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:31.349182 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-dbcf51c0-d901-474d-9445-7daedf0ae19e admin admin] The token cache is being invalidate because project 3ce98d6dfbeb4e9a893584e920c2f8b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80329) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:21:31.349469 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-dbcf51c0-d901-474d-9445-7daedf0ae19e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:31.350223 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-dbcf51c0-d901-474d-9445-7daedf0ae19e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:31.352132 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1396/2833] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:21:31 2022] DELETE /identity/v3/projects/3ce98d6dfbeb4e9a893584e920c2f8b7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:31.362396 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481ecb9-587d-4c41-9cb6-7c5e252885d8 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:31.363005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481ecb9-587d-4c41-9cb6-7c5e252885d8 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:31.363005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481ecb9-587d-4c41-9cb6-7c5e252885d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:31.386369 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-9481ecb9-587d-4c41-9cb6-7c5e252885d8 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:31.387812 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9481ecb9-587d-4c41-9cb6-7c5e252885d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:31.453537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1438/2834] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:31.462730 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd15d5-666c-4c4a-aee4-a6f06e20ee95 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:31.463020 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd15d5-666c-4c4a-aee4-a6f06e20ee95 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:31.463298 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd15d5-666c-4c4a-aee4-a6f06e20ee95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:31.486051 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-27bd15d5-666c-4c4a-aee4-a6f06e20ee95 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:31.487324 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-27bd15d5-666c-4c4a-aee4-a6f06e20ee95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:31.495609 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1397/2835] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:31.500245 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481ecb9-587d-4c41-9cb6-7c5e252885d8 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:31.511399 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481ecb9-587d-4c41-9cb6-7c5e252885d8 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:31.516126 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47077f-8b91-46ed-83c8-826672c84d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:31.516780 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47077f-8b91-46ed-83c8-826672c84d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:31.517779 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47077f-8b91-46ed-83c8-826672c84d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:31.518284 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47077f-8b91-46ed-83c8-826672c84d96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:31.519059 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47077f-8b91-46ed-83c8-826672c84d96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80330) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:21:31.519356 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47077f-8b91-46ed-83c8-826672c84d96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:31.520994 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d47077f-8b91-46ed-83c8-826672c84d96 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:31.533637 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1439/2836] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:21:31.538207 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd15d5-666c-4c4a-aee4-a6f06e20ee95 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:31.547922 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd15d5-666c-4c4a-aee4-a6f06e20ee95 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:31.552969 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c49d51-4c6f-4f36-b059-8750d4a7c60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:31.553586 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c49d51-4c6f-4f36-b059-8750d4a7c60c admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:31.553869 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c49d51-4c6f-4f36-b059-8750d4a7c60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:31.554143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c49d51-4c6f-4f36-b059-8750d4a7c60c admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:31.554829 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c49d51-4c6f-4f36-b059-8750d4a7c60c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:31.556774 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c49d51-4c6f-4f36-b059-8750d4a7c60c admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:31.592849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1398/2837] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:21:31 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:21:31.597248 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47077f-8b91-46ed-83c8-826672c84d96 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:31.608757 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d47077f-8b91-46ed-83c8-826672c84d96 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:31.654130 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:31.671221 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda805f-22ff-47da-bb34-a72b949e9592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:31.671845 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda805f-22ff-47da-bb34-a72b949e9592 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:31.672194 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda805f-22ff-47da-bb34-a72b949e9592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:31.672447 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda805f-22ff-47da-bb34-a72b949e9592 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:31.673752 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda805f-22ff-47da-bb34-a72b949e9592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:31.675805 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda805f-22ff-47da-bb34-a72b949e9592 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:31.706493 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1440/2838] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:21:31 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:21:31.710645 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c49d51-4c6f-4f36-b059-8750d4a7c60c admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:31.721550 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c49d51-4c6f-4f36-b059-8750d4a7c60c admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:31.727044 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6864081-8ddf-41b3-8a68-b906eb3dfc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:31.727687 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6864081-8ddf-41b3-8a68-b906eb3dfc5f admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:31.727975 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6864081-8ddf-41b3-8a68-b906eb3dfc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:31.728258 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6864081-8ddf-41b3-8a68-b906eb3dfc5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:31.728995 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6864081-8ddf-41b3-8a68-b906eb3dfc5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:31.730637 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6864081-8ddf-41b3-8a68-b906eb3dfc5f admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:31.743423 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1399/2839] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:21:31.747787 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda805f-22ff-47da-bb34-a72b949e9592 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:31.758942 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda805f-22ff-47da-bb34-a72b949e9592 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:31.765122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9cc0f-5b53-4068-93e9-c1a4530f50d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:31.765740 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9cc0f-5b53-4068-93e9-c1a4530f50d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:31.766023 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9cc0f-5b53-4068-93e9-c1a4530f50d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:31.766299 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9cc0f-5b53-4068-93e9-c1a4530f50d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:31.767044 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9cc0f-5b53-4068-93e9-c1a4530f50d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:31.769123 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9cc0f-5b53-4068-93e9-c1a4530f50d5 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:31.780615 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1441/2840] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:31.785080 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6864081-8ddf-41b3-8a68-b906eb3dfc5f admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:31.795393 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6864081-8ddf-41b3-8a68-b906eb3dfc5f admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:31.801388 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b1765-6ce0-46a1-b433-af66d0c874b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:31.802045 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b1765-6ce0-46a1-b433-af66d0c874b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:31.802328 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b1765-6ce0-46a1-b433-af66d0c874b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:31.802606 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b1765-6ce0-46a1-b433-af66d0c874b4 admin admin] PATH_INFO: `/v3/projects/2017c386d29e46f78ffb84a0e9280dfd/users/1e8ee338f72a4a72817e49a45c040c9e/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:31.819222 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b1765-6ce0-46a1-b433-af66d0c874b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2017c386d29e46f78ffb84a0e9280dfd, user_id=1e8ee338f72a4a72817e49a45c040c9e, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:31.823524 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b1765-6ce0-46a1-b433-af66d0c874b4 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:31.836146 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1400/2841] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:31 2022] PUT /identity/v3/projects/2017c386d29e46f78ffb84a0e9280dfd/users/1e8ee338f72a4a72817e49a45c040c9e/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:31.849211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714024-11d0-459f-94a2-cc4007d53c22 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:31.849499 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714024-11d0-459f-94a2-cc4007d53c22 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:31.849772 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0714024-11d0-459f-94a2-cc4007d53c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:31.882409 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-e0714024-11d0-459f-94a2-cc4007d53c22 None None] MFA Rules not processed for user `1e8ee338f72a4a72817e49a45c040c9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:31.882409 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e0714024-11d0-459f-94a2-cc4007d53c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:31.967114 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1442/2842] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:31.971861 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b1765-6ce0-46a1-b433-af66d0c874b4 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:32.041322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b1765-6ce0-46a1-b433-af66d0c874b4 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:32.046598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ae6cb-0706-4fdd-939c-fd7643c15aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:32.047222 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ae6cb-0706-4fdd-939c-fd7643c15aeb admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:32.047511 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ae6cb-0706-4fdd-939c-fd7643c15aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:32.047790 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ae6cb-0706-4fdd-939c-fd7643c15aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:32.049068 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ae6cb-0706-4fdd-939c-fd7643c15aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:32.050971 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ae6cb-0706-4fdd-939c-fd7643c15aeb admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:32.083539 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1401/2843] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:21:31 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:21:32.087902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0714024-11d0-459f-94a2-cc4007d53c22 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:32.099708 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0714024-11d0-459f-94a2-cc4007d53c22 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:32.159191 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336fd4f-edac-47d7-97ce-ff9c76274e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:32.159882 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336fd4f-edac-47d7-97ce-ff9c76274e62 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:32.160029 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336fd4f-edac-47d7-97ce-ff9c76274e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:32.160424 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336fd4f-edac-47d7-97ce-ff9c76274e62 admin admin] PATH_INFO: `/v3/users` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:32.161294 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336fd4f-edac-47d7-97ce-ff9c76274e62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:32.163260 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8336fd4f-edac-47d7-97ce-ff9c76274e62 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:32.191304 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1443/2844] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:21:32 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:21:32.196286 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ae6cb-0706-4fdd-939c-fd7643c15aeb admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:32.207283 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ae6cb-0706-4fdd-939c-fd7643c15aeb admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:32.212190 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0aaaf-9336-4bc2-b896-7230247b828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:32.212842 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0aaaf-9336-4bc2-b896-7230247b828f admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:32.213123 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0aaaf-9336-4bc2-b896-7230247b828f admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:32.213404 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0aaaf-9336-4bc2-b896-7230247b828f admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:32.214098 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0aaaf-9336-4bc2-b896-7230247b828f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:32.215917 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0aaaf-9336-4bc2-b896-7230247b828f admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:32.222275 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:32.232301 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1402/2845] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:32.238616 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336fd4f-edac-47d7-97ce-ff9c76274e62 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:32.258676 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8336fd4f-edac-47d7-97ce-ff9c76274e62 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:32.264683 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322a112-f728-4a7f-a6c1-6423b45a1db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:32.265358 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322a112-f728-4a7f-a6c1-6423b45a1db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:32.265850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322a112-f728-4a7f-a6c1-6423b45a1db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:32.265971 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322a112-f728-4a7f-a6c1-6423b45a1db4 admin admin] PATH_INFO: `/v3/projects/33680fb27b2843748c0b5444718e2578/users/593e254777724c4098ab44a40cec0b7f/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:32.287108 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322a112-f728-4a7f-a6c1-6423b45a1db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33680fb27b2843748c0b5444718e2578, user_id=593e254777724c4098ab44a40cec0b7f, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:32.289887 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322a112-f728-4a7f-a6c1-6423b45a1db4 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:32.306992 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1444/2846] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:32 2022] PUT /identity/v3/projects/33680fb27b2843748c0b5444718e2578/users/593e254777724c4098ab44a40cec0b7f/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:21:32.311602 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0aaaf-9336-4bc2-b896-7230247b828f admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:32.321677 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0aaaf-9336-4bc2-b896-7230247b828f admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:32.396389 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a4bcc-dbae-45cd-8a75-dadd330faf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:32.397049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a4bcc-dbae-45cd-8a75-dadd330faf1f admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:32.397363 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a4bcc-dbae-45cd-8a75-dadd330faf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:32.397608 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a4bcc-dbae-45cd-8a75-dadd330faf1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:32.398340 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a4bcc-dbae-45cd-8a75-dadd330faf1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:32.399951 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a4bcc-dbae-45cd-8a75-dadd330faf1f admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:32.414836 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1403/2847] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:21:32.416246 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322a112-f728-4a7f-a6c1-6423b45a1db4 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:32.430800 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322a112-f728-4a7f-a6c1-6423b45a1db4 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:32.436231 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5bacd-01af-4788-b049-2d6d4bd812e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:32.437074 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5bacd-01af-4788-b049-2d6d4bd812e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:32.437425 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5bacd-01af-4788-b049-2d6d4bd812e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:32.437703 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5bacd-01af-4788-b049-2d6d4bd812e9 admin admin] PATH_INFO: `/v3/projects/33680fb27b2843748c0b5444718e2578/users/593e254777724c4098ab44a40cec0b7f/roles/c15ca78eb3c9472f94e15e2d28c7f403` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:32.440209 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5bacd-01af-4788-b049-2d6d4bd812e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33680fb27b2843748c0b5444718e2578, user_id=593e254777724c4098ab44a40cec0b7f, role_id=c15ca78eb3c9472f94e15e2d28c7f403)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:32.443005 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5bacd-01af-4788-b049-2d6d4bd812e9 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:32.454970 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1445/2848] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:32 2022] PUT /identity/v3/projects/33680fb27b2843748c0b5444718e2578/users/593e254777724c4098ab44a40cec0b7f/roles/c15ca78eb3c9472f94e15e2d28c7f403 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:32.458949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a4bcc-dbae-45cd-8a75-dadd330faf1f admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:32.460919 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-831a4bcc-dbae-45cd-8a75-dadd330faf1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:32.465594 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad458390-38a7-4907-abc7-067324641253 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:32.465907 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad458390-38a7-4907-abc7-067324641253 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:32.466183 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad458390-38a7-4907-abc7-067324641253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:32.476444 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a4bcc-dbae-45cd-8a75-dadd330faf1f admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:32.482186 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:32.497838 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-ad458390-38a7-4907-abc7-067324641253 None None] MFA Rules not processed for user `593e254777724c4098ab44a40cec0b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:32.499095 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ad458390-38a7-4907-abc7-067324641253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:32.541569 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b60e10-d9f1-44e0-8af1-d75e655659c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:32.542218 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b60e10-d9f1-44e0-8af1-d75e655659c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:32.542482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b60e10-d9f1-44e0-8af1-d75e655659c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:32.542754 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b60e10-d9f1-44e0-8af1-d75e655659c8 admin admin] PATH_INFO: `/v3/users/229d26024a3b46329575911d4eeda4f9` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:32.543938 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b60e10-d9f1-44e0-8af1-d75e655659c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=229d26024a3b46329575911d4eeda4f9)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:32.546023 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b60e10-d9f1-44e0-8af1-d75e655659c8 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:32.581155 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1446/2849] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:32.596319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad458390-38a7-4907-abc7-067324641253 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:32.597804 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-ad458390-38a7-4907-abc7-067324641253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:32.609204 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-85b60e10-d9f1-44e0-8af1-d75e655659c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '229d26024a3b46329575911d4eeda4f9'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:32.609971 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-85b60e10-d9f1-44e0-8af1-d75e655659c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '229d26024a3b46329575911d4eeda4f9'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:32.625962 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-85b60e10-d9f1-44e0-8af1-d75e655659c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '229d26024a3b46329575911d4eeda4f9'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:32.638993 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-85b60e10-d9f1-44e0-8af1-d75e655659c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '229d26024a3b46329575911d4eeda4f9'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:32.640069 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-85b60e10-d9f1-44e0-8af1-d75e655659c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '229d26024a3b46329575911d4eeda4f9'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:32.654379 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1404/2850] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:21:32 2022] DELETE /identity/v3/users/229d26024a3b46329575911d4eeda4f9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:32.659785 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19c366-54f3-4b00-bdbe-f103a3a3fdbb None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:32.660066 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19c366-54f3-4b00-bdbe-f103a3a3fdbb None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:32.660339 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19c366-54f3-4b00-bdbe-f103a3a3fdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:32.665617 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad458390-38a7-4907-abc7-067324641253 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:32.683189 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-dc19c366-54f3-4b00-bdbe-f103a3a3fdbb None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:32.684663 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-dc19c366-54f3-4b00-bdbe-f103a3a3fdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:32.697115 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:32.725964 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1daa0e-2799-4c51-82a9-0ee63b25904a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:32.726652 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1daa0e-2799-4c51-82a9-0ee63b25904a service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:32.726874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1daa0e-2799-4c51-82a9-0ee63b25904a service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:32.727145 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1daa0e-2799-4c51-82a9-0ee63b25904a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:32.729056 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0e1daa0e-2799-4c51-82a9-0ee63b25904a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:32.758286 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1405/2851] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:32.770279 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19c366-54f3-4b00-bdbe-f103a3a3fdbb None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:32.771729 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-dc19c366-54f3-4b00-bdbe-f103a3a3fdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:32.802411 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1daa0e-2799-4c51-82a9-0ee63b25904a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:32.803907 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1daa0e-2799-4c51-82a9-0ee63b25904a service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:32.814507 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1447/2852] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:21:32.842224 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19c366-54f3-4b00-bdbe-f103a3a3fdbb None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:32.847218 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ee2c3-b5b8-4120-84a8-584d92cc5e75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:32.847836 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ee2c3-b5b8-4120-84a8-584d92cc5e75 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:32.848120 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ee2c3-b5b8-4120-84a8-584d92cc5e75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:32.848395 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ee2c3-b5b8-4120-84a8-584d92cc5e75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:32.858981 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ee2c3-b5b8-4120-84a8-584d92cc5e75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:32.861480 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ee2c3-b5b8-4120-84a8-584d92cc5e75 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:32.872956 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1406/2853] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:21:33.213101 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1daa0e-2799-4c51-82a9-0ee63b25904a service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:33.215158 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-0e1daa0e-2799-4c51-82a9-0ee63b25904a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:33.226178 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=100 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:33.234142 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1daa0e-2799-4c51-82a9-0ee63b25904a service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:33.242737 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ef92c-1e1e-4b21-85e3-ed109f0e524a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:33.243500 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ef92c-1e1e-4b21-85e3-ed109f0e524a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:33.243855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ef92c-1e1e-4b21-85e3-ed109f0e524a admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:33.244295 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ef92c-1e1e-4b21-85e3-ed109f0e524a admin admin] PATH_INFO: `/v3/projects/ea432e90bb784e8ab19838d66c28b1ed` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:33.245855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ef92c-1e1e-4b21-85e3-ed109f0e524a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea432e90bb784e8ab19838d66c28b1ed)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:33.248671 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50ef92c-1e1e-4b21-85e3-ed109f0e524a admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:33.313344 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e50ef92c-1e1e-4b21-85e3-ed109f0e524a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea432e90bb784e8ab19838d66c28b1ed', 'request_id': 'req-e50ef92c-1e1e-4b21-85e3-ed109f0e524a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:33.320090 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e50ef92c-1e1e-4b21-85e3-ed109f0e524a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea432e90bb784e8ab19838d66c28b1ed', 'request_id': 'req-e50ef92c-1e1e-4b21-85e3-ed109f0e524a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:33.325894 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e50ef92c-1e1e-4b21-85e3-ed109f0e524a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea432e90bb784e8ab19838d66c28b1ed', 'request_id': 'req-e50ef92c-1e1e-4b21-85e3-ed109f0e524a'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:33.340729 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e50ef92c-1e1e-4b21-85e3-ed109f0e524a admin admin] The token cache is being invalidate because project ea432e90bb784e8ab19838d66c28b1ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:21:33.341024 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e50ef92c-1e1e-4b21-85e3-ed109f0e524a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:33.341855 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-e50ef92c-1e1e-4b21-85e3-ed109f0e524a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:33.343599 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1448/2854] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:21:33 2022] DELETE /identity/v3/projects/ea432e90bb784e8ab19838d66c28b1ed => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:33.349544 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ee2c3-b5b8-4120-84a8-584d92cc5e75 service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:33.363778 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ee2c3-b5b8-4120-84a8-584d92cc5e75 service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:33.426826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05888a0d-e24a-48b6-b2c2-09c010650988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:33.427486 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05888a0d-e24a-48b6-b2c2-09c010650988 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:33.427769 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05888a0d-e24a-48b6-b2c2-09c010650988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:33.428032 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05888a0d-e24a-48b6-b2c2-09c010650988 admin admin] PATH_INFO: `/v3/users/0a681f13692e46a588e92ff9cad7866d` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:33.429238 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05888a0d-e24a-48b6-b2c2-09c010650988 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a681f13692e46a588e92ff9cad7866d)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:33.431169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05888a0d-e24a-48b6-b2c2-09c010650988 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:33.487665 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-05888a0d-e24a-48b6-b2c2-09c010650988 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a681f13692e46a588e92ff9cad7866d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:33.492517 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-05888a0d-e24a-48b6-b2c2-09c010650988 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a681f13692e46a588e92ff9cad7866d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:33.503160 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:33.505662 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-05888a0d-e24a-48b6-b2c2-09c010650988 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a681f13692e46a588e92ff9cad7866d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:33.521049 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-05888a0d-e24a-48b6-b2c2-09c010650988 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a681f13692e46a588e92ff9cad7866d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:33.522035 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-05888a0d-e24a-48b6-b2c2-09c010650988 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a681f13692e46a588e92ff9cad7866d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:33.537263 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1407/2855] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:21:33 2022] DELETE /identity/v3/users/0a681f13692e46a588e92ff9cad7866d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:33.817159 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ef92c-1e1e-4b21-85e3-ed109f0e524a admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:33.818676 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-e50ef92c-1e1e-4b21-85e3-ed109f0e524a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:33.833014 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ef92c-1e1e-4b21-85e3-ed109f0e524a admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:33.892479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06f126-364e-4cdd-9b08-d6a10874902d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:33.893138 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06f126-364e-4cdd-9b08-d6a10874902d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:33.893408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06f126-364e-4cdd-9b08-d6a10874902d admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:33.893677 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06f126-364e-4cdd-9b08-d6a10874902d admin admin] PATH_INFO: `/v3/projects/2ca3822a4af0439fac4142d389b731a9` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:33.894890 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06f126-364e-4cdd-9b08-d6a10874902d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca3822a4af0439fac4142d389b731a9)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:33.896858 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06f126-364e-4cdd-9b08-d6a10874902d admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:33.946850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ff06f126-364e-4cdd-9b08-d6a10874902d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca3822a4af0439fac4142d389b731a9', 'request_id': 'req-ff06f126-364e-4cdd-9b08-d6a10874902d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:33.954101 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ff06f126-364e-4cdd-9b08-d6a10874902d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca3822a4af0439fac4142d389b731a9', 'request_id': 'req-ff06f126-364e-4cdd-9b08-d6a10874902d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:33.960129 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ff06f126-364e-4cdd-9b08-d6a10874902d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca3822a4af0439fac4142d389b731a9', 'request_id': 'req-ff06f126-364e-4cdd-9b08-d6a10874902d'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:33.977211 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ff06f126-364e-4cdd-9b08-d6a10874902d admin admin] The token cache is being invalidate because project 2ca3822a4af0439fac4142d389b731a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:21:33.978178 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ff06f126-364e-4cdd-9b08-d6a10874902d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:33.978178 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-ff06f126-364e-4cdd-9b08-d6a10874902d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:33.979654 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1449/2856] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:21:33 2022] DELETE /identity/v3/projects/2ca3822a4af0439fac4142d389b731a9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:33.989764 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b6a39-a884-4f5c-84c9-8685419a704a None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:33.990334 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b6a39-a884-4f5c-84c9-8685419a704a None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:33.990478 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b6a39-a884-4f5c-84c9-8685419a704a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:34.012920 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-6c4b6a39-a884-4f5c-84c9-8685419a704a None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:34.014415 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-6c4b6a39-a884-4f5c-84c9-8685419a704a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:34.084034 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1408/2857] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:34.092105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf5565-e4ce-49df-9f61-27010d46dc5b None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:34.092395 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf5565-e4ce-49df-9f61-27010d46dc5b None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:34.092697 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf5565-e4ce-49df-9f61-27010d46dc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:34.113105 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-f2cf5565-e4ce-49df-9f61-27010d46dc5b None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:34.114309 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f2cf5565-e4ce-49df-9f61-27010d46dc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:34.122195 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1450/2858] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:34.127258 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b6a39-a884-4f5c-84c9-8685419a704a None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:34.137105 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b6a39-a884-4f5c-84c9-8685419a704a None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:34.141746 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565c8e4-a310-4adf-9e03-ef1ca46dbba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:34.142375 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565c8e4-a310-4adf-9e03-ef1ca46dbba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:34.142653 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565c8e4-a310-4adf-9e03-ef1ca46dbba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:34.142926 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565c8e4-a310-4adf-9e03-ef1ca46dbba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:34.143626 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565c8e4-a310-4adf-9e03-ef1ca46dbba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 10:21:34.143932 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565c8e4-a310-4adf-9e03-ef1ca46dbba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:34.145563 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565c8e4-a310-4adf-9e03-ef1ca46dbba5 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:34.157635 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1409/2859] 10.222.0.85 () {58 vars in 1153 bytes} [Tue Aug 2 10:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 10:21:34.162488 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf5565-e4ce-49df-9f61-27010d46dc5b None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:34.171932 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf5565-e4ce-49df-9f61-27010d46dc5b None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:34.179304 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cb1d7-585c-4030-95c7-ed0bf6b83221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:34.180298 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cb1d7-585c-4030-95c7-ed0bf6b83221 admin admin] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:34.180941 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cb1d7-585c-4030-95c7-ed0bf6b83221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:34.181413 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cb1d7-585c-4030-95c7-ed0bf6b83221 admin admin] PATH_INFO: `/v3/projects` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:34.182620 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cb1d7-585c-4030-95c7-ed0bf6b83221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:34.185403 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cb1d7-585c-4030-95c7-ed0bf6b83221 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:34.191537 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:34.216375 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1451/2860] 10.222.0.85 () {60 vars in 1153 bytes} [Tue Aug 2 10:21:34 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 10:21:34.223575 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565c8e4-a310-4adf-9e03-ef1ca46dbba5 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:34.241619 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565c8e4-a310-4adf-9e03-ef1ca46dbba5 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:34.332695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445a93c-e95d-48d9-895b-f0ede76c5995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:34.333433 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445a93c-e95d-48d9-895b-f0ede76c5995 admin admin] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:34.333845 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445a93c-e95d-48d9-895b-f0ede76c5995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:34.334182 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d445a93c-e95d-48d9-895b-f0ede76c5995 admin admin] PATH_INFO: `/v3/users` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:34.334891 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445a93c-e95d-48d9-895b-f0ede76c5995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:34.337096 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d445a93c-e95d-48d9-895b-f0ede76c5995 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:34.363816 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1410/2861] 10.222.0.85 () {60 vars in 1144 bytes} [Tue Aug 2 10:21:34 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 10:21:34.368098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cb1d7-585c-4030-95c7-ed0bf6b83221 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:34.379198 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cb1d7-585c-4030-95c7-ed0bf6b83221 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:34.384353 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec47784-7b67-4f2e-92a5-c336dea23051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:34.385053 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec47784-7b67-4f2e-92a5-c336dea23051 admin admin] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:34.385329 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec47784-7b67-4f2e-92a5-c336dea23051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:34.385603 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec47784-7b67-4f2e-92a5-c336dea23051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:34.386296 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec47784-7b67-4f2e-92a5-c336dea23051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:34.387874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec47784-7b67-4f2e-92a5-c336dea23051 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:34.399019 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1452/2862] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 10:21:34.403865 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445a93c-e95d-48d9-895b-f0ede76c5995 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:34.420696 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d445a93c-e95d-48d9-895b-f0ede76c5995 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:34.425911 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cf4ae-8d70-4bf0-a111-cf0cd7b0fc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:34.426542 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cf4ae-8d70-4bf0-a111-cf0cd7b0fc99 admin admin] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:34.426837 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cf4ae-8d70-4bf0-a111-cf0cd7b0fc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:34.427138 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cf4ae-8d70-4bf0-a111-cf0cd7b0fc99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:34.427849 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cf4ae-8d70-4bf0-a111-cf0cd7b0fc99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:34.429553 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cf4ae-8d70-4bf0-a111-cf0cd7b0fc99 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:34.443027 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1411/2863] 10.222.0.85 () {58 vars in 1122 bytes} [Tue Aug 2 10:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 10:21:34.447164 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec47784-7b67-4f2e-92a5-c336dea23051 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:34.458380 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec47784-7b67-4f2e-92a5-c336dea23051 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:34.463196 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4ff6b-2861-4968-956e-088b929f66ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:34.463991 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4ff6b-2861-4968-956e-088b929f66ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:34.464369 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4ff6b-2861-4968-956e-088b929f66ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:34.464722 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4ff6b-2861-4968-956e-088b929f66ff admin admin] PATH_INFO: `/v3/projects/c3cdfe42ee544e9cba0d7d08ea2bf239/users/1c4b61a974f547b383532d7dbec2190d/roles/a2d6e3ab7e054be982bc78ce3c0a9748` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:34.480757 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4ff6b-2861-4968-956e-088b929f66ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3cdfe42ee544e9cba0d7d08ea2bf239, user_id=1c4b61a974f547b383532d7dbec2190d, role_id=a2d6e3ab7e054be982bc78ce3c0a9748)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:34.483741 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4ff6b-2861-4968-956e-088b929f66ff admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:34.497919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1453/2864] 10.222.0.85 () {60 vars in 1483 bytes} [Tue Aug 2 10:21:34 2022] PUT /identity/v3/projects/c3cdfe42ee544e9cba0d7d08ea2bf239/users/1c4b61a974f547b383532d7dbec2190d/roles/a2d6e3ab7e054be982bc78ce3c0a9748 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:34.504046 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ef131-fb92-4e05-896d-2b42fc6e8632 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:34.504395 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ef131-fb92-4e05-896d-2b42fc6e8632 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:34.504780 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ef131-fb92-4e05-896d-2b42fc6e8632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:34.525887 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-6e9ef131-fb92-4e05-896d-2b42fc6e8632 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:34.527160 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-6e9ef131-fb92-4e05-896d-2b42fc6e8632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:34.578444 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:34.612953 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1412/2865] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:34.623428 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4ff6b-2861-4968-956e-088b929f66ff admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:34.625524 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4de4ff6b-2861-4968-956e-088b929f66ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:34.711974 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4ff6b-2861-4968-956e-088b929f66ff admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:34.716605 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a44ef-cbb6-48ce-87bb-48b00e10ec03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:34.717332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a44ef-cbb6-48ce-87bb-48b00e10ec03 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:34.717691 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a44ef-cbb6-48ce-87bb-48b00e10ec03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:34.718034 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a44ef-cbb6-48ce-87bb-48b00e10ec03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:34.728758 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a44ef-cbb6-48ce-87bb-48b00e10ec03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:34.730452 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a44ef-cbb6-48ce-87bb-48b00e10ec03 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:34.743361 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1454/2866] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:21:35.490419 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271cd11-5d42-4519-a0e0-a6648de3e1f0 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:35.490892 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271cd11-5d42-4519-a0e0-a6648de3e1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:35.491159 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271cd11-5d42-4519-a0e0-a6648de3e1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:35.522933 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-0271cd11-5d42-4519-a0e0-a6648de3e1f0 None None] MFA Rules not processed for user `1c4b61a974f547b383532d7dbec2190d`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:35.524145 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-0271cd11-5d42-4519-a0e0-a6648de3e1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:35.594239 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1413/2867] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:35.609797 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a44ef-cbb6-48ce-87bb-48b00e10ec03 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:35.615201 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2f5a44ef-cbb6-48ce-87bb-48b00e10ec03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:35.681949 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a44ef-cbb6-48ce-87bb-48b00e10ec03 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:35.686077 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80f0eb-b688-4b9c-b0b2-6473d30c6c22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:35.686699 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80f0eb-b688-4b9c-b0b2-6473d30c6c22 service cinder] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:35.686977 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80f0eb-b688-4b9c-b0b2-6473d30c6c22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:35.687255 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80f0eb-b688-4b9c-b0b2-6473d30c6c22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:35.696370 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80f0eb-b688-4b9c-b0b2-6473d30c6c22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:35.697845 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80f0eb-b688-4b9c-b0b2-6473d30c6c22 service cinder] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:35.707255 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1455/2868] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:21:37.088261 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966a08c-1bc1-40d0-a626-d92d51ccfa8c None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:37.088998 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966a08c-1bc1-40d0-a626-d92d51ccfa8c None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:37.088998 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1966a08c-1bc1-40d0-a626-d92d51ccfa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:37.108822 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-1966a08c-1bc1-40d0-a626-d92d51ccfa8c None None] MFA Rules not processed for user `1c4b61a974f547b383532d7dbec2190d`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:37.110028 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-1966a08c-1bc1-40d0-a626-d92d51ccfa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:37.117275 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1414/2869] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:21:37.158465 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80f0eb-b688-4b9c-b0b2-6473d30c6c22 service cinder] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:37.159869 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-9d80f0eb-b688-4b9c-b0b2-6473d30c6c22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:37.218886 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80f0eb-b688-4b9c-b0b2-6473d30c6c22 service cinder] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:37.223337 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d146b-8435-452a-b38c-19822880871f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0af63c36df2c4ceaa2df4d3ac59542bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:37.223953 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d146b-8435-452a-b38c-19822880871f service glance] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:37.224244 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d146b-8435-452a-b38c-19822880871f service glance] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:37.224557 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676d146b-8435-452a-b38c-19822880871f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:37.226321 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-676d146b-8435-452a-b38c-19822880871f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:37.237687 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:37.302642 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d146b-8435-452a-b38c-19822880871f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:37.304162 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676d146b-8435-452a-b38c-19822880871f service glance] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:37.318553 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1456/2870] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:21:37.332796 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966a08c-1bc1-40d0-a626-d92d51ccfa8c None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:37.343453 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1966a08c-1bc1-40d0-a626-d92d51ccfa8c None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:37.347866 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075e589-1911-488f-b640-b05f836afb1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8e4e240f7958425a99a2cc1110e40c13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:37.348500 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075e589-1911-488f-b640-b05f836afb1a service cinder] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:37.348786 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075e589-1911-488f-b640-b05f836afb1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:37.349062 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075e589-1911-488f-b640-b05f836afb1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:37.351010 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4075e589-1911-488f-b640-b05f836afb1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:37.425710 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075e589-1911-488f-b640-b05f836afb1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:37.427197 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4075e589-1911-488f-b640-b05f836afb1a service cinder] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:37.437427 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1415/2871] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:21:37.549121 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d146b-8435-452a-b38c-19822880871f service glance] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:37.550488 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-676d146b-8435-452a-b38c-19822880871f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:37.562051 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676d146b-8435-452a-b38c-19822880871f service glance] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:37.567158 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af1ab3-b9cc-48b1-90ef-7c03ca12540e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:37.567776 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af1ab3-b9cc-48b1-90ef-7c03ca12540e service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:37.568057 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af1ab3-b9cc-48b1-90ef-7c03ca12540e service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:37.568331 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af1ab3-b9cc-48b1-90ef-7c03ca12540e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:37.570121 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-f3af1ab3-b9cc-48b1-90ef-7c03ca12540e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:37.581408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af1ab3-b9cc-48b1-90ef-7c03ca12540e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:37.582943 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af1ab3-b9cc-48b1-90ef-7c03ca12540e service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:37.594376 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1457/2872] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:21:37.969914 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075e589-1911-488f-b640-b05f836afb1a service cinder] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:37.971525 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-4075e589-1911-488f-b640-b05f836afb1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:37.987913 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af1ab3-b9cc-48b1-90ef-7c03ca12540e service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:37.998019 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af1ab3-b9cc-48b1-90ef-7c03ca12540e service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:38.004422 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c32a94-ef8b-4849-9dfb-b2a7907b4a27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:38.005176 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c32a94-ef8b-4849-9dfb-b2a7907b4a27 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:38.005583 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c32a94-ef8b-4849-9dfb-b2a7907b4a27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:38.006079 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c32a94-ef8b-4849-9dfb-b2a7907b4a27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:38.010096 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-02c32a94-ef8b-4849-9dfb-b2a7907b4a27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:38.028727 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c32a94-ef8b-4849-9dfb-b2a7907b4a27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:38.030487 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c32a94-ef8b-4849-9dfb-b2a7907b4a27 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:38.043253 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1458/2873] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:21:38.052358 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=100 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:38.057192 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4075e589-1911-488f-b640-b05f836afb1a service cinder] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:38.062750 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ae39d-93e9-49d7-ac1c-6aa25739b8a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2a420cc676e4f2bb2766826a1de3b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:38.063428 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ae39d-93e9-49d7-ac1c-6aa25739b8a2 service placement] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:38.064080 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ae39d-93e9-49d7-ac1c-6aa25739b8a2 service placement] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:38.064312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ae39d-93e9-49d7-ac1c-6aa25739b8a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:38.066188 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-cb8ae39d-93e9-49d7-ac1c-6aa25739b8a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:38.078695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ae39d-93e9-49d7-ac1c-6aa25739b8a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:38.080242 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ae39d-93e9-49d7-ac1c-6aa25739b8a2 service placement] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:38.093475 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1416/2874] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:21:39.796408 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c32a94-ef8b-4849-9dfb-b2a7907b4a27 service neutron] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:39.805630 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c32a94-ef8b-4849-9dfb-b2a7907b4a27 service neutron] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:39.809706 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b6a6a-5926-4fe6-9c1c-244a71fd2338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:39.810319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b6a6a-5926-4fe6-9c1c-244a71fd2338 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:39.810605 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b6a6a-5926-4fe6-9c1c-244a71fd2338 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:39.810885 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b6a6a-5926-4fe6-9c1c-244a71fd2338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:39.812718 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-100b6a6a-5926-4fe6-9c1c-244a71fd2338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:39.823110 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b6a6a-5926-4fe6-9c1c-244a71fd2338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:39.824598 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b6a6a-5926-4fe6-9c1c-244a71fd2338 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:39.833938 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1459/2875] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:21:42.434125 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ae39d-93e9-49d7-ac1c-6aa25739b8a2 service placement] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:42.435664 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-cb8ae39d-93e9-49d7-ac1c-6aa25739b8a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:42.453306 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ae39d-93e9-49d7-ac1c-6aa25739b8a2 service placement] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:42.458964 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697d691-b79d-4337-9a96-82d5a0a4db81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:42.459691 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697d691-b79d-4337-9a96-82d5a0a4db81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:42.459982 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697d691-b79d-4337-9a96-82d5a0a4db81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:42.460258 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697d691-b79d-4337-9a96-82d5a0a4db81 admin admin] PATH_INFO: `/v3/users/1e8ee338f72a4a72817e49a45c040c9e` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:42.461565 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697d691-b79d-4337-9a96-82d5a0a4db81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e8ee338f72a4a72817e49a45c040c9e)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:42.463502 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697d691-b79d-4337-9a96-82d5a0a4db81 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:42.517925 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a697d691-b79d-4337-9a96-82d5a0a4db81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e8ee338f72a4a72817e49a45c040c9e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:42.518601 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a697d691-b79d-4337-9a96-82d5a0a4db81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e8ee338f72a4a72817e49a45c040c9e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:42.533436 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a697d691-b79d-4337-9a96-82d5a0a4db81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e8ee338f72a4a72817e49a45c040c9e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:42.543971 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a697d691-b79d-4337-9a96-82d5a0a4db81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e8ee338f72a4a72817e49a45c040c9e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:42.545135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-a697d691-b79d-4337-9a96-82d5a0a4db81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e8ee338f72a4a72817e49a45c040c9e'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:42.560898 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1417/2876] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:21:42 2022] DELETE /identity/v3/users/1e8ee338f72a4a72817e49a45c040c9e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:42.566180 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08b219-e039-4287-8a66-b912caf63b69 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:42.566615 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08b219-e039-4287-8a66-b912caf63b69 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:42.566744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08b219-e039-4287-8a66-b912caf63b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:42.588313 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-cd08b219-e039-4287-8a66-b912caf63b69 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:21:42.589662 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cd08b219-e039-4287-8a66-b912caf63b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:42.655786 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1460/2877] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:21:42.666934 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697d691-b79d-4337-9a96-82d5a0a4db81 admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:42.668345 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a697d691-b79d-4337-9a96-82d5a0a4db81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:42.736485 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697d691-b79d-4337-9a96-82d5a0a4db81 admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:42.741681 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88cc9b-27dd-4935-ab12-f661b0350484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:42.742416 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88cc9b-27dd-4935-ab12-f661b0350484 service neutron] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:42.742795 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88cc9b-27dd-4935-ab12-f661b0350484 service neutron] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:42.744610 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88cc9b-27dd-4935-ab12-f661b0350484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:42.753558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88cc9b-27dd-4935-ab12-f661b0350484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:42.755112 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88cc9b-27dd-4935-ab12-f661b0350484 service neutron] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:42.768603 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1418/2878] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:21:43.127928 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08b219-e039-4287-8a66-b912caf63b69 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:43.129424 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cd08b219-e039-4287-8a66-b912caf63b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:43.146025 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08b219-e039-4287-8a66-b912caf63b69 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:43.152040 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9d055-bda7-4b47-b3a0-484015fe110f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:43.152726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9d055-bda7-4b47-b3a0-484015fe110f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:43.153121 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9d055-bda7-4b47-b3a0-484015fe110f admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:43.153275 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9d055-bda7-4b47-b3a0-484015fe110f admin admin] PATH_INFO: `/v3/projects/2017c386d29e46f78ffb84a0e9280dfd` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:43.154711 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9d055-bda7-4b47-b3a0-484015fe110f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2017c386d29e46f78ffb84a0e9280dfd)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:43.156744 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9d055-bda7-4b47-b3a0-484015fe110f admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:43.207911 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-99a9d055-bda7-4b47-b3a0-484015fe110f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2017c386d29e46f78ffb84a0e9280dfd', 'request_id': 'req-99a9d055-bda7-4b47-b3a0-484015fe110f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:43.214293 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-99a9d055-bda7-4b47-b3a0-484015fe110f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2017c386d29e46f78ffb84a0e9280dfd', 'request_id': 'req-99a9d055-bda7-4b47-b3a0-484015fe110f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:43.215542 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:43.223765 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-99a9d055-bda7-4b47-b3a0-484015fe110f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2017c386d29e46f78ffb84a0e9280dfd', 'request_id': 'req-99a9d055-bda7-4b47-b3a0-484015fe110f'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:43.237751 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-99a9d055-bda7-4b47-b3a0-484015fe110f admin admin] The token cache is being invalidate because project 2017c386d29e46f78ffb84a0e9280dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:21:43.238045 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-99a9d055-bda7-4b47-b3a0-484015fe110f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:43.238693 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-99a9d055-bda7-4b47-b3a0-484015fe110f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:43.240383 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1461/2879] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:21:43 2022] DELETE /identity/v3/projects/2017c386d29e46f78ffb84a0e9280dfd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 10:21:43.244449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88cc9b-27dd-4935-ab12-f661b0350484 service neutron] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:43.255023 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88cc9b-27dd-4935-ab12-f661b0350484 service neutron] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:43.315237 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c0f272-2377-446a-b356-b8098c13ecb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:43.315893 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0f272-2377-446a-b356-b8098c13ecb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:43.316180 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0f272-2377-446a-b356-b8098c13ecb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:43.316478 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c0f272-2377-446a-b356-b8098c13ecb2 admin admin] PATH_INFO: `/v3/users/593e254777724c4098ab44a40cec0b7f` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:43.317684 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0f272-2377-446a-b356-b8098c13ecb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=593e254777724c4098ab44a40cec0b7f)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:43.319614 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c0f272-2377-446a-b356-b8098c13ecb2 admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:43.326008 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:43.372914 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-77c0f272-2377-446a-b356-b8098c13ecb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '593e254777724c4098ab44a40cec0b7f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:43.373571 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-77c0f272-2377-446a-b356-b8098c13ecb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '593e254777724c4098ab44a40cec0b7f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:43.386947 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-77c0f272-2377-446a-b356-b8098c13ecb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '593e254777724c4098ab44a40cec0b7f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:43.395003 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-77c0f272-2377-446a-b356-b8098c13ecb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '593e254777724c4098ab44a40cec0b7f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:43.397647 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-77c0f272-2377-446a-b356-b8098c13ecb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '593e254777724c4098ab44a40cec0b7f'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:43.411015 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1419/2880] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:21:43 2022] DELETE /identity/v3/users/593e254777724c4098ab44a40cec0b7f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:43.699707 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9d055-bda7-4b47-b3a0-484015fe110f admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:21:43.701265 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-99a9d055-bda7-4b47-b3a0-484015fe110f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:21:43.717919 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9d055-bda7-4b47-b3a0-484015fe110f admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:21:43.785530 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd383e4-3ea3-4609-97a7-8feda09fbd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:21:43.786742 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd383e4-3ea3-4609-97a7-8feda09fbd92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:21:43.787100 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd383e4-3ea3-4609-97a7-8feda09fbd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:21:43.787571 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd383e4-3ea3-4609-97a7-8feda09fbd92 admin admin] PATH_INFO: `/v3/projects/33680fb27b2843748c0b5444718e2578` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:21:43.788824 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd383e4-3ea3-4609-97a7-8feda09fbd92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33680fb27b2843748c0b5444718e2578)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:21:43.790746 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd383e4-3ea3-4609-97a7-8feda09fbd92 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:21:43.842559 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2bd383e4-3ea3-4609-97a7-8feda09fbd92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33680fb27b2843748c0b5444718e2578', 'request_id': 'req-2bd383e4-3ea3-4609-97a7-8feda09fbd92'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:43.849631 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2bd383e4-3ea3-4609-97a7-8feda09fbd92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33680fb27b2843748c0b5444718e2578', 'request_id': 'req-2bd383e4-3ea3-4609-97a7-8feda09fbd92'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:43.855554 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2bd383e4-3ea3-4609-97a7-8feda09fbd92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33680fb27b2843748c0b5444718e2578', 'request_id': 'req-2bd383e4-3ea3-4609-97a7-8feda09fbd92'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:43.869479 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2bd383e4-3ea3-4609-97a7-8feda09fbd92 admin admin] The token cache is being invalidate because project 33680fb27b2843748c0b5444718e2578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:21:43.869769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2bd383e4-3ea3-4609-97a7-8feda09fbd92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:43.870418 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-2bd383e4-3ea3-4609-97a7-8feda09fbd92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:21:43.872088 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1462/2881] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:21:43 2022] DELETE /identity/v3/projects/33680fb27b2843748c0b5444718e2578 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:21:53.406695 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:21:53.866111 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:DELETE=10,keystone:SELECT=55,keystone:INSERT=2 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:01.549238 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01092af-84dc-49eb-a2a8-479967fd9498 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:01.549831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01092af-84dc-49eb-a2a8-479967fd9498 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:01.549831 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01092af-84dc-49eb-a2a8-479967fd9498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:01.571008 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-b01092af-84dc-49eb-a2a8-479967fd9498 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:22:01.572268 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-b01092af-84dc-49eb-a2a8-479967fd9498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:22:01.637143 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1420/2882] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 2 10:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:22:01.682167 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd383e4-3ea3-4609-97a7-8feda09fbd92 admin admin] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:22:01.683815 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-2bd383e4-3ea3-4609-97a7-8feda09fbd92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:22:01.765263 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd383e4-3ea3-4609-97a7-8feda09fbd92 admin admin] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:22:01.771908 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328c83f-751f-4b5f-9a48-fbe265e38fbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:22:01.772468 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328c83f-751f-4b5f-9a48-fbe265e38fbb service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:01.772775 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328c83f-751f-4b5f-9a48-fbe265e38fbb service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:01.773050 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328c83f-751f-4b5f-9a48-fbe265e38fbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:01.785673 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6328c83f-751f-4b5f-9a48-fbe265e38fbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:22:01.788227 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6328c83f-751f-4b5f-9a48-fbe265e38fbb service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:22:01.801726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1463/2883] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:22:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:22:04.640781 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e138d-42a4-4300-b92c-07725d8e0785 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:04.642572 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e138d-42a4-4300-b92c-07725d8e0785 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:04.642572 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e138d-42a4-4300-b92c-07725d8e0785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:04.662168 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-1f9e138d-42a4-4300-b92c-07725d8e0785 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:22:04.663393 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-1f9e138d-42a4-4300-b92c-07725d8e0785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:22:04.673734 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1421/2884] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 2 10:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:22:04.696308 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328c83f-751f-4b5f-9a48-fbe265e38fbb service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:22:04.697834 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6328c83f-751f-4b5f-9a48-fbe265e38fbb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:22:04.714421 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328c83f-751f-4b5f-9a48-fbe265e38fbb service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:22:04.721920 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a6308-9a20-4c38-b83e-29f32b6ea998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:22:04.722547 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a6308-9a20-4c38-b83e-29f32b6ea998 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:04.722881 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a6308-9a20-4c38-b83e-29f32b6ea998 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:04.723214 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a6308-9a20-4c38-b83e-29f32b6ea998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:04.732261 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a6308-9a20-4c38-b83e-29f32b6ea998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:22:04.733877 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a6308-9a20-4c38-b83e-29f32b6ea998 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:22:04.744850 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1464/2885] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:22:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:22:07.880529 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6c9c7-c58e-4631-a9e6-9e5f78199e7e None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:07.881098 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6c9c7-c58e-4631-a9e6-9e5f78199e7e None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:07.881098 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6c9c7-c58e-4631-a9e6-9e5f78199e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:07.906193 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-abb6c9c7-c58e-4631-a9e6-9e5f78199e7e None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:22:07.908241 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-abb6c9c7-c58e-4631-a9e6-9e5f78199e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:22:07.916622 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1422/2886] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 2 10:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:22:07.931048 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a6308-9a20-4c38-b83e-29f32b6ea998 service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:22:07.943549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a6308-9a20-4c38-b83e-29f32b6ea998 service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:22:07.949258 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a97f7-08e9-48ed-b03a-45395c91044a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:22:07.949874 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a97f7-08e9-48ed-b03a-45395c91044a service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:07.950187 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a97f7-08e9-48ed-b03a-45395c91044a service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:07.950470 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a97f7-08e9-48ed-b03a-45395c91044a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:07.959925 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a97f7-08e9-48ed-b03a-45395c91044a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:22:07.961631 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a97f7-08e9-48ed-b03a-45395c91044a service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:22:07.972769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1465/2887] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:22:10.966466 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb017a4-4467-4c39-8a9f-b81200a0146b None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:10.966996 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb017a4-4467-4c39-8a9f-b81200a0146b None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:10.967117 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb017a4-4467-4c39-8a9f-b81200a0146b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:10.988413 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-2fb017a4-4467-4c39-8a9f-b81200a0146b None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:22:10.989669 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-2fb017a4-4467-4c39-8a9f-b81200a0146b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:22:10.997568 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1423/2888] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 2 10:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:22:11.013372 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a97f7-08e9-48ed-b03a-45395c91044a service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:22:11.027135 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a97f7-08e9-48ed-b03a-45395c91044a service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:22:11.034208 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00830f34-b2c7-4300-a397-35f7d7879145 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:22:11.034835 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00830f34-b2c7-4300-a397-35f7d7879145 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:11.035122 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00830f34-b2c7-4300-a397-35f7d7879145 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:11.035403 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00830f34-b2c7-4300-a397-35f7d7879145 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:11.044405 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00830f34-b2c7-4300-a397-35f7d7879145 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:22:11.046079 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00830f34-b2c7-4300-a397-35f7d7879145 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:22:11.056204 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1466/2889] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:22:14.138585 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364560f-23f6-4ecc-a563-20a8eb6633b7 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:14.139151 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364560f-23f6-4ecc-a563-20a8eb6633b7 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:14.139151 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364560f-23f6-4ecc-a563-20a8eb6633b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:14.159991 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-a364560f-23f6-4ecc-a563-20a8eb6633b7 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:22:14.161250 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-a364560f-23f6-4ecc-a563-20a8eb6633b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:22:14.169335 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1424/2890] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 2 10:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:22:14.185647 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00830f34-b2c7-4300-a397-35f7d7879145 service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:22:14.197988 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00830f34-b2c7-4300-a397-35f7d7879145 service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:22:14.204918 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990543fa-56cc-44e8-9bd5-af8faa84a396 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:22:14.205540 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990543fa-56cc-44e8-9bd5-af8faa84a396 service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:14.205821 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990543fa-56cc-44e8-9bd5-af8faa84a396 service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:14.206098 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990543fa-56cc-44e8-9bd5-af8faa84a396 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:14.215102 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990543fa-56cc-44e8-9bd5-af8faa84a396 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:22:14.216721 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990543fa-56cc-44e8-9bd5-af8faa84a396 service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:22:14.228785 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1467/2891] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:22:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 10:22:17.298826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f64b15-3ef7-42f6-92ed-32b39bd56ba7 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:17.299349 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f64b15-3ef7-42f6-92ed-32b39bd56ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:17.299537 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f64b15-3ef7-42f6-92ed-32b39bd56ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:17.319557 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-c0f64b15-3ef7-42f6-92ed-32b39bd56ba7 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:22:17.320826 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-c0f64b15-3ef7-42f6-92ed-32b39bd56ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:22:17.329588 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1425/2892] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 2 10:22:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 10:22:17.346254 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990543fa-56cc-44e8-9bd5-af8faa84a396 service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:22:17.357726 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990543fa-56cc-44e8-9bd5-af8faa84a396 service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:22:17.365510 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b974d6-812b-4bfe-bbb9-61318a4fbd7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:22:17.366119 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b974d6-812b-4bfe-bbb9-61318a4fbd7a service nova] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:17.366399 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b974d6-812b-4bfe-bbb9-61318a4fbd7a service nova] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:17.366669 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b974d6-812b-4bfe-bbb9-61318a4fbd7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:17.375578 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b974d6-812b-4bfe-bbb9-61318a4fbd7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:22:17.377218 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b974d6-812b-4bfe-bbb9-61318a4fbd7a service nova] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:22:17.386803 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1468/2893] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:22:27.314248 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=42 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:27.382489 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=64 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:33.518116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42bed0-b4f5-4662-ac72-b769b4b64ea5 None None] REQUEST_METHOD: `POST` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:33.519135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42bed0-b4f5-4662-ac72-b769b4b64ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:33.519135 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42bed0-b4f5-4662-ac72-b769b4b64ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:33.538693 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.auth.core [None req-ca42bed0-b4f5-4662-ac72-b769b4b64ea5 None None] MFA Rules not processed for user `1c4b61a974f547b383532d7dbec2190d`. Rule list: `[]` (Enabled: `True`). {{(pid=80329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:22:33.539917 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-ca42bed0-b4f5-4662-ac72-b769b4b64ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:22:33.602435 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1426/2894] 10.222.0.85 () {58 vars in 958 bytes} [Tue Aug 2 10:22:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:22:33.847319 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b974d6-812b-4bfe-bbb9-61318a4fbd7a service nova] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:22:33.848831 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-d0b974d6-812b-4bfe-bbb9-61318a4fbd7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:22:33.908402 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b974d6-812b-4bfe-bbb9-61318a4fbd7a service nova] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:22:33.912116 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83319e64-8b19-4aaa-a5ec-19e2c2e7dc49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '828eb58cdce44ca8827f1ce2be7c19d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:22:33.912755 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83319e64-8b19-4aaa-a5ec-19e2c2e7dc49 service neutron] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:33.913037 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83319e64-8b19-4aaa-a5ec-19e2c2e7dc49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:33.913317 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83319e64-8b19-4aaa-a5ec-19e2c2e7dc49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:33.915073 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-83319e64-8b19-4aaa-a5ec-19e2c2e7dc49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:22:33.925880 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83319e64-8b19-4aaa-a5ec-19e2c2e7dc49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:22:33.927298 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83319e64-8b19-4aaa-a5ec-19e2c2e7dc49 service neutron] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:22:33.935472 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1469/2895] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:22:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:22:43.594983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=25 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:43.931770 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=26 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:22:44.716320 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42bed0-b4f5-4662-ac72-b769b4b64ea5 None None] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:22:44.732558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42bed0-b4f5-4662-ac72-b769b4b64ea5 None None] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:22:44.739378 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5012d7d-21d2-4497-947d-ea02b8e4b28d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:22:44.740018 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5012d7d-21d2-4497-947d-ea02b8e4b28d service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:44.740303 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5012d7d-21d2-4497-947d-ea02b8e4b28d service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:44.740626 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5012d7d-21d2-4497-947d-ea02b8e4b28d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:44.742464 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-e5012d7d-21d2-4497-947d-ea02b8e4b28d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:22:44.756234 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5012d7d-21d2-4497-947d-ea02b8e4b28d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:22:44.758106 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5012d7d-21d2-4497-947d-ea02b8e4b28d service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:22:44.776449 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1427/2896] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:22:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:22:48.876303 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f84d9-6464-4b37-97c1-028dcc3313ab None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:48.876878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f84d9-6464-4b37-97c1-028dcc3313ab None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:48.876878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f84d9-6464-4b37-97c1-028dcc3313ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:48.896676 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-6f5f84d9-6464-4b37-97c1-028dcc3313ab None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:22:48.897898 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-6f5f84d9-6464-4b37-97c1-028dcc3313ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:22:48.906138 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1470/2897] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 2 10:22:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:22:48.921409 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5012d7d-21d2-4497-947d-ea02b8e4b28d service nova] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:22:48.933109 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5012d7d-21d2-4497-947d-ea02b8e4b28d service nova] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:22:48.939394 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5209bd2-ea9c-48dd-bd80-9e9977e664d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:22:48.940001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5209bd2-ea9c-48dd-bd80-9e9977e664d0 service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:48.940284 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5209bd2-ea9c-48dd-bd80-9e9977e664d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:48.940598 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5209bd2-ea9c-48dd-bd80-9e9977e664d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:48.949019 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5209bd2-ea9c-48dd-bd80-9e9977e664d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:22:48.950664 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5209bd2-ea9c-48dd-bd80-9e9977e664d0 service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:22:48.960312 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1428/2898] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:22:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:22:52.148660 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef94a5-d628-4667-9b8c-9fee5765f79d None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:52.149193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef94a5-d628-4667-9b8c-9fee5765f79d None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:52.149193 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef94a5-d628-4667-9b8c-9fee5765f79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:52.169336 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-5aef94a5-d628-4667-9b8c-9fee5765f79d None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:22:52.170542 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-5aef94a5-d628-4667-9b8c-9fee5765f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:22:52.179549 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1471/2899] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 2 10:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:22:52.209486 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5209bd2-ea9c-48dd-bd80-9e9977e664d0 service nova] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:22:52.221878 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5209bd2-ea9c-48dd-bd80-9e9977e664d0 service nova] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:22:52.227645 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b33dd-6b3c-4d41-8112-c96fdaa4e92c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:22:52.228261 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b33dd-6b3c-4d41-8112-c96fdaa4e92c service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:52.228584 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b33dd-6b3c-4d41-8112-c96fdaa4e92c service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:52.228866 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b33dd-6b3c-4d41-8112-c96fdaa4e92c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:52.238627 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b33dd-6b3c-4d41-8112-c96fdaa4e92c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:22:52.240203 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b33dd-6b3c-4d41-8112-c96fdaa4e92c service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:22:52.250082 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1429/2900] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:22:55.236601 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365837ad-5079-41dc-a9bf-5fc635290507 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:55.237132 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365837ad-5079-41dc-a9bf-5fc635290507 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:55.237132 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365837ad-5079-41dc-a9bf-5fc635290507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:55.256239 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-365837ad-5079-41dc-a9bf-5fc635290507 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:22:55.257470 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-365837ad-5079-41dc-a9bf-5fc635290507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:22:55.265575 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1472/2901] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 2 10:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:22:55.279985 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b33dd-6b3c-4d41-8112-c96fdaa4e92c service nova] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:22:55.292530 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b33dd-6b3c-4d41-8112-c96fdaa4e92c service nova] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:22:55.299966 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fa06e-9174-4e76-8c2e-5569dad16636 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:22:55.299966 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fa06e-9174-4e76-8c2e-5569dad16636 service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:55.300295 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fa06e-9174-4e76-8c2e-5569dad16636 service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:55.300621 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fa06e-9174-4e76-8c2e-5569dad16636 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:55.309626 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fa06e-9174-4e76-8c2e-5569dad16636 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:22:55.311207 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fa06e-9174-4e76-8c2e-5569dad16636 service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:22:55.321265 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1430/2902] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:22:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:22:58.396914 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f8a80-7b02-4388-9f51-efc30c80d8af None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:58.397469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f8a80-7b02-4388-9f51-efc30c80d8af None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:58.397469 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f8a80-7b02-4388-9f51-efc30c80d8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:58.417902 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-7e7f8a80-7b02-4388-9f51-efc30c80d8af None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:22:58.419120 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-7e7f8a80-7b02-4388-9f51-efc30c80d8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:22:58.427186 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1473/2903] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 2 10:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:22:58.443216 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fa06e-9174-4e76-8c2e-5569dad16636 service nova] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:22:58.455521 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fa06e-9174-4e76-8c2e-5569dad16636 service nova] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:22:58.460973 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d93118-ff5c-4835-96da-99855946483a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:22:58.461579 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d93118-ff5c-4835-96da-99855946483a service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:22:58.461860 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d93118-ff5c-4835-96da-99855946483a service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:22:58.462134 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d93118-ff5c-4835-96da-99855946483a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:22:58.471155 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d93118-ff5c-4835-96da-99855946483a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:22:58.472768 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d93118-ff5c-4835-96da-99855946483a service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:22:58.482169 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1431/2904] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:22:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:23:01.559351 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc254d-fdcc-4ac9-9112-97d1b740fc69 None None] REQUEST_METHOD: `POST` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:23:01.559828 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc254d-fdcc-4ac9-9112-97d1b740fc69 None None] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:23:01.559934 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc254d-fdcc-4ac9-9112-97d1b740fc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:23:01.580151 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.auth.core [None req-4fdc254d-fdcc-4ac9-9112-97d1b740fc69 None None] MFA Rules not processed for user `06f2ad1758af4022bd84ef137b10c0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80330) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 10:23:01.581386 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4fdc254d-fdcc-4ac9-9112-97d1b740fc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:23:01.589230 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1474/2905] 10.222.0.60 () {58 vars in 1016 bytes} [Tue Aug 2 10:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 10:23:01.605501 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d93118-ff5c-4835-96da-99855946483a service nova] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:23:01.617960 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d93118-ff5c-4835-96da-99855946483a service nova] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:23:01.623453 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ada88a-ed98-46a2-b3b6-f1c3f446cc7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '310867deefd34a598cfef2f3e4245ace', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:23:01.624836 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ada88a-ed98-46a2-b3b6-f1c3f446cc7e service nova] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:23:01.625116 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ada88a-ed98-46a2-b3b6-f1c3f446cc7e service nova] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:23:01.625393 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ada88a-ed98-46a2-b3b6-f1c3f446cc7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:23:01.633512 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ada88a-ed98-46a2-b3b6-f1c3f446cc7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:23:01.635067 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ada88a-ed98-46a2-b3b6-f1c3f446cc7e service nova] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:23:01.644558 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1432/2906] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:23:11.575404 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=15 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:11.640360 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=36 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:29.575811 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc254d-fdcc-4ac9-9112-97d1b740fc69 None None] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:23:29.578682 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-4fdc254d-fdcc-4ac9-9112-97d1b740fc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:23:29.644165 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ada88a-ed98-46a2-b3b6-f1c3f446cc7e service nova] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:23:29.645742 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-20ada88a-ed98-46a2-b3b6-f1c3f446cc7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:23:29.659324 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ada88a-ed98-46a2-b3b6-f1c3f446cc7e service nova] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:23:29.660878 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc254d-fdcc-4ac9-9112-97d1b740fc69 None None] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:23:29.664245 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc2767-d47c-43c2-bc8e-3946c54e613d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:23:29.664983 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc2767-d47c-43c2-bc8e-3946c54e613d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:23:29.665495 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc2767-d47c-43c2-bc8e-3946c54e613d admin admin] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:23:29.665772 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc2767-d47c-43c2-bc8e-3946c54e613d admin admin] PATH_INFO: `/v3/users/1c4b61a974f547b383532d7dbec2190d` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:23:29.666305 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf753c99-9037-4b5a-bbaf-cef407ccdbe8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2a420cc676e4f2bb2766826a1de3b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:23:29.666932 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf753c99-9037-4b5a-bbaf-cef407ccdbe8 service placement] REQUEST_METHOD: `GET` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:23:29.667083 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc2767-d47c-43c2-bc8e-3946c54e613d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4b61a974f547b383532d7dbec2190d)` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:23:29.667202 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf753c99-9037-4b5a-bbaf-cef407ccdbe8 service placement] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:23:29.667476 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf753c99-9037-4b5a-bbaf-cef407ccdbe8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:23:29.669011 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc2767-d47c-43c2-bc8e-3946c54e613d admin admin] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:23:29.669300 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.fernet_utils [None req-cf753c99-9037-4b5a-bbaf-cef407ccdbe8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80330) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:23:29.681325 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf753c99-9037-4b5a-bbaf-cef407ccdbe8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:23:29.682930 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf753c99-9037-4b5a-bbaf-cef407ccdbe8 service placement] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:23:29.693917 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1475/2907] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:23:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:23:29.719725 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-85cc2767-d47c-43c2-bc8e-3946c54e613d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4b61a974f547b383532d7dbec2190d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:23:29.720593 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-85cc2767-d47c-43c2-bc8e-3946c54e613d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4b61a974f547b383532d7dbec2190d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:23:29.734204 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-85cc2767-d47c-43c2-bc8e-3946c54e613d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4b61a974f547b383532d7dbec2190d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:23:29.742001 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-85cc2767-d47c-43c2-bc8e-3946c54e613d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4b61a974f547b383532d7dbec2190d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:23:29.742807 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.notifications [None req-85cc2767-d47c-43c2-bc8e-3946c54e613d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4b61a974f547b383532d7dbec2190d'} {{(pid=80329) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:23:29.755663 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1433/2908] 10.222.0.85 () {58 vars in 1224 bytes} [Tue Aug 2 10:23:29 2022] DELETE /identity/v3/users/1c4b61a974f547b383532d7dbec2190d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:23:29.930777 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf753c99-9037-4b5a-bbaf-cef407ccdbe8 service placement] Authenticating user token {{(pid=80330) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:23:29.949700 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf753c99-9037-4b5a-bbaf-cef407ccdbe8 service placement] Validating token access rules against request {{(pid=80330) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:23:30.008769 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb8709-6e36-4ec0-9fe6-04831b3c3325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '06f2ad1758af4022bd84ef137b10c0c7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c3d1fabb05ac40668bd828447419da5a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80330) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:23:30.009414 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb8709-6e36-4ec0-9fe6-04831b3c3325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:23:30.009700 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb8709-6e36-4ec0-9fe6-04831b3c3325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:23:30.009981 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb8709-6e36-4ec0-9fe6-04831b3c3325 admin admin] PATH_INFO: `/v3/projects/c3cdfe42ee544e9cba0d7d08ea2bf239` {{(pid=80330) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:23:30.011186 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb8709-6e36-4ec0-9fe6-04831b3c3325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3cdfe42ee544e9cba0d7d08ea2bf239)` {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:23:30.013200 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb8709-6e36-4ec0-9fe6-04831b3c3325 admin admin] RBAC: Authorization granted {{(pid=80330) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:23:30.062121 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4abb8709-6e36-4ec0-9fe6-04831b3c3325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3cdfe42ee544e9cba0d7d08ea2bf239', 'request_id': 'req-4abb8709-6e36-4ec0-9fe6-04831b3c3325'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:23:30.068332 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4abb8709-6e36-4ec0-9fe6-04831b3c3325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3cdfe42ee544e9cba0d7d08ea2bf239', 'request_id': 'req-4abb8709-6e36-4ec0-9fe6-04831b3c3325'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:23:30.073975 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4abb8709-6e36-4ec0-9fe6-04831b3c3325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3cdfe42ee544e9cba0d7d08ea2bf239', 'request_id': 'req-4abb8709-6e36-4ec0-9fe6-04831b3c3325'} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:23:30.087897 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4abb8709-6e36-4ec0-9fe6-04831b3c3325 admin admin] The token cache is being invalidate because project c3cdfe42ee544e9cba0d7d08ea2bf239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80330) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 10:23:30.088182 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4abb8709-6e36-4ec0-9fe6-04831b3c3325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:23:30.088824 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG keystone.notifications [None req-4abb8709-6e36-4ec0-9fe6-04831b3c3325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80330) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 10:23:30.090322 dv-cinder-850318-6-smb devstack@keystone.service[80330]: [pid: 80330|app: 0|req: 1476/2909] 10.222.0.85 () {58 vars in 1233 bytes} [Tue Aug 2 10:23:29 2022] DELETE /identity/v3/projects/c3cdfe42ee544e9cba0d7d08ea2bf239 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 10:23:39.752205 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:23:40.084957 dv-cinder-850318-6-smb devstack@keystone.service[80330]: DEBUG dbcounter [-] [80330] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80330) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 10:24:23.619344 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc2767-d47c-43c2-bc8e-3946c54e613d admin admin] Authenticating user token {{(pid=80329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 10:24:23.620854 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-85cc2767-d47c-43c2-bc8e-3946c54e613d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:24:23.696734 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc2767-d47c-43c2-bc8e-3946c54e613d admin admin] Validating token access rules against request {{(pid=80329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 10:24:23.759987 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e8565-321f-4b0d-8892-406c96498b34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2a420cc676e4f2bb2766826a1de3b41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '701d7ad0b7594984885e7bfe8a236937', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 10:24:23.760640 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e8565-321f-4b0d-8892-406c96498b34 service placement] REQUEST_METHOD: `GET` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 10:24:23.760924 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e8565-321f-4b0d-8892-406c96498b34 service placement] SCRIPT_NAME: `/identity` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 10:24:23.761196 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e8565-321f-4b0d-8892-406c96498b34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 10:24:23.763482 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.fernet_utils [None req-151e8565-321f-4b0d-8892-406c96498b34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 10:24:23.775322 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e8565-321f-4b0d-8892-406c96498b34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 10:24:23.776949 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e8565-321f-4b0d-8892-406c96498b34 service placement] RBAC: Authorization granted {{(pid=80329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 10:24:23.787820 dv-cinder-850318-6-smb devstack@keystone.service[80329]: [pid: 80329|app: 0|req: 1434/2910] 10.222.0.85 () {60 vars in 1365 bytes} [Tue Aug 2 10:24:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 10:24:33.783222 dv-cinder-850318-6-smb devstack@keystone.service[80329]: DEBUG dbcounter [-] [80329] Writing DB stats keystone:SELECT=58 {{(pid=80329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}